> ## Documentation Index
> Fetch the complete documentation index at: https://docs.scrapegraphai.com/llms.txt
> Use this file to discover all available pages before exploring further.
# Hermes Agent
> Give Nous Research's Hermes Agent the power of web scraping with schema-validated JSON
## Overview
[Hermes Agent](https://hermes-agent.nousresearch.com) is Nous Research's local-first, autonomous agent that gets sharper over time by turning completed tasks into reusable skills. The one thing it cannot do out of the box is read the live web reliably with structured output.
The ScrapeGraphAI [just-scrape](https://github.com/ScrapeGraphAI/just-scrape) skill fixes that. One install gives Hermes a clean scraping toolkit that returns schema-enforced JSON instead of markdown soup. Combined with Hermes' built-in cron scheduler, any scrape becomes a recurring agent that runs while you sleep.
Browse the CLI and skill source
## Prerequisites
| Requirement | Where to get it |
| ----------------------- | -------------------------------------------------------------------------------------------------------- |
| Hermes Agent installed | [hermes-agent.nousresearch.com](https://hermes-agent.nousresearch.com/docs/getting-started/installation) |
| Node.js 18+ | Used by the `just-scrape` CLI under the hood |
| A ScrapeGraphAI API key | [scrapegraphai.com/dashboard](https://scrapegraphai.com/dashboard) |
If you have not installed Hermes yet, this one-liner handles it on macOS, Linux, or WSL2:
```bash theme={null}
curl -fsSL https://raw.githubusercontent.com/NousResearch/hermes-agent/main/scripts/install.sh | bash
```
Reload your shell and type `hermes`. If it drops you into a chat prompt, you are ready.
## Setup
Grab your API key from the [dashboard](https://scrapegraphai.com/dashboard) and export it. Add it to your shell profile so Hermes inherits it on every launch:
```bash theme={null}
export SGAI_API_KEY=sgai-xxxxxxxxxxxxxxxxxxxx
```
The `just-scrape` skill is published on [skills.sh](https://www.skills.sh/scrapegraphai/just-scrape/just-scrape). Hermes has native skills.sh registry support, so one command pulls it down — and Hermes takes care of any tooling it needs on first use:
```bash theme={null}
hermes skills install skills-sh/scrapegraphai/just-scrape/just-scrape
```
Alternatively, install via the skills.sh CLI (requires Node.js 18+):
```bash theme={null}
npx skills add https://github.com/scrapegraphai/just-scrape --skill just-scrape
```
Either way, the skill lands in `~/.hermes/skills/` and is available the moment you start a new session.
```bash theme={null}
hermes skills list | grep just-scrape
```
You can audit any skill before installing it with `hermes skills inspect skills-sh/scrapegraphai/just-scrape/just-scrape`.
Hermes uses progressive disclosure for skills, so `just-scrape` only consumes tokens when the agent decides to use it.
## Run your first scrape
Start a fresh Hermes session and paste a URL. Hermes will read the skill, pick the right `just-scrape` subcommand, and return structured data:
```text theme={null}
> https://www.ebay.com/sch/i.html?_nkw=consoles
I want details of all the console products. Use the just-scrape skill.
```
Hermes calls `just-scrape extract` with a schema for title, price, condition, shipping, seller rating, and listing URL, then streams back a clean summary.
Because `just-scrape` returns schema-validated JSON, every listing comes back with the same fields in the same shape. No regex parsing, no markdown wrangling:
## Schedule recurring scrapes
Hermes has a built-in cron scheduler. Hand it a job in natural language and it figures out the schedule, prompt, and delivery target. Stay in the same chat session so Hermes has the context fresh, then send:
```text theme={null}
> Now set a cron for this to run every 3 hours and update me about new
listings or price changes.
```
Hermes calls its `cronjob` tool, writes the job, and confirms back:
Each run scrapes the page, compares the result with the previous run stored in memory, and sends a diff — new listings, removed listings, price changes. If nothing moved, you get a quiet "no changes" note instead of noise.
Manage jobs from chat:
```text theme={null}
/cron list
/cron pause
/cron resume
/cron remove
```
Or from the shell with `hermes cron list`. Cron sessions cannot create new cron jobs, so you cannot accidentally trigger runaway scheduling loops.
## What you can build
The pattern is always the same: scrape, persist, compare, alert. Swap the URL and prompt and you have a different agent.
* **Competitor pricing watch** — point it at a SaaS pricing page, schema the plan tiers, get a diff every Monday morning
* **Lead enrichment** — feed Hermes a CSV of company URLs, scrape each homepage, extract company name, industry, headcount, and latest news
* **Job board scraper** — watch a search on Wellfound or LinkedIn; new posting drops, you get a ping with the role, salary, and link
* **Release notes digest** — scrape changelog pages for tools you depend on, daily digest of what shipped
* **News digest** — `just-scrape search "AI news"` on a morning cron, top 5 stories summarized before your first meeting
## Support
Need help with the integration?
Report bugs and request features
Get help from our community