Examples

Fetch a Reddit thread for an AI agent

Reddit's old.reddit.com works with local fetchers, but new.reddit is heavily JS-gated. AgentFetch auto-routes reddit.com URLs to FireCrawl and returns the post body + visible comments as Markdown.

Try it

Get a free key at agentfetch.dev (500 free fetches/mo, no credit card).

curl -X POST https://api.agentfetch.dev/fetch \
  -H "Content-Type: application/json" \
  -H "X-AgentFetch-Key: af_xxx" \
  -d '{
    "url": "https://www.reddit.com/r/LocalLLaMA/comments/1abc234",
    "max_tokens": 2000
  }'

In an MCP-aware agent

fetch_url(
  url="https://www.reddit.com/r/LocalLLaMA/comments/1abc234",
  max_tokens=2000,
)

In LangChain

from langchain_agentfetch import AgentFetchTool

tool = AgentFetchTool(api_key="af_xxx")
result = tool.run({"url": "https://www.reddit.com/r/LocalLLaMA/comments/1abc234"})

How it routes

AgentFetch automatically routes fetch reddit thread-style URLs through FireCrawl (JS-rendered) based on domain heuristics — you don't pick a fetcher.

When agents reach for this

Build a community-monitoring agent, summarize discussion threads.


Related patterns

Fetch a Hacker News thread for an AI agent
Fetch a Twitter / X thread for an AI agent
Fetch a GitHub README for an AI agent
Fetch an arXiv paper for an AI agent
Fetch and extract text from a PDF for an AI agent
Fetch a public Notion page for an AI agent