Examples โ
Fetch a Twitter / X thread for an AI agent
Twitter / X is JS-rendered behind a login wall โ local fetchers fail. AgentFetch auto-routes X URLs through FireCrawl, which renders the page and returns the visible thread (post + replies + quote tweets) as Markdown.
Try it
Get a free key at agentfetch.dev (500 free fetches/mo, no credit card).
curl -X POST https://api.agentfetch.dev/fetch \
-H "Content-Type: application/json" \
-H "X-AgentFetch-Key: af_xxx" \
-d '{
"url": "https://x.com/sama/status/1234567890",
"max_tokens": 2000
}'
In an MCP-aware agent
fetch_url(
url="https://x.com/sama/status/1234567890",
max_tokens=2000,
)
In LangChain
from langchain_agentfetch import AgentFetchTool
tool = AgentFetchTool(api_key="af_xxx")
result = tool.run({"url": "https://x.com/sama/status/1234567890"})
How it routes
AgentFetch automatically routes fetch twitter thread for agent-style URLs through
FireCrawl (JS-rendered) based on domain heuristics โ you don't pick a fetcher.
When agents reach for this
Brief on a viral thread, extract takeaways, build sentiment models.
Related patterns
Fetch a Hacker News thread for an AI agent
Fetch a GitHub README for an AI agent
Fetch an arXiv paper for an AI agent
Fetch and extract text from a PDF for an AI agent
Fetch a public Notion page for an AI agent
Fetch a Reddit thread for an AI agent