Examples →

Fetch a GitHub README for an AI agent

GitHub renders Markdown server-side, but agents that fetch the rendered HTML get tons of nav/footer noise. AgentFetch's Trafilatura pass strips it cleanly; for the rare repo where Trafilatura fails, Jina takes over.

Try it

Get a free key at agentfetch.dev (500 free fetches/mo, no credit card).

curl -X POST https://api.agentfetch.dev/fetch \
  -H "Content-Type: application/json" \
  -H "X-AgentFetch-Key: af_xxx" \
  -d '{
    "url": "https://github.com/anthropics/anthropic-cookbook",
    "max_tokens": 2000
  }'

In an MCP-aware agent

fetch_url(
  url="https://github.com/anthropics/anthropic-cookbook",
  max_tokens=2000,
)

In LangChain

from langchain_agentfetch import AgentFetchTool

tool = AgentFetchTool(api_key="af_xxx")
result = tool.run({"url": "https://github.com/anthropics/anthropic-cookbook"})

How it routes

AgentFetch automatically routes fetch github readme-style URLs through Trafilatura → Jina fallback based on domain heuristics — you don't pick a fetcher.

When agents reach for this

Index a repo, extract install instructions, summarize project purpose.

Related patterns

Fetch a Hacker News thread for an AI agent
Fetch a Twitter / X thread for an AI agent
Fetch an arXiv paper for an AI agent
Fetch and extract text from a PDF for an AI agent
Fetch a public Notion page for an AI agent
Fetch a Reddit thread for an AI agent