Examples →

Fetch a docs page for an AI agent

Documentation sites are gold for coding agents. AgentFetch extracts the main content from docs.python.org, ReadTheDocs, MkDocs, GitBook, Docusaurus, and most custom doc generators — stripping nav and search widgets, preserving code blocks.

Try it

Get a free key at agentfetch.dev (500 free fetches/mo, no credit card).

curl -X POST https://api.agentfetch.dev/fetch \
  -H "Content-Type: application/json" \
  -H "X-AgentFetch-Key: af_xxx" \
  -d '{
    "url": "https://docs.python.org/3/library/asyncio.html",
    "max_tokens": 2000
  }'

In an MCP-aware agent

fetch_url(
  url="https://docs.python.org/3/library/asyncio.html",
  max_tokens=2000,
)

In LangChain

from langchain_agentfetch import AgentFetchTool

tool = AgentFetchTool(api_key="af_xxx")
result = tool.run({"url": "https://docs.python.org/3/library/asyncio.html"})

How it routes

AgentFetch automatically routes fetch documentation for ai-style URLs through Trafilatura → Jina fallback based on domain heuristics — you don't pick a fetcher.

When agents reach for this

Coding agents that need API references, install instructions, examples.

Related patterns

Fetch a Hacker News thread for an AI agent
Fetch a Twitter / X thread for an AI agent
Fetch a GitHub README for an AI agent
Fetch an arXiv paper for an AI agent
Fetch and extract text from a PDF for an AI agent
Fetch a public Notion page for an AI agent