Scrape URL to Markdown
Any public page as clean, LLM-ready markdown. Handles JS-rendered sites; links preserved, nav and footer stripped.
POST https://api.bottrunk.com/s/scrape-markdown
Call it
# Ask. You get a 402 with the payment requirements.
curl https://api.bottrunk.com/s/scrape-markdown \
-d '{"url": "https://example.com/pricing"}'
# Pay and retry. Any x402 client does this for you.
curl https://api.bottrunk.com/s/scrape-markdown \
-H "X-PAYMENT: <signed USDC transfer>" \
-d '{"url": "https://example.com/pricing"}'
from x402.clients import requests as x402_requests
session = x402_requests.x402_http_adapter(account)
r = session.post(
"https://api.bottrunk.com/s/scrape-markdown",
json={"url": "https://example.com/pricing"},
)
print(r.json()["markdown"])
{ "mcpServers": { "bottrunk": { "url": "https://mcp.bottrunk.com" } } }
# then call the tool `scrape_markdown` from your agent
Input
| url | string | Public http(s) URL to fetch. |
| render_js | boolean | Reserved: headless rendering is not available yet; the flag is accepted and ignored. |
| selector | string | Optional CSS selector to scope the extraction. |
Output
| markdown | string | Body content as GitHub-flavored markdown. |
| title | string | Document title. |
| word_count | integer | Words in markdown, for budgeting tokens. |