llms.txt llms.txt · AI Docs Browser · mdream [llms.txt Tools](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt) # llms.txt llms.txt Browse llms.txt documentation as markdown. Click any page in the sidebar to view it, or copy the full llms.txt for your AI tools. scrapegraphai.com/llms.txt [Raw llms.txt](https://scrapegraphai.com/llms.txt) [Raw llms-full.txt](https://scrapegraphai.com/llms-full.txt) Copy Markdown [](https://scrapegraphai.com/llms.txt) llms.txt Overview of ScrapeGraphAI Statistics Pricing Model API Services / doc scrape extract search crawl monitor Cost Breakdown: What's Included Key Use Cases Core Features MCP Server Integration Integrations Data Output Formats Authentication Usage Examples Getting Started Support & Resources https://docs.scrapegraphai.com https://github.com/ScrapeGraphAI/Scrapegraph-ai contact@scrapegraphai.com Topics We Cover Key Blog Posts & Resources Website https://scrapegraphai.com https://scrapegraphai.com/pricing https://docs.scrapegraphai.com https://scrapegraphai.com/blog https://scrapegraphai.com/compare https://scrapegraphai.com/for-startups https://github.com/ScrapeGraphAI/Scrapegraph-ai https://v2-api.scrapegraphai.com/api https://discord.gg/scrapegraphai https://twitter.com/scrapegraphai https://www.linkedin.com/company/101881123/ contact@scrapegraphai.com https://scrapegraphai.com/api-status https://github.com/ScrapeGraphAI/ScrapeGraphAI-manifesto https://scrapegraphai.com/privacy https://scrapegraphai.com/terms Glossary Web Scraping glossary Data Extraction glossary Web Crawling glossary AI-Powered Scraping glossary Full index Why ScrapeGraphAI? Enterprise Features ## What is llms.txt's llms.txt? llms.txt publishes an `/llms.txt` file that provides AI systems with a structured index of its documentation. It follows the [llms.txt specification](https://llmstxt.org), organizing links to guides, API references, and tutorials under section headings so that LLMs like ChatGPT, Claude, and Gemini can quickly understand what llms.txt offers and where to find details. Issues Spec 20 Sections 29 Links 20.8 KB Size ~5.3k Tokens Sections: Overview of ScrapeGraphAI · Statistics · Pricing Model · API Services / doc · Cost Breakdown: What's Included · Key Use Cases · and 14 more ## Add llms.txt Docs to Your AI Assistant Select your tool to see how to add llms.txt's llms.txt as a documentation source. Cursor Windsurf Claude Code ChatGPT Zed Copilot 1. 1 Open any chat or composer panel 2. 2 Type @Docs and select "Add new doc" 3. 3 Paste the URL: https://scrapegraphai.com/llms.txt 4. 4 Wait for the green dot (indexing complete) 5. 5 Reference @Docs in chat when asking about llms.txt Cursor crawls the URL and indexes all subpages. Add a trailing slash to index child pages too. ## Spec Compliance 38 errors ## Frequently Asked Questions Where is llms.txt's llms.txt file? llms.txt publishes its llms.txt at https://scrapegraphai.com/llms.txt. This file provides a structured, markdown-formatted index of llms.txt's documentation that AI systems can consume to understand the project's APIs, guides, and references. How do I use llms.txt's llms.txt with AI coding assistants? Copy the llms.txt content and paste it into your AI assistant (Cursor, Windsurf, Claude, ChatGPT) as context. This gives the AI an accurate map of llms.txt's documentation so it can provide better code suggestions and answers about llms.txt. What does llms.txt's llms.txt contain? llms.txt's llms.txt contains 20 sections and 29 documentation links in 20.8 KB (~5.3k tokens). Key sections include Overview of ScrapeGraphAI, Statistics, Pricing Model, API Services / doc, Cost Breakdown: What's Included, Key Use Cases. How many tokens does llms.txt's llms.txt use? The concise llms.txt index is approximately 5.3k tokens (20.8 KB). Most AI assistants can fit this within their context window. For the full expanded documentation, look for an llms-full.txt variant which embeds all content inline. What is llms.txt? Python scraper based on AI. llms.txt's llms.txt file helps AI systems understand this by providing a structured overview of its documentation, making it easier for developers to get accurate AI-assisted help when working with llms.txt. Can I generate an llms.txt for my own project? Yes. Use the free llms.txt generator at mdream.dev/tools/llms-txt/generator to crawl your site and produce a spec-compliant llms.txt file. You can also validate existing files with the llms.txt validator. ## Browse More llms.txt Files [Claude](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt/claude) [Seth Hobson Intelligent automation and multi-agent orchestration for Claude Code](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt/agents) [Pulumi Infrastructure as code in real programming languages. Define, deploy, and manage cloud infrastructure on AWS, Azure, Google Cloud, Kubernetes, and 150+ providers using TypeScript, Python, Go, C#, Java, or YAML.](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt/pulumi) [World Monitor Real-time global intelligence dashboard - AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational awareness interface.](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt/worldmonitor) [Teleport: The easiest, most secure way to access and protect all your infrastructure Teleport is the Infrastructure Identity platform built for engineering and security teams that manage complex, distributed environments. The platform unifies identity, access, and policy for both human and machine users across cloud, on-prem, edge, and hybrid infrastructure. Teleport eliminates static credentials, implements least-privileged, zero trust access, and consolidates access control, audit, and policy enforcement. With cryptographic identity and ephemeral authorization at its core, Teleport protects against identity-based threats, improves engineering velocity, and ensures compliance across multi-cloud environments. Trusted by forward-thinking organizations, Teleport powers secure, scalable access to infrastructure with products including Zero Trust Access, Machine & Workload Identity, Identity Governance, and Identity Security.](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt/teleport) [Apache Superset Apache Superset is a modern, enterprise-ready business intelligence web application. It provides a no-code interface for building charts, a powerful SQL editor, support for nearly any SQL database, and beautiful visualizations. Superset is open source under the Apache 2.0 license.](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt/superset) [Netdata The fastest path to AI-powered full stack observability, even for lean teams.](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt/netdata) [VitePress Vite & Vue Powered Static Site Generator](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt/vitepress) [View all 99 projects ](https://mdream.dev/llms-txt/scrapegraph-ai/llms-txt) ## Related Tools [

llms.txt Generator

Generate an llms.txt for your own project.](https://mdream.dev/llms-txt/scrapegraph-ai/tools/llms-txt/generator) [

llms.txt Validator

Validate your llms.txt against the official spec.](https://mdream.dev/llms-txt/scrapegraph-ai/tools/llms-txt/validator) © 2026 [Harlan Wilton](https://github.com/harlan-zw) · [MIT](https://github.com/harlan-zw/mdream/blob/main/license) [GitHub](https://github.com/harlan-zw/mdream) [Discord](https://discord.com/invite/275MBUBvgP)