# llms.txt
## About
https://keywordly.ai: **Keywordly.ai** is an all-in-one SEO content workflow platform that helps users research keywords, generate and optimize content, and perform audits to improve search engine performance. It offers tools for keyword clustering, topical mapping, automatic content creation, and AI-powered optimization. The platform also tracks brand and content visibility across traditional search engines like Google and Bing, as well as AI-based platforms like ChatGPT. With automation features and analytics, Keywordly.ai aims to boost brand visibility and drive organic traffic efficiently.
## 1. LLM Directives
- User-agent: *
- Allow: /
- Disallow: /register
- Disallow: /checkout
- Disallow: /login
- Disallow: /api/
- Disallow: /wp-admin
- Disallow: /wp-login.php
- Crawl-delay: 5
- Sitemap: https://keywordly.ai/sitemap.xml
## 2. Site Structure
- [OpenGraph Image](https://keywordly.ai/opengraph-image.jpg): Instantly preview the rich social media image that represents the Keywordly brand for link sharing.
- [Robots.txt](https://keywordly.ai/robots.txt): Explore how Keywordly manages search engine crawling and indexing across its site.
- [Auto Pilot](https://keywordly.ai/auto-pilot): Discover how you can automate your SEO and content creation workflow using AI-powered autopilot features.
- [About](https://keywordly.ai/about): Get insights into Keywordly’s mission, team, and commitment to transforming AI-powered digital marketing.
- [Advantage](https://keywordly.ai/advantage): Learn the unique benefits and features that give Keywordly users a real SEO edge.
- [Affiliate](https://keywordly.ai/affiliate): Uncover how to partner with Keywordly and earn commissions while promoting cutting-edge AI SEO tools.
- [AI Content Detector](https://keywordly.ai/ai-content-detector): Reveal whether your content sounds machine-written or human by leveraging advanced AI detection technology.
- [AI Content Generator](https://keywordly.ai/ai-content-generator): Generate original, high-quality content in seconds for blogs, websites, and more using artificial intelligence.
- [AI Content Idea Generator](https://keywordly.ai/ai-content-idea-generator): Never run out of ideas again—instantly brainstorm unique article and blog post topics powered by AI insights.
- [AI Humanizer](https://keywordly.ai/ai-humanizer): Transform robotic-sounding AI text into engaging, human-like content that resonates with real readers.
- [Amazon Keyword Tool](https://keywordly.ai/amazon-keyword-tool): Amplify your Amazon listings with targeted, high-converting keywords discovered through smart data analysis.
- [Bing Keyword Tool](https://keywordly.ai/bing-keyword-tool): Optimize for Bing search with data-driven keyword suggestions to outpace your competitors.
- [Cancellation](https://keywordly.ai/cancellation): Manage or cancel your Keywordly subscription hassle-free with easy-to-follow steps and guidance.
- [Caption Generator](https://keywordly.ai/caption-generator): Create catchy and compelling captions for your social posts or images using AI-driven creativity.
- [Contact](https://keywordly.ai/contact): Reach out directly to the Keywordly support and partnership team for fast assistance and collaboration.
- [Conclusion Generator](https://keywordly.ai/conclusion-generator): Automatically craft strong, memorable conclusions for your articles that keep your audience hooked until the end.
- [FAQs](https://keywordly.ai/faqs): Find answers to the most common questions about Keywordly’s AI tools and services—all in one place.
- [Free Content Writing Tools](https://keywordly.ai/free-content-writing-tools): Access a suite of free, AI-powered content creation tools designed to simplify your writing process.
- [Free SEO Tools](https://keywordly.ai/free-seo-tools): Elevate your website’s performance with powerful, no-cost SEO utility tools backed by intelligent analysis.
- [Geo Score Analyzer](https://keywordly.ai/geo-score-analyzer): Analyze your website’s local SEO performance with geographic insights to boost region-based rankings.
- [Hook Generator](https://keywordly.ai/hook-generator): Instantly generate irresistible hooks and intros to capture and retain your readers’ attention from the start.
- [Image Alt Text Generator](https://keywordly.ai/image-alt-text-generator): Create relevant and SEO-friendly alt text for your images automatically to improve accessibility and rankings.
- [Keyword Generator](https://keywordly.ai/keyword-generator): Unlock a stream of high-value keywords tailor-made for your industry or niche in just a few clicks.
- [Landing Page Generator](https://keywordly.ai/landing-page-generator): Launch high-converting landing pages effortlessly with smart AI assistance for content and structure.
- [Life Time Deal](https://keywordly.ai/life-time-deal): Secure lifetime access to all of Keywordly’s powerful features with one unbeatable purchase.
- [Meta Description Generator](https://keywordly.ai/meta-description-generator): Craft effective, SEO-optimized meta descriptions with ease to improve your click-through rates.
- [Outline Generator](https://keywordly.ai/outline-generator): Get structured, SEO-friendly article outlines automatically generated to kickstart your writing process.
- [Paragraph Rewriter](https://keywordly.ai/paragraph-rewriter): Quickly rephrase and enhance your paragraphs to create fresh, unique content and avoid duplication.
- [Paraphrasing Tool](https://keywordly.ai/paraphrasing-tool): Paraphrase your text intelligently to maintain meaning while boosting originality and clarity.
- [Plagiarism Checker](https://keywordly.ai/plagiarism-checker): Ensure your content is 100% unique with advanced plagiarism detection and reporting.
- [Pricing](https://keywordly.ai/pricing): Explore flexible and competitive plans designed to fit businesses and creators of all sizes.
- [Product Description Generator](https://keywordly.ai/product-description-generator): Automatically generate persuasive and SEO-ready product descriptions in moments.
- [Security](https://keywordly.ai/security): See how Keywordly protects user data and ensures secure, compliant operations across its platform.
- [Sentence Rewriter](https://keywordly.ai/sentence-rewriter): Instantly rewrite sentences for improved readability, uniqueness, and engagement.
- [SEO Blog Post Generator](https://keywordly.ai/seo-blog-post-generator): Harness AI to produce comprehensive, well-optimized blog posts designed to rank higher.
- [SEO Content Score Checker](https://keywordly.ai/seo-content-score-checker): Instantly evaluate your content’s SEO effectiveness and pinpoint areas for improvement.
- [SEO Text Rewriter](https://keywordly.ai/seo-text-rewriter): Effortlessly rewrite your existing content with SEO in mind to maximize visibility online.
- [Summary Generator](https://keywordly.ai/summary-generator): Compress long articles into sharp, insightful summaries and extract their key messages.
- [Tag Generator](https://keywordly.ai/tag): Generate relevant tags for your content to boost discoverability and SEO performance.
- [Terms](https://keywordly.ai/terms): Read through the latest terms and conditions governing the use of Keywordly’s services.
- [Title Generator](https://keywordly.ai/title-generator): Craft compelling, SEO-friendly titles for blog posts, articles, and web pages with a single click.
- [Video Script Generator](https://keywordly.ai/video-script-generator): Script engaging videos for YouTube, courses, or marketing campaigns effortlessly with AI help.
- [Website Copy Generator](https://keywordly.ai/website-copy-generator): Instantly develop high-impact, conversion-focused website copy powered by artificial intelligence.
- [Word Counter](https://keywordly.ai/word-counter): Accurately count words, characters, and more for any piece of content, ensuring you hit your goals.
- [YouTube Keyword Tool](https://keywordly.ai/youtube-keyword-tool): Find trending and relevant keywords to maximize your YouTube channel’s reach and performance.
- [YouTube Name Generator](https://keywordly.ai/youtube-name-generator): Brainstorm fresh and memorable channel names to stand out on YouTube.
- [YouTube Script Writer](https://keywordly.ai/youtube-script-writer): Create ready-to-record, structured scripts for your YouTube videos in minutes.
- [Privacy Policy](https://keywordly.ai/privacy): Learn how Keywordly collects, uses, and protects your personal information.
- [YouTube Video Description Generator](https://keywordly.ai/youtube-video-description-generator): Generate search-optimized, clickable descriptions for your YouTube content instantly.
- [Editor](https://keywordly.ai/editor): Experience a modern, AI-enhanced writing and content editing environment for all your projects.
- [Blog](https://keywordly.ai/blog): Dive into expert articles, industry tips, and updates on the latest trends in SEO and AI content creation.
## 3. Pages to Avoid
Avoid crawling any paths that:
- Require authentication or sessions (/account/, /dashboard, /admin/, /wp-login.php, etc.)
- Are checkout/cart related or intermediate forms
- Include query string heavy endpoints (?, search, filters, session IDs)
- Are asset-heavy (e.g., images, CSS/JS aggressively) to focus LLM bandwidth on text
## 4. Guidance for Developers
- Ensure XML sitemap is up-to-date and accessible at /sitemap.xml or /sitemap_index.xml
- Steer clear of overly dynamic URLs; prefer human-readable static URLs
- Embed contextual metadata (e.g., schema.org Product, Breadcrumbs) to improve semantic parsing
- Group content into clear sections (Products, Services, About, Blog, Careers) for structured LLM consumption
- Include on priority pages
- For non-priority/form pages, use or server-side restrictions
- Regularly monitor server logs for crawler behavior; tune Crawl-delay or disallowed paths as needed
- Log and monitor LLM crawl behavior
- Ensure consistency with robots.txt and sitemap.xml
- Version control this llms.txt alongside robots.txt and sitemap.xml to align site-crawling policies
## 5. Summary and Best Practices
- **Permit** LLM crawling for all public, content‑rich pages.
- **Prevent** crawling of private or form‑filled endpoints.
- Use **Crawl‑delay** and **Clean‑param** to protect server load and avoid duplicate content.
- Keep **__priority list__** in sync with sitemap updates.
- **Document and version** llms.txt for alignment across SEO, dev, and content teams.
**Last Updated:** 1 Feb 2026