www: SEO/AEO audit fixes (sitemap, robots, JSON-LD, canonicals)#95
Draft
bholmesdev wants to merge 1 commit intomainfrom
Draft
www: SEO/AEO audit fixes (sitemap, robots, JSON-LD, canonicals)#95bholmesdev wants to merge 1 commit intomainfrom
bholmesdev wants to merge 1 commit intomainfrom
Conversation
- Set `site` to https://simple-stack.dev in astro.config so Astro and Starlight emit absolute canonical, Open Graph, and Twitter URLs. - Add @astrojs/sitemap integration. Generates sitemap-index.xml and per-page entries on build. - Add public/robots.txt referencing the sitemap and explicitly allowing AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, Google-Extended, ClaudeBot) to improve AEO / AI citation visibility. - Inject site-wide Organization JSON-LD via Starlight `head` config so AI engines and search engines can identify the project as an entity. - Add a top-level `description` to the Starlight config so non-frontmatter pages inherit a meaningful default meta description. - Rework the homepage frontmatter: removed the redundant `head: title` override that suppressed the brand template, replaced the emoji-only title with a descriptive one, and expanded the meta description with product-name keywords. Co-Authored-By: Oz <oz-agent@warp.dev>
|
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
SEO/AEO audit of
simple-stack/wwwThis PR is the result of an SEO + AEO audit of the Starlight docs site at
simple-stack.dev. It addresses the highest-impact
findings while staying minimal and self-contained.
Findings (highlights)
Critical
siteconfigured inastro.config.mjs. Without it, Astro/Starlightcannot emit absolute canonical URLs, the canonical/
og:url/twitter:urltags fall back to relative paths, and
@astrojs/sitemapcannot run.robots.txt. AI crawlers (GPTBot, OAI-SearchBot, PerplexityBot,Google-Extended, ClaudeBot, etc.) had no explicit signal and no sitemap
pointer.
High
show Organization + FAQPage JSON-LD as the highest-leverage schema for
AI citations.
<title>toSimple stack 🌱(anemoji-only title), which suppressed Starlight's brand template and
produced a SERP entry with weak keywords.
descriptionwas generic ("A suite of tools built for Astroto simplify your workflow.") and missing the product names that drive
branded queries.
Medium / Ongoing (not in this PR — see below)
should likely be
noindexand excluded from the sitemap so AI/searchdon't surface unmaintained content.
ChatGPT/Perplexity/Google AI Overviews citations.
astro-partial-rendering-demo.mp4~14MB,simple-stream-intro.mov~3.4MB) ship frompublic/assets/on everydeploy. Host externally or
<video preload="none">with a poster.Changes in this PR
siteURL configured —https://simple-stack.devadded toastro.config.mjs. Enables absolute canonical/OG/Twitter URLs.@astrojs/sitemapintegration. Emitssitemap-index.xmlplussitemap-0.xmlon build.robots.txt— Newwww/public/robots.txtreferencing the sitemapand explicitly allowing major AI crawlers (AEO).
headconfig so AI engines and Google can disambiguate the project as an
entity (
name,url,logo,description,sameAs).descriptionsopages without frontmatter
descriptioninherit a meaningful default.head: titleoverride,replaced the emoji-only title with a descriptive one, and expanded the
description to include the product names that drive branded search.
Note on the existing
oz/seo-aeo-audit-wwwbranchA previous remote branch with a similar name already exists (Ben's
commit
2b5ee58) and goes further: it also adds FAQPage JSON-LD to thehome page, marks deprecated docs
noindex, and excludes them from thesitemap. Consider merging the two — that branch is a good template for
the "Suggested follow-ups" section above.
Suggested follow-ups (not in this PR)
noindexdeprecatedstream.mdandform/*.md{x}and exclude themfrom the sitemap with
sitemap({ filter: ... }).FAQPageJSON-LD to home +store.mdx/query.mdx/scope.mdxcovering "What is …", "How do I install …", "Is it production-ready?".
og:imageand reference it from Starlighthead..mp4/.movfiles out ofpublic/or lazy-load.Validation
pnpm installwas attempted in the sandbox to runastro build, but thesandbox network timed out before it completed. The changes are
configuration-only and follow the documented Starlight +
@astrojs/sitemappatterns; please run
pnpm install && pnpm --filter docs buildlocallyto verify.
Conversation: https://app.warp.dev/conversation/0b12e656-aa9e-4a08-ae5b-2ba337858621
Run: https://oz.warp.dev/runs/019ddd9d-dd42-7c07-9e12-82d2e0bb3366
This PR was generated with Oz.