Index every page your competitors rank for. Extract their keyword strategy, content structure, and meta patterns — then close the gap fast.
START FOR FREE →Page title, meta description, OG tags — what they tell search engines
H1–H6 hierarchy, keyword density, topic clusters
Full page text for semantic keyword analysis and gap identification
How they structure and label their internal links
Add competitor URLs or entire sitemaps. We crawl and extract every indexable page automatically.
All content is chunked, embedded, and stored in your searchable index — no setup required.
Search "what topics do competitors cover that we don't?" and get specific answers with sources.
Export the insights, feed them into your content calendar, and close the gap systematically.
Use the sitemap endpoint to discover all competitor URLs, then bulk-extract them. Every page becomes searchable knowledge — titles, headings, body, meta tags.
Run semantic search across the entire corpus to find content gaps, keyword patterns, and topics you haven't covered yet.
STEP 1 — DISCOVER ALL PAGES
# Get full sitemap
curl -X POST \
https://api.knowledgesdk.com/v1/sitemap \
-H "x-api-key: knowledgesdk_live_..." \
-d '{ "url": "https://competitor.com" }'
// → returns all URLs on the domain
STEP 2 — EXTRACT & INDEX EACH PAGE
# Extract and store for search
for url in urls:
POST /v1/extract
{ "url": url, "store": true }
# Then search across all content
POST /v1/search
{ "query": "topics they rank for that I don't" }