Compare Pages and Competitor Websites | CrawlNFix
Compare bulk keyword lists across selected page groups, bounded website crawls and public e-commerce content. Review coverage, filters and local saved-content…
Use this guide when several pages describe the same service, product family or subject and you want a repeatable way to compare their content. CrawlNFix accepts keyword lists, groups of selected URLs and bounded website crawls. It also compares saved HTML or text on your device after the tool loads. Start with a clear question: which relevant topics and phrase placements are visible in the documents you actually analyzed?
Quick answer
Open Keyword & Competitor Comparison, paste a keyword per line or import a TXT/CSV list, and choose selected pages or website crawl. Put your URLs in the first group and each competitor in a separate group. Run the comparison, inspect coverage, then filter by keyword, competitor, measured area, phrase frequency and page type. Review evidence before changing any page.
Why this matters
A homepage, a product page and a long informational article serve different purposes. Mixing them can make a phrase list look impressive while answering the wrong question. Collection boundaries and crawl coverage explain what the tool measured. A missing phrase is an observation about sampled content; it does not establish demand, ranking difficulty, a product requirement or a reason to copy someone else.
In-depth explanation
Start with selected pages when you already know which documents should be comparable. This avoids spending a crawl budget on unrelated blog posts, policies or navigation pages. Bulk lists are especially useful for product families, several service locations or an editorial topic cluster. Keep each competitor's collection understandable so aggregate word counts and phrase occurrences have a useful context.
Website mode answers a discovery question rather than guaranteeing exhaustive coverage. Public HTML links and bounded sitemap reads can expose pages, while robots rules and excluded transaction paths remove others. JavaScript-only navigation, access restrictions, response errors and operational budgets can leave sections unseen. Read the coverage notes and compare similar sections before making a business decision.
Saved-content mode provides a separate workflow for pages you already have permission to review. You can paste one document or select several HTML/text files in a group. The content is parsed as data and is not executed. Reproducibility still matters: keep the source version and date, because an older saved competitor page is not necessarily the current public page.
E-commerce evidence is deliberately narrow. A product classification may come from its URL shape or parsed schema. Product and Offer types, SKU, price, currency and availability are reported when found in structured data. Missing evidence is not a statement that a business lacks the product, uses the wrong price or has no stock. A proper commerce audit may require additional platform-specific validation outside this tool.
What to check
- Choose a small set of relevant keyword phrases and keep their language consistent with the pages. Up to 100 unique keywords fit a run; very large page lists need smaller keyword batches within the stated processing budget.
- Collect comparable pages: service pages against service pages, product pages against similar products, or categories against categories. A competitor group may contain several URLs.
- Decide whether you need selected-page evidence or a broader public website crawl. Website mode follows permitted same-origin links and sitemap entries within page, byte and time budgets.
- Check whether a page depends on JavaScript for its main copy. Online comparison reads HTML and does not execute scripts; saved rendered HTML may contain evidence the initial response lacks.
- For public e-commerce pages, distinguish a product URL hint from actual Product schema. Review observed offers, currency, price and availability without treating them as a checkout or inventory test.
Manual fix steps
- Prepare the input. Put each keyword on its own line, or import the first column of a keyword CSV. Remove accidental headers, irrelevant brands and phrases that describe features your site does not provide. Keep a local copy of the source list.
- Enter your selected page URLs one per line. Add a competitor group for each competing site, then add that competitor's relevant pages to its own list. Do not put identical URLs into several groups because that would confuse the comparison.
- Choose website crawl only when broader discovery will answer your question. Keep seed URLs in a group on one origin. Start with a modest page budget, read the stop reason and add a more specific seed or a second run when important sections were not reached.
- Run the comparison and review coverage before the metrics. A restricted competitor, blocked robots path or truncated source must not silently become zero words or an invented gap. Compare the successful evidence and keep the missing coverage visible.
- Use the keyword filter to inspect one phrase at a time. The competitor selector narrows the displayed comparison. Measured-area filters separate placement from headings and schema, while phrase search and minimum occurrences narrow the collection-wide gap candidates.
- Apply a relevant manual change in your CMS or source template. Improve the page explanation, title or heading only where it makes the document clearer. Preserve useful content, accessibility and normal navigation. The comparison does not rewrite or publish your site.
Verification checklist
- Use Rescan comparison with the same inputs after your change is deployed. A changed URL set or crawl budget creates a different sample and can explain apparent improvements unrelated to your edit.
- Check the per-page evidence, including title, H1, description, URL placement and repeated/chrome counts. Main-body exact matches stay within text-block and sentence boundaries. Aggregate placement means a phrase was found on at least one analyzed page; it does not mean every page has that phrase in its title or H1.
- Export JSON or CSV for the full matrix. The compact PDF contains findings and shared collection gaps once; enable the detailed PDF appendix for all page and keyword evidence. On-screen filters affect the view; the export explains the complete measured run.
- For local verification, load the tool, choose saved-content mode, disconnect the network and compare saved pages. This checks local processing after assets load; it does not establish fresh offline app startup.
- Use Clear data before a different project. It removes input lists, selected uploaded files, errors and current results. A cancelled in-flight request must not repopulate an old result.
Workflow resources
Common mistakes
- Calling the bounded crawl a complete inventory when page, time or byte limits stopped discovery.
- Adding competitor brands or buying a feature because it appears in a repeated phrase list.
- Interpreting more schema types, a higher phrase count or a longer page as proof of better rankings.
- Including cart, payment, account or private token URLs; comparison accepts public content and excludes transaction flows.
- Treating an observed JSON-LD price as a verified live checkout price or using missing source markup to prove a product is unavailable.
Practical example
A shop sells running shoes on two product pages and one collection page. The owner compares three relevant phrases against two competing shops, each with its own product and collection list. One phrase appears on the owner's collection but not the product descriptions. That is a page-placement finding. The owner adds a clear explanation where it answers a real customer question, then rescans the same selected URLs. A competitor's unrelated subscription promotion is ignored rather than copied.
Frequently asked questions
Does a bulk keyword report show Google positions?
No. It measures exact phrase placement and content observations from the supplied or crawled pages. Rankings, search volume, CPC, backlinks and actual AI citations are not measured.
Can I compare more than five keywords?
Yes. Paste or import up to 100 unique keywords per run. Larger page collections may need smaller batches within the stated page-keyword processing budget. There is no paid upgrade or daily quota for this feature; short-term server protection still applies.
Can I compare a whole shop?
Website mode can crawl permitted public store pages within its displayed budget. It excludes cart, checkout, payment, account and login paths. Coverage shows what was actually analyzed instead of claiming that an incomplete crawl covered the entire store.
Where should I go next?
Open the dedicated comparison tool to run a test. Use the related bulk comparison article for conceptual examples, the SEO audit for diagnostic evidence and the site crawler when you need a broader link graph.
Related diagnostic and explanation
Related guides
All public pages · Diagnostic tools · Fix guides · Run a website scan · Articles · Check library