Instead of monitoring individual pages one by one, Changeflow can track an entire website for you. This includes all existing pages and automatically monitors new pages as they're added to the site.

Request entire site tracking form

When to Track an Entire Site

Entire site tracking is perfect for:

  • Competitor monitoring: Track everything a competitor publishes - blog posts, product pages, case studies, documentation
  • Regulatory compliance: Monitor an entire regulatory agency website for any new guidance or updates
  • News and media: Track all articles published on a news site or publication
  • Supplier/vendor monitoring: Monitor all content from key suppliers or partners
  • Franchise/multi-location businesses: Track every location or franchise page
  • Documentation sites: Monitor an entire documentation site for updates across all pages
  • E-commerce competitors: Track all products, categories, and content on competitor stores
  • Job boards: Monitor all job postings on a careers site

How Entire Site Tracking Works

What Gets Monitored

When you request entire site tracking, we'll monitor:

  1. All existing pages on the site
  2. The sitemap (if available) to discover new pages automatically
  3. New pages that get added over time

This means you don't just get notified of changes to existing pages - you also get alerts when brand new pages appear on the site.

Automatic New Page Detection

As the site grows and adds new content, Changeflow automatically:

  • Detects new pages via sitemap monitoring
  • Discovers new pages through link crawling
  • Sets up monitoring for new pages with the same configuration
  • Notifies you when new pages appear

Example: If you're tracking a competitor's blog and they publish a new post, you'll get notified about the new page immediately, not just when you manually add it.

How to Request Entire Site Tracking

Step 1: Access the Feature

  1. Go to your Sources page in Changeflow
  2. Click the plus icon in the blue circle
  3. Select "Track an entire site"

Step 2: Provide Site Details and Configuration

You'll provide:

Required:

  • The site you want to track (e.g., https://competitor.com)

In the "Any other details?" field, tell us:

What to monitor:

  • Do you want ALL pages or a specific subset?
  • Which sections or page types to include/exclude?
  • Example: "Track only the blog, exclude footer pages and privacy policy"
  • Example: "Track all product pages under /products, but not category pages"

How often to check:

  • Your preferred check frequency
  • Example: "Check daily at 9am"
  • Example: "Check hourly during business hours"

What to check for:

  • What changes matter to you?
  • Example: "Alert me to new blog posts and pricing changes"
  • Example: "Track all new content, particularly interested in new product launches"
  • Example: "Monitor for any changes to documentation pages"

Organization:

  • Tags to apply
  • Example: "Tag all sources with #competitors and #blog"

Step 3: Submit and Wait

  1. Submit your request
  2. Our team will review and set up tracking
  3. We'll configure monitoring for all relevant pages
  4. You'll receive an email when setup is complete
  5. All sources will appear in your Sources page

Typical turnaround times:

  • Small sites (<100 pages): Within 24 hours
  • Medium sites (100-500 pages): 1-2 business days
  • Large sites (500+ pages): 2-3 business days
  • Urgent requests: Contact [email protected]

Example Requests

Here are examples of well-specified entire site tracking requests:

Competitor Blog Monitoring

"Please track the entire blog at https://competitor.com/blog. I want to know immediately when they publish new posts. Check hourly. For each post, I'm particularly interested in the title, publish date, author, and main topics covered. Tag all sources with #competitors and #blog."

Regulatory Compliance

"Track all guidance documents on https://fda.gov/guidance. Check weekly on Mondays. Alert me to new guidance documents and any updates to existing documents. Tag with #regulatory and #fda. I want individual email notifications for each new or changed document."

E-commerce Competitor

"Monitor all product pages on https://competitor-store.com/products. Check daily at 9am. Track pricing changes, new products, and product discontinuations. Tag with #competitors and #ecommerce. Group notifications - I'd prefer a daily digest showing all product changes rather than individual emails."

Job Market Intelligence

"Track all job postings at https://company.com/careers and all their subsidiary career sites. Check daily at 8am. I'm interested in job title, location, department, and posting date. Tag with #talent and #company-name. This will help us understand their hiring strategy and growth plans."

Documentation Monitoring

"Monitor the entire documentation site at https://docs.product.com. Check weekly. Alert me to new documentation pages and significant updates to existing pages (ignore minor typo fixes). Tag with #product-docs and #competitor-intel."

Scope Considerations

Monitoring Entire Site vs. Specific Sections

Entire site tracking is best when:

  • The whole site is relevant to you
  • You don't want to miss anything
  • Site is relatively focused (not massive)
  • New pages could appear anywhere

Section-specific tracking is better when:

  • Only certain sections are relevant (e.g., just the blog, not marketing pages)
  • Site is very large and you'd get overwhelmed with notifications
  • You have budget/check limits and want to prioritize
  • Different sections need different monitoring approaches

Excluding Irrelevant Pages

You can exclude pages or sections to focus on what matters:

Common exclusions:

  • Footer pages: Privacy policy, terms of service, cookie policy
  • Administrative pages: Login, account settings, shopping cart
  • Marketing fluff: About us, contact us, press releases (unless those are relevant)
  • Duplicate content: Print versions, PDF versions of web pages
  • Template pages: Style guides, component libraries

Example: "Track https://competitor.com but exclude /legal, /privacy, /terms, /contact, and /about pages. Focus on product pages, blog, and documentation."

Managing Notification Volume

Tracking an entire site can generate many notifications. Here are strategies to avoid overwhelm:

Use Digests Instead of Individual Alerts

Instead of getting an email for every single page change:

  • Request daily or weekly digest notifications
  • Group changes by section or page type
  • Get summaries rather than individual alerts

Apply Smart Filtering

Use prompts to filter what triggers notifications:

  • "Only notify me of significant changes, not minor typo fixes"
  • "Alert on new pages, but only major updates to existing pages"
  • "Track pricing changes only, ignore other content updates"

Use Tags and Email Filters

Organize notifications with:

  • Tags for different sections: #blog, #products, #docs
  • Email filters to route notifications to folders
  • Different notification channels for different priorities

Adjust Check Frequency

Not all pages need hourly checks:

  • High-priority sections: Hourly or daily
  • Medium-priority sections: Daily
  • Low-priority sections: Weekly
  • Archives or rarely updated sections: Monthly

After Setup

Once your entire site tracking is active:

Review the Configuration

  1. Check your Sources page - you'll see many new sources
  2. Review how they're organized (tags, naming)
  3. Wait for first check cycle to complete
  4. Verify notifications are working as expected

Tune and Refine

After a few days:

  • Too many notifications? See too many notifications guide
  • Missing changes? Adjust prompts or frequency
  • Irrelevant pages? Pause or delete specific sources
  • New sections added? Request additional tracking

Monitor New Page Detection

Pay attention to notifications about new pages:

  • Are you being notified when new pages appear?
  • Are new pages being monitored automatically?
  • Do new pages need different configuration than existing ones?

Cost

Setting up entire site tracking is free - there's no charge for our team to configure all the sources. You only pay for the monitoring itself based on your plan.

Cost considerations:

  • Tracking 100 pages checking daily = 100 source-check cycles per day
  • Consider check frequency vs. your plan limits
  • Start with less frequent checking if needed, increase later
  • We can help you optimize cost vs. coverage

Technical Details

Sitemap Monitoring

If a site has a sitemap (most modern sites do), we'll monitor it to automatically detect new pages:

  • XML sitemaps at /sitemap.xml
  • Sitemap index files
  • Dynamic sitemaps
  • Multiple sitemaps for different sections

Page Discovery Methods

We use multiple methods to ensure comprehensive coverage:

  1. Sitemap parsing: Read all URLs from site's sitemap
  2. Link crawling: Follow internal links to discover pages not in sitemap
  3. Pattern detection: Identify URL patterns to discover systematic pages
  4. Regular re-crawls: Periodically re-scan site to catch new pages

Updates to Site Structure

When sites redesign or restructure:

  • Existing sources automatically adapt (self-healing monitoring)
  • New structure is detected and incorporated
  • We can reconfigure tracking if major changes occur
  • Contact us if you notice issues after site redesign

Alternatives

If entire site tracking isn't quite right:

  • Bulk import: Import a list of specific URLs you've identified
  • Chatbot setup: Set up a smaller set of pages conversationally
  • API integration: Programmatically manage sources (enterprise)

See our guide on too many sources to setup manually for all options.

Getting Help

For assistance with entire site tracking:

  • Email: [email protected]
  • Questions before requesting: Contact us to discuss scope and approach
  • Mid-setup questions: We may reach out if we need clarification
  • Post-setup adjustments: We can modify configuration as needed

We're here to help you set up comprehensive, scalable monitoring that actually works for your workflow!