• Support
  • FAQ
  •   Login
  •  Corporate site
  • English
  • Nederlands
  •   Login
  •   Corporate site
    English Nederlands
Getting started with Searchine
  • What is Searchine Site Search?
  • Extensible Widgets
  • Supported Content Management Platforms
  • Definitions of terms
Installing
  • Embedded widget
  • Advanced widget
  • Search suggestions widget
  • Examples
  • Content Management Systems plugins
  • Content Security Policy
Crawling & Indexing
  • Crawler setup
  • Add & update content
  • Multiple domains support
  • Crawling frequency
  • Exclude specific URLs
  • Searchine Page Snippet
  • Robots meta tag
  • Add allowed URL parameters
  • Synonyms & stopwords
Frequently asked questions
Crawling & Indexing
Crawling frequency
  • Crawler setup
  • Add & update content
  • Multiple domains support
  • Exclude specific URLs
  • Searchine Page Snippet
  • Robots meta tag
  • Add allowed URL parameters
  • Synonyms & stopwords

Crawling frequency

Searchine Site Search adds new content from your site automatically. This process is called crawling and is done on regular basis that depends on your subscription.

  • Starter: Weekly
  • Standard: Daily
  • Pro: Continuously​

In normal circumstances you don't have to worry about this crawling process. In situations with more content available there are more options available. Take a look at add & update content or contact us for more information. 

Multiple domains support
Exclude specific URLs
© Searchine 2025  | 
 Terms of Use
 Privacy Policy
Corporate  |  Contact