Crawling & Indexing
Setting up the crawler
Getting started with the Searchine crawler.Add & update content
Multiple domains support
Crawling frequency
Exclude specific URLs
Searchine Page Snippet
The page snippet is used to pass extra information to Searchine regarding the crawled page