Full Site Index Mode (FSIM)

Overview

Full Site Index Mode (FSIM) is a specialized crawling mode for the SearchFur search engine. When activated, FSIM dedicates all available resources to comprehensively index a single website.

Purpose

FSIM aims to create a complete index of all pages within a specified website, ensuring thorough coverage of its content.

Functionality

• Concentrates all crawling resources on one website

• Attempts to index every accessible page within the target site

• Temporarily suspends crawling and updates for all other websites

User Impact

While FSIM is active, users may experience:

• Outdated information for non-FSIM websites

• Slower search response times

• Potential search failures for recent content on non-FSIM sites

Resource Allocation

SearchFur has limited resources. FSIM optimizes these for deep, single-site crawling at the expense of broader, multi-site updates.