Content Manager Features

Feature	Description
Open Graph Meta Tag	Content managers can use the og:image HTML tag in web pages to display thumbnail images for documents on the search page.
Selective HTML indexing	Specific content can be excluded from indexing using tags such as ..., ..., or ....
Meta Robots	Meta robots tags can control whether a page should be indexed or crawled, allowing flexible indexing rules.
Robots.txt	The crawler follows the rules defined in the robots.txt file, which take the highest priority over other web collection settings.
Canonical	Canonical URLs can be indexed by enabling the canonical setting in the web collection. Eg of canonical tag: `<link href="https://www.example.com" rel="canonical">`
Sitemap	SearchBlox supports standard XML sitemaps, including sitemaps referenced in robots.txt.
Custom Date Header	Custom date header indexing can be configured if the .htaccess file contains a header in the required date format. Example: Header set SearchBlox-Last-modified "Wed, 01 Jan 2000 12:00:01 GMT".
HTML Parser - Document Description	The description setting in Web Collection allows the HTML parser to read document descriptions from HTML tags such as META, H1, H2, H3, H4, H5, and H6. Ensure valid tags exist on the webpage if this feature is used.
Selective LastModified Date	Documents can be indexed using Default Header Date, Custom LastModified Date (lastmodified or last-modified), or Custom Header Date.
Search Results Display	Default SearchBlox fields such as title, description, keywords, and lastmodified can be controlled from web pages. After re-indexing the collection, updated content will appear in the search page.
SmartFAQs	Allows easy creation and management of FAQs using the SearchBlox AI model.
Custom Meta Fields	Custom meta tags can be added to web pages and indexed within web collections to enhance search functionality. To know more: Custom Data Fields