The Web Crawl Configuration screen in the Airgentic admin console controls how your website is crawled and indexed for use by the AI. You can reach it from Data Sources for your service, then Web Crawl Configuration, or open it directly at admin.airgentic.com/edit_web_crawl_config.
The screen is organised into four tabs. This section of the help documentation mirrors those tabs:
After you save changes, the configuration is written to your ingest config. Depending on what you changed, you may be prompted to trigger an index or HTML-processing job so that updates take effect.