FAQ
最終更新日：2026-09-10 12:11:41
Reading time: About 4 minutes
1. How does AI Crawler Control relate to Bot Management?
AI Crawler Control is a specialized sub-feature of Bot Management. The two are complementary but focus on different areas:
| Dimension | AI Crawler Control | Bot Management |
|---|---|---|
| Coverage | Focused on crawlers used for AI search, training, and applications | Covers search engines, general crawlers, malicious bots, and more |
| AI Data Scrapers | AI scraping compliance audits, content licensing management | Security protection, SEO optimization, resource protection |
| Key Features | Dedicated identification and control for AI crawlers | Public Bots management, multi-dimensional rules, behavior analysis, JavaScript detection, Bot Tag Forwarding to Origin, and more |
| Priority | Custom Bots > AI Crawler Control > Public Bots > Definite Bots > Likely Bots > Web Bot Detection > Workflow Detection | |
| Recommendation | You can use both features together to achieve comprehensive Bot traffic management alongside targeted AI crawler control. | |
2.How does AI Crawler Control relate to the existing “AI Bots” feature in Bot Management?
AI Crawler Control is an upgraded version of the “AI Bots” feature previously provided in Bot Management. After the upgrade, AI Crawler Control operates as an independent module offering richer visual analysis and more granular control. Policy configurations from the original AI Bots feature have been automatically migrated to the AI Crawler Control module. On the Security Policy edit page, under the Bot Management tab, clicking Configure for AI Bots now takes you directly to the AI Crawler Control > Crawler Control page for unified management.
3. What is the difference between the Basic and Advanced editions? How do I upgrade?
Basic edition: View the crawler list and control status, and take action (Not Used/Log/Skip/Deny) on one or more crawlers.
Advanced edition: In addition to the above, view request statistics and activity trends for each crawler to support your control decisions.
To upgrade to the Advanced edition, contact your account manager or submit a support ticket to request the AI Crawler Control value-added service.
4.How many AI crawlers does the system include? Are they updated?
The system currently includes more than 40 AI crawlers. The AI Bots library is continuously maintained and updated. Newly added AI crawlers are initially set to Not Used, and you can set the action based on your business needs.
5.How do I view request details for a specific AI crawler?
You can view request details in the following ways:
- Trends Overview: Use the filter bar to select the crawler name and view its request trends and statistics.
- Attack Logs: In the filter conditions, set the policy type to AI Crawler Control, and filter by crawler name to view the specific request logs.