英语语法分析

Maximum database size for crawler 2GB 2GB

爬虫的最大数据库大小 2GB 2GB

Use a site map to lead the crawler around your site.

使用站点地图引导爬行器遍历您的站点。

Define the crawler subdirectories, as illustrated in Figure 8.

定义爬虫子目录，如图8所示。