User-agent: bingbot Disallow: /article-* # 禁止爬取article页面(根据需求调整) Allow: / # 允许访问首页 User-agent: * Disallow: /