# 遛养派 robots.txt - 搜索引擎 + AI 爬虫配置 # https://www.19up.com # 单一真值源:lyp/public/robots.txt(随前端发布包部署) # 边缘生效路径:nginx /robots.txt → alias /www/wwwroot/19up/lyp/public/robots.txt # Next.js 侧:本文件即 /robots.txt(不再使用 src/app/robots.ts 动态路由) # 修改本文件后必须重新发布前端;不要再给本文件制造任何副本(robots-static.txt 已废弃) # 最后更新: 2026-09-16 # # 口径:索引与引用开放,内容本体与结构化数据保留;完整政策见 /citation-guidelines # 机器可读索引 /llms.txt 与 /llms/ 下的索引文件明确开放抓取。 # 注意:robots.txt 匹配到某个 User-agent 组后只使用该组规则, # 因此每个爬虫组都需独立声明数据层 Disallow,否则会绕过 "*" 组的 /api/ 封锁。 User-agent: * Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Disallow: /_next/ Disallow: /node_modules/ User-agent: Baiduspider Allow: / Disallow: /api/ Disallow: /src-data/ Crawl-delay: 1 User-agent: Baiduspider-image Allow: / Disallow: /api/ Crawl-delay: 2 User-agent: Baiduspider-video Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Bytespider Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Toutiaospider Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: 360Spider Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: 360Spider-image Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Sogou spider Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Sogou pic spider Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Bingbot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 1 User-agent: Googlebot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 1 User-agent: Googlebot-Image Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Googlebot-Mobile Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: DeepSeek-Crawl Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: DeepSeek-Chat Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Doubao-bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Doubao-Search Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Baidu-Yiyan Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: ERNIE-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Tongyi-Qianwen Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Qwen-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: HunYuan-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Yuanbao-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: WeChat-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Sogou-WeChat Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Kuaishou-AI Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: 360-AI-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: TianGong-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Zhipu-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: ChatGLM Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: iFlytek-Spark Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: MiniMax-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: 01-AI-Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: ClaudeBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: anthropic-ai Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: perplexity-ai Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: YouBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: DuckDuckBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: CriteoBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 3 User-agent: Qwantify Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 3 User-agent: KagiBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: CCBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 5 User-agent: AI2Bot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 3 User-agent: Omgilibot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 3 User-agent: facebookexternalhit Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: Twitterbot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 2 User-agent: LinkedInBot Allow: / Disallow: /api/ Disallow: /src-data/ Disallow: /admin/ Crawl-delay: 3 User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / # Sitemap 位置 Sitemap: https://www.19up.com/sitemap.xml Sitemap: https://sq.19up.com/sitemap.xml