User-agent: * Disallow: /-sys-/ Disallow: /~sys~/ Disallow: /%7esys%7e/ Disallow: /nb/ Disallow: /awl/ Disallow: /forum/nb/ Disallow: /news/nb/ Disallow: /arts/nb/ Disallow: /videos/nb/ User-agent: GPTBot Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: dotbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: barkrowler Disallow: / User-agent: FemtosearchBot Disallow: / User-agent: ImagesiftBot Disallow: /