Skip to content
Snippets Groups Projects
Verified Commit e24ba55f authored by Thorge Petersen's avatar Thorge Petersen
Browse files

Reordered and consolidated robots.txt entries

parent dd7cf4f5
No related branches found
No related tags found
No related merge requests found
Show whitespace changes
Inline Side-by-side
ckanext/odsh/templates/home/robots.txt
+ 4
− 8
View file @ e24ba55f
User-agent: SemrushBot
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: AwarioRssBot
User-agent: AwarioSmartBot
User-agent: DataForSeoBot
Disallow: /
User-agent: PetalBot
User-agent: SemrushBot
User-agent: SEOkicks
Disallow: /
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment

Impressum - Datenschutz - Barrierefreiheit