3 lines
72 B
Plaintext
3 lines
72 B
Plaintext
# allow crawling everything by default
|
|
User-agent: *
|
|
Disallow: /cdn-cgi/ |