Historia zmian

Autor SHA1 Wiadomość Data
  Zed 6c4c691fe7 Add Crawl-delay to robots.txt 3 lat temu
  Zed 138826fb4f Fix Twitterbot rule in robots.txt 4 lat temu
  Zed dfb2519870 Explicitly allow Twitterbot to generate previews 4 lat temu
  minus c543a1df8c Block search engines via robots.txt (#631) 4 lat temu