vdd/nitter

réplica de https://github.com/zedeus/nitter

Autor	SHA1 Mensaxe	Data
Zed	6c4c691fe7 Add Crawl-delay to robots.txt	%!s(int64=3) %!d(string=hai) anos
Zed	138826fb4f Fix Twitterbot rule in robots.txt	%!s(int64=4) %!d(string=hai) anos
Zed	dfb2519870 Explicitly allow Twitterbot to generate previews	%!s(int64=4) %!d(string=hai) anos
minus	c543a1df8c Block search engines via robots.txt (#631)	%!s(int64=4) %!d(string=hai) anos