vdd/nitter

spogulis no https://github.com/zedeus/nitter

Autors	SHA1 Ziņojums	Datums
Zed	6c4c691fe7 Add Crawl-delay to robots.txt	3 gadi atpakaļ
Zed	138826fb4f Fix Twitterbot rule in robots.txt	4 gadi atpakaļ
Zed	dfb2519870 Explicitly allow Twitterbot to generate previews	4 gadi atpakaļ
minus	c543a1df8c Block search engines via robots.txt (#631)	4 gadi atpakaļ