Home Verkennen Help
Inloggen
vdd
/
nitter
spiegel van https://github.com/zedeus/nitter
1
0
Vork 0
Bestanden Issues 0 Wiki
Aftakking: feature/mp4-streaming
Aftakkingen Labels
nitter
/
public
/
robots.txt

robots.txt 74 B
Permalink Geschiedenis Ruwe

12345 
  1. User-agent: *
    2. 

  2. Disallow: /
    3. 

  3. Crawl-delay: 1
    4. 

  4. User-agent: Twitterbot
    5. 

  5. Disallow:
    6.