Home Esplora Aiuto
Accedi
vdd
/
nitter
mirror da https://github.com/zedeus/nitter
1
0
Forka 0
File Problemi 0 Wiki
Albero (Tree): 083d65a8cf
Rami (Branch) Tag
nitter
/
public
/
robots.txt

robots.txt 74 B
Cronologia Originale

12345 
  1. User-agent: *
    2. 

  2. Disallow: /
    3. 

  3. Crawl-delay: 1
    4. 

  4. User-agent: Twitterbot
    5. 

  5. Disallow:
    6.