msfjarvis
/
msfjarvis.dev
mirror of https://github.com/msfjarvis/msfjarvis.dev.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update robots.txt 

Signed-off-by: Harsh Shandilya <me@msfjarvis.dev>
This commit is contained in:
Harsh Shandilya 2020-03-15 17:23:28 +05:30
parent ec4203dd3f
commit 7f1cb6772f
1 changed files with 9 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
static/robots.txt
View File

@ -1 +1,9 @@
User-agent: * Disallow:
# Googlebot
User-agent: Googlebot
Disallow: /static/
# Everybody else
User-agent: *
Allow: /
Sitemap: https://msfjarvis.dev/sitemap.xml