msfjarvis/msfjarvis.dev
1
0
Fork 0
mirror of https://github.com/msfjarvis/msfjarvis.dev.git synced 2024-06-03 04:18:56 +05:30
Code Issues Packages Projects Releases Wiki Activity

Update robots.txt

Browse Source 
Signed-off-by: Harsh Shandilya <me@msfjarvis.dev>
This commit is contained in:
Harsh Shandilya 2020-03-15 17:23:28 +05:30
parent 9b330788da
commit f1e2c38385
No known key found for this signature in database
GPG Key ID: 366D7BBAD1031E80
1 changed files with 9 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
static/robots.txt
View File

@ -1 +1,9 @@
User-agent: * Disallow:
# Googlebot
User-agent: Googlebot
Disallow: /static/
# Everybody else
User-agent: *
Allow: /
Sitemap: https://msfjarvis.dev/sitemap.xml