1
0
Fork 0
Browse Source

create robot.txt file.

pull/7/head
Craig Oates 4 years ago
parent
commit
bb05c5e151
  1. 5
      app/static/robots.txt

5
app/static/robots.txt

@ -0,0 +1,5 @@
# www.robotstxt.org/
# Disallow The Wayback Machine
User-agent: ia_archiver
Disallow:/