What is the difference between meta robots and robots.txt
The Meta tag tells the search bots to not index individual files, whereas the Robots.txt file can be used to restrict access to entire directories.
109,896 questions
120,582 answers
1,364 comments
7,058,864 users