What is the difference between meta robots and robots.txt
The Meta tag tells the search bots to not index individual files, whereas the Robots.txt file can be used to restrict access to entire directories.
114,167 questions
124,942 answers
1,375 comments
7,059,696 users