HOW TO SETUP A PROPer ROBOTS TXT SEO FRieNDLY

When the robots file, incorrectly set up, it can negatively affect your SEO, with the wrong directives can do things as block pages and resources.

Hello Folks thank you for joining my course in this lesson we're going to learn, How to verify and set up the robots.txt file properly I will also share with you at the end of this video my best SEO practice of the robot file for your website that you can download for free.

robots txt file seo freindly best practise

There are many websites and free tools that allow you to verify if a site has a robots file or not however, I rather do it manually to understand how it works, so to view the robots file manually just add /robots.txt at the end of the domain, and If you want to verify the directives if they work or not.


Open up> https://www.google.com/webmasters/tools/robots-testing-tool >choose a property >copy the robot txt file and >past it into the search console tool .now you can run a test and verify each URL if is blocked by the robot or not .

For example, if you own a photography website, everything's fine and your technical SEO is good, but your images are not showing up on the search, That's a kind of hassle that you might fall into.

if this happens to you in this case,check the robot txt check this line disallow:/*img and replace it with allow:/img and done. your images are live.

Grab your FREE MASTER CHECKLIST and learn how to do SEO TO YOUR NEXT CLIENT

LOCAL-SEO-AUDIT V0.1 -2022-

Trick: you can bulk check robots files of other websites on the search that you might offer them a free SEO audit, and Get leads.

For example: go to the search and type

"photography" site:*.com inurl:robots filetype:txt

That simple search operator line help you to perform a bulk check audit for your client related to your niche “photography”


Download robots.txt file:robots.txt



Watch The Video Course.