HOW ROBOT.TXT WORKS?

http://www.seooutsourcingph.info/robots-txt-generator.html


1) With the robots.txt file, site owners can choose not to be crawled by Googlebot, or they can provide more specific instructions about how to process pages on their sites.

2) The robots.txt file is a simple text file placed on your web server which tells webcrawlers like Googlebot if they should access a file or not.
3) Improper usage of the robots.txt file can hurt your ranking
 The robots.txt file controls how search engine spiders see and interact with your webpages
 This file is mentioned in several of the Google guidelines
 This file, and the bots they interact with, are fundamental parts of how search engines work Priorities for your website
4) There are three important things that any webmaster should do when it comes to the robots.txt file.
 Determine if you have a robots.txt file
 If you have one, make sure it is not harming your ranking or blocking content you dont want blocked
 Determine if you need a robots.txt file
 Determining if you have a robots.txt
5) Determine if your robots.txt is blocking important files
 You can use the Google guidelines tool, which will warn you if you are blocking certain page resources that Google needs to understand your pages.
 If you have access and permission you can use the Google search console to test your robots.txt file.
6) To fully understand if your robots.txt file is not blocking anything you do not want it to block, you will need to understand what it is saying.
 Do you need a robots.txt file?
 You may not even need to have a robots.txt file on your site. In fact it is often the case you do not need one.
7) Reasons you may want to have a robots.txt file:
 You have content you want blocked from search engines
 You are using paid links or advertisements that need special instructions for robots
 You want to fine tune access to your site from reputable robots
 You are developing a site that is live, but you do not want search engines to index it yet
 They help you follow some Google guidelines in some certain situations
 You need some or all of the above, but do not have full access to your webserver and how it is configured
 Each of the above situations can be controlled by other methods, however the robots.txt file is a good central place to take care of them and most webmasters have the ability and access required to create and use a robots.txt file.
 It is simple and error free and you do not have any files you want or need to be blocked from search engines
 You do not find yourself in any of the situations listed in the above reasons to have a robots.txt file
9) When you do not have a robots.txt file
 The search engine robots like Googlebot will have full access to your site. This is a normal and simple method that is very common. It is okay to not have a robots.txt file especially if you only have static kind of website.

PHILIPPINES

Blk 22, Lot 7, Cleveland Drive, Broadway Pines Executive Village, Mayamot Antipolo City 1870

Landmark: Please see Marikina City Map above as this place is just near our old office at Marquinton Condominium in Marikina City for easier accesibility

TECHNICAL SUPPORT GROUP
Contact:

Phil Tel:
(+632) 215-4568

US Tel:
402-679-4810

Email:
[email protected]
Mobiles:

Sun:
0922-8810197

Globe:
0917-5823957

Smart:
0939-9090494

Email:
[email protected]

Contact:
(+632) 215-4568
Email:
[email protected]

[email protected]

HUMAN RESOURCES DEPARTMENT

Contact:
(+632) 215-4568

Email:
[email protected]

ACCOUNTING DEPARTMENT

Email:
[email protected]
[email protected]

PAYMENT OPTIONS