Software To Help You Create A Robots.Txt file



Get Web Design Tips and Tricks on mps-web-design.com. Software To Help You Create A Robots.Txt file topic will increase your understanding on Web Design Tips and Tricks. We at mps-web-design.com only provide news, articles, information in Web Design Tips and Tricks. Web Design Tips and Tricks at mps-web-design.com provides the most up to date news and articles. If you have questions please do not hesitate to contact us.

Robogen is a software for Windows 95, Windows 98,Windows XP and Windows NT based computers which can help you create robots.txt files without having to worry about the correct syntax of a robots.txt file. It comes in two editions: the free Limited edition and the Standard edition which costs $12.95. You can get Robogen from http://www.rietta.com/robogen/.

In this article, I'll tell how you can use Robogen to simplify the process of creating a robots.txt file. This article assumes that you have read my article on what a robots.txt file is and how you can manually create it. If you missed the article, it is available at http://www.1stSearchRanking.com/t.cgi?4901&robots.htm

I would recommend that you download the trial version of the Standard Edition. The Limited edition does not support as many search engines as the Standard Edition.

Once you have downloaded Robogen and installed it in your hard drive, start the program. Here are the steps that you should follow to create a robots.txt file:

Step 1: Click on the Logon FTP Server button. In the dialog box that appears, type in the address of the FTP server for your web site, make sure that the 'This server requires me to log in' option is checked, and then type in the username and the password which you use to access the server in the appropriate boxes.

Now, depending on how your web host has set up the server, the files for your web site may be present in the root directory of the server itself. Or, it may be present in a sub-directory of the root directory. In the latter case, click on the 'Use specified root' option and type the relevant sub-directory in the text box besides the option. If you don't know in which sub-directory the files for your web site are present, ask your web host to give it to you.

Done? Now click on OK. After a while, Robogen will display the directories and files which are present in your site in the right pane of the main Robogen program window. If you find that Robogen has not displayed the files in your site, it means that you did not enter the correct sub-directory in which the files of your web site are present. In this case, ask you web host to give the correct sub-directory to you.

Step 2: In the left pane of the main Robogen window, click on the small button present to the right of the drop-down combo box at the top. In the menu that appears, select 'Popular Search Engines'.

Step 3: Now, click on the drop-down combo box and choose the search engine that you are targeting (say, AltaVista). In the right pane, select a page which is NOT meant for AltaVista. Now click on the '<<<' button. You will find that the file which you had selected in the right pane is now present in the left pane. In this way, click on each of the pages which are not meant for AltaVista and press the '<<<' button.

Repeat step 3 for each of the search engines that you are targeting. Just select the search engine that you are targeting from the drop-down combo box, select the pages which are not meant for the search engine one by one from the right pane, and click on the '<<<' button after clicking on each age. Repeat this process for all the search engines that you are targeting.

Step 4: Upload the file to your server using the 'Upload Robots.Txt' button. If you want, you can also use the Save menu item from the File menu to save a copy of the robots.txt file in your hard drive.

About the Author
Sumantra Roy is one of the most respected search engine positioning specialists on the Internet. To have Sumantra's company place your site at the
top of the search engines
, go to http://the-easy-way.com/main.html For more advice on how you can take your web site to the top of the search engines, subscribe to his
FREE newsletter



Instant Article Submitter. - Amazing Breakthrough Software Stuffs Any Website You Want Full Of Free Targeted Traffic.
Top Producing Flash Site. - Download movies, games, software and music.

Whether or not there is a consumer tablet market at all, beyond the iPad, is still up for debate but in enterprise Microsoft is still a powerhouse. With the decline of RIM and the inability of Android to gain any serious traction I have long been an advocate of the rise of Windows in the mobile space. [...]


Article Index: | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | 53 | 54 | 55 | 56 | 57 | 58 | 59 | 60 | 61 | 62 | 63 | 64 | 65 | 66 | 67 | 68 | 69 | 70 | 71 | 72 | 73 | 74 | 75 | 76 | 77 | 78 | 79


More Articles:


1. Absolute Versus Relative Linking in Web Sites
What is an absolute link? What is a relative link? Why should you care which one you use? When it comes to how you set up the links on your web site, it's important to use an absolute link (which means that when you link to another page on your web site you specify the complete URL in the link like http://www.yourdomain.com/page1.html). A relative link is when you have an internal link and you only specify the page URL and not the full URL in the link (for example, a relative link would be…

2. Unique Catalog Designs
Through the years, catalog printing services has continued to expand with their services. There are a lot of companies and individuals who have realized its importance and have switched to using catalogs to showcase their needs and personal means to communicate with the customers. This has been considered a smart strategy because we all know that catalogs are very unique in spreading out their information and details that no other services can compare. We are all aware of the increasing need t…

3. Project Discovery: The First Step to Building Strong Web Communication
You're in a hurry to get your Web site going. You've got tight deadlines. But don't let your haste get in the way of your success. A company's Web site should embody the company, reflect its values and strengthen its identity. When you pick your Web design team, make sure they are going to learn your business inside and out. Good Web design firms know to start a project with as much information as possible. They gather it during the Discovery phase. Discovery encompasses a full-scale examinatio…

4. Web Site Design – Focus, Focus, Focus By Halstatt Pires
When creating a web site design, it is easy to fall into the trap of trying to be all things to all people. In reality, the key to a good web site design is focus, focus, focus.We Don’t Need No Stink’n DistractionsIt happens ever few weeks or so. I am sitting in front of the computer contemplating the meaning of life, i.e., why my numbers aren’t being picked in the California lottery. A frustrated person calls and wants to know why their site isn’t converting. Shaking myself from my revelry, I…