Jan G
Full Member
Each day is a gift, so enjoy!
Posts: 115
|
Post by Jan G on Dec 8, 2007 21:59:36 GMT -5
I received the following from scrubtheweb. Can someone take a look at my site and let me know how to fix it to be robots friendly? Thank you, Jan G
Note! This site does NOT provide the robots.txt file or the robots.txt file is not constructed properly. It is recommended all sites provide this file.
|
|
|
Post by mpatton on Dec 8, 2007 23:18:09 GMT -5
I received the following from scrubtheweb. Can someone take a look at my site and let me know how to fix it to be robots friendly? Thank you, Jan G Note! This site does NOT provide the robots.txt file or the robots.txt file is not constructed properly. It is recommended all sites provide this file. Jan These are some examples <meta name="Robots" content="All"> <meta name="Revisit-after" content="10 days"> you can right click on most site and check some other options "view page source" hope this helps
|
|
Jan G
Full Member
Each day is a gift, so enjoy!
Posts: 115
|
Post by Jan G on Dec 9, 2007 0:21:35 GMT -5
Thanks alot for the information. Jan
|
|
|
Post by michael on Dec 9, 2007 1:13:25 GMT -5
|
|
|
Post by troyzone on Dec 9, 2007 11:24:29 GMT -5
Hi Michael, I assume you meant the second link, as it includes some robots.txt commands to disallow certain email collection robots from crawling one's site. Thanks for helpful links...if I ever get around to updating the forum FAQs further then I'll be sure to add something for robots.txt and your links there. I've made note of the info in any case. Thanks, take care. Troy
|
|
|
Post by michael on Dec 9, 2007 11:30:44 GMT -5
Hi Troy,
Yes it was the second one, I pasted them out of the order I was looking them up.
I have found you can find a lot of helpful tips by doing a google search for what ever your problem might be. Granted it may take some searching but occasionally you can get lucky and find what you need on the first page.
I have recently upgraded to Windows Vista and the google searches have been great for helping me find fixes.
Michael
|
|
|
Post by troyzone on Dec 9, 2007 12:17:07 GMT -5
I agree Michael. Searching Google is how I often find solutions to my own problems, plus I do this sometimes to solve problems posted on this forum as well. You can find just about anything these days by doing some research with Google or other search engines.
Troy
|
|
stirls
Long Time Member
Posts: 942
|
Post by stirls on Dec 9, 2007 20:32:37 GMT -5
I agree Michael. Searching Google is how I often find solutions to my own problems, plus I do this sometimes to solve problems posted on this forum as well. You can find just about anything these days by doing some research with Google or other search engines. Troy Troy I do the same and often find exactly what i am looking for after a couple of searches. We even use the convert feature in Google search to figure out how to convert food recipes from imperial to metric. It is pretty cool - try it out by putting in the search box - convert 8 oz to ml Get this - Shanna (my wife) is back in school and on Friday she had an exam that was open computer! I remember in University being happy for open book exams but open computer that is like a dream - basically it is a open Google exam! Google - we seem to have a love and hate relationship with them. Love the search feature, struggle with the Adwords TOS. They are getting to a position of "can't live with them, can't live without them".
|
|
|
Post by troyzone on Dec 10, 2007 3:57:46 GMT -5
Hi Chris, I use the convert feature sometimes too, as well as the define: feature to look up obscure words and so forth. I didn't realize that Google would do those things too and a whole host of other features besides standard web searches via the search box until one day, maybe a couple of years ago, I happened to read the help or search tips section on Google and learned that you could do a lot more with it. For those interested, I found a page listing many other functions that Google can perform and how to use them, you can find it here: www.google.com/intl/en/help/features.htmlI found it this time by going to the Google home page at www.google.com and then clicking More, then Even More, then going to the bottom-left of the page and clicking Web Search Features. Troy
|
|