Not sure if this belongs here...about googlebot

This is an archive of the phpBB 2.0.x support forum. Support for phpBB2 has now ended.
Forum rules
Following phpBB2's EoL, this forum is now archived for reference purposes only.
Please see the following announcement for more information: viewtopic.php?f=14&t=1385785
Locked
epona45
Registered User
Posts: 2
Joined: Sat May 27, 2006 2:44 am
Contact:

Not sure if this belongs here...about googlebot

Post by epona45 »

I just wanted to know if there's a way to keep a googlebot from crawling my forum. I'm not a computer whiz by any means so if you know how I can do this can you explain it in simple terms?

I read somewhere about robot.txt but I don't know exactly what this is. Also, I guess a better question would be, is it really a good idea to somehow block such a bot?

Thanks for any help
The KaN
Registered User
Posts: 380
Joined: Mon Mar 13, 2006 12:49 am

...

Post by The KaN »

Here is all of Google's info on the topic.

Google Crawler Support
phpBB3 User
User avatar
CTCNetwork
Former Team Member
Posts: 15424
Joined: Fri Dec 19, 2003 3:50 am
Location: In that Volvo behind you!
Contact:

Post by CTCNetwork »

Hi,

Yes, create a robots.txt file and upload it to your hosts server in the phpBB folder or the one above it.

More info on robots.txt can be found Here...

Hope this helps,

Des. . . :wink:
Density:- Not just a measurement~Its a whole way of Life.! ! !
| Welcome! | RTFM!!! | Search! It's Easy! | Problem? | Spam? | Advice! |
ferrethouse2004
Registered User
Posts: 80
Joined: Mon Oct 04, 2004 2:28 am

Post by ferrethouse2004 »

I just banned ask jeeves. 9 out of every 10 hits to my site was from jeeves bot and I get no real traffic from them. 54 gigs of bandwidth i've used this month and about 30 gigs of that was jeeves bot. keep googlebot and get rid of jeeves.
The KaN
Registered User
Posts: 380
Joined: Mon Mar 13, 2006 12:49 am

...

Post by The KaN »

ferrethouse2004 wrote: I just banned ask jeeves. 9 out of every 10 hits to my site was from jeeves bot and I get no real traffic from them. 54 gigs of bandwidth i've used this month and about 30 gigs of that was jeeves bot. keep googlebot and get rid of jeeves.


30 GBs... WOW... Yea...
phpBB3 User
epona45
Registered User
Posts: 2
Joined: Sat May 27, 2006 2:44 am
Contact:

Post by epona45 »

Thanks everyone, I'm going to give this a try...wish me luck
User avatar
tanfwc
Registered User
Posts: 2691
Joined: Sat Oct 11, 2003 7:10 am
Location: Singapore
Contact:

Post by tanfwc »

This might make Google love your site.

http://www.gotaxe.com/phpbb-sitemap.php
Locked

Return to “2.0.x Support Forum”