Page 1 of 1

noindex, nofollow in the header

Posted: Fri Apr 19, 2019 5:52 pm
by z.ukosa
Hi All,

I would like every page on my board to have this tag:

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

I'm using prosilver SE and I wanted to confirm with you that it is as simple as editing the overall_header.html and simple_header.html files and just adding this tag before </head>

I've tested it on local server and it seems to be working fine - won't it cause any issues that I don't see now?

thanks!

Re: noindex, nofollow in the header

Posted: Fri Apr 19, 2019 6:22 pm
by janus_zonstraal
Why not just block the bots in ACP?
won't it cause any issues that I don't see now?
Nobody will find your board, but maybe you want it that way?

Re: noindex, nofollow in the header

Posted: Fri Apr 19, 2019 8:16 pm
by z.ukosa
I'm not sure how blocking bots is effected by phpBB, I tried to disallow them in ACP, but I could not see how it is effected in the html file. Does it give any specific instructions in html of the page?

As far as I know, the best way is to disallow them in robots.txt and I also wanted to add this <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> just to be sure.

I'm aware about the effect that this command will have on google etc., I just wanted to make sure I won't mess up the operation of phpBB software, hm?

thanks

Re: noindex, nofollow in the header

Posted: Sat Apr 20, 2019 1:06 am
by stevemaury
Give the Bots group a No access Role for all forums in Group forum permissions. If there are particular bots you want to block that are not included with phpBB, you can add them.

Re: noindex, nofollow in the header

Posted: Sat Apr 20, 2019 5:21 pm
by z.ukosa
OK, so I get the ACP method. But if a stubborn folk would like to add <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> into the overall_header.html and simple_header.html files - would it do any harm to the operation of phpBB?

Re: noindex, nofollow in the header

Posted: Sat Apr 20, 2019 6:29 pm
by Lumpy Burgertushie
no, it will not have any affect on phpbb.


never did understand why people want to do this. the whole point of the web is linking back and forth for information.

oh well,

robert

Re: noindex, nofollow in the header

Posted: Sat Apr 20, 2019 6:29 pm
by janus_zonstraal
No

Re: noindex, nofollow in the header

Posted: Sat Apr 20, 2019 6:53 pm
by z.ukosa
thanks!
Lumpy Burgertushie wrote:
Sat Apr 20, 2019 6:29 pm

never did understand why people want to do this. the whole point of the web is linking back and forth for information.

my board is a part of a larger website, and I feel (though I'm a novice) that keeping the board out of google index will be beneficial for the website overall. That's from the content perspective and technical, too. But that's a lengthy SEO-related discussion, I'm not sure whether you're up for it :)

Re: noindex, nofollow in the header

Posted: Sat Apr 20, 2019 10:50 pm
by Lumpy Burgertushie
I assume that your board is related to the rest of your website. If so, then having the content of the board added to the content the main website can only help your search engine rankings etc.
there is no way it can hurt your website rankings.

as a matter of fact, you can increase that by making sure that your board's forum and topic titles use keywords related your site's subject.

the main thing google cares about is relevant content and lots of it. if members of your board are discussing things relevant to your main site subject matter it is a great help to ranking etc.

robert

Re: noindex, nofollow in the header

Posted: Mon Apr 22, 2019 8:20 pm
by z.ukosa
well, what is your opinion based on? don't get me wrong, this really is a question!

As I wrote before, I'm a novice, but I've been reading a lot about SEO. And it seems that more is not better. A few strong (i.e. of good quality and length) pages seem to work better than more not so good quality pages. For example, take a look at this study by Ahrefs. So I figure, if I keep the rest of my website to be of good quality and updated, it may be better to noindex my board and just use the discussions held there as a valuable input to the rest of my website. But I haven't decided yet on what to do...

And there is also the more technical side. I feel that phpBB could do better when it comes to telling bots which links to follow. For example, why are login/register/new topic/reply etc. links dofollow links? (see the last paragraph here).

And, since we're discussing SEO, what do you think about robots.txt of arstechnica.com? They've blocked lots of paths of phpBB. Maybe this is a good idea for blocking bots from visiting links unimportant for SEO.

Marek

Re: noindex, nofollow in the header

Posted: Mon Apr 22, 2019 9:25 pm
by Lumpy Burgertushie
I get my opinions from over 20+ years of experience and from google itself.
most of the SEO info you come across online is based on old information. google says that content is important. the more relevant content the higher the ranking. whoever told you that there can be soo much content doesn't know what they are talking about .

it all boils down to what the purpose of your board is in relation to your website.

if your website is selling something and your board contains discussions bout those products etc. then it will only help . by default, it will contain keywords that are relevant to your products etc.

eventually, as you add more and more relevant keywords/content your site will move up higher and higher in the search returns.

that is simply how it works.
'
luck,
robert