Why don't spiders see some content?

Get help with installation and running phpBB 3.3.x here. Please do not post bug reports, feature requests, or extension related questions here.
Post Reply
User avatar
AbuHossam
Registered User
Posts: 290
Joined: Sun Sep 02, 2018 7:24 am

Why don't spiders see some content?

Post by AbuHossam »

hello brothers..

Somehow, I knew that search engine spiders "bots" weren't seeing some of my page content. Specifically the "Recent Topics" content on the homepage.

Are there settings that can be made for the spider to see these posts?
Last edited by Mick on Sun Mar 19, 2023 9:52 am, edited 1 time in total.
Reason: Solved.
Sorry, I'm using google translate. Try to understand the meaning of my words.
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6671
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Why don't spiders see some content?

Post by HiFiKabin »

To receive extension support please visit our Extensions Database and post in the specific extension's designated support area. The link to the support area for each released extension is also available in the first post of each released extension listed in the [3.3.x] Extension Database Releases forum. For extensions still in development (not recommended for a live board) support is in that extension's topic in the Extensions in Development forum.
User avatar
AbuHossam
Registered User
Posts: 290
Joined: Sun Sep 02, 2018 7:24 am

Re: Why don't spiders see some content?

Post by AbuHossam »

Thank you, Mr.
I say "for example".
Sorry, I'm using google translate. Try to understand the meaning of my words.
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6671
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Why don't spiders see some content?

Post by HiFiKabin »

You said
AbuHossam wrote: Sat Mar 18, 2023 3:54 pm Specifically the "Recent Topics" content on the homepage.
not
AbuHossam wrote: Sat Mar 18, 2023 5:05 pm I say "for example".
I suggest that you check your bot permissions and your Google Panel etc to see if there are any errors or omissions.
User avatar
Mannix_
Registered User
Posts: 1838
Joined: Sun Oct 25, 2015 2:56 pm
Name: Matt
Contact:

Re: Why don't spiders see some content?

Post by Mannix_ »

Even if it is just an example it's a bad example since this extension doesn't add new pages/ links to your board it just displays topics that already exist on your board. So there is nothing new to crawl for bots
Did I helped You? Consider a donation.
New version of phpBB has been released? My styles aren't validated for it yet? Check my page for the latest downloads!
User avatar
AbuHossam
Registered User
Posts: 290
Joined: Sun Sep 02, 2018 7:24 am

Re: Why don't spiders see some content?

Post by AbuHossam »

@HiFiKabin

Yes, the problem is in my language
I am really sorry.

But what about permissions? Can you point me right?

@Mannix_

I'm putting new posts on the homepage "below the header/navbar".

This is in order for Google to see the new topics, and then quickly index them.

that what I think.

Now, I found out that he doesn't see these links. He only sees forums, sections, categories...
Sorry, I'm using google translate. Try to understand the meaning of my words.
User avatar
janus_zonstraal
Registered User
Posts: 6418
Joined: Sat Aug 30, 2014 1:30 pm

Re: Why don't spiders see some content?

Post by janus_zonstraal »

Somehow, I knew that search engine spiders "bots" weren't seeing some of my page content. Specifically the "Recent Topics" content on the homepage.
Are you sure?
If I test it GB is able to see recent topics.
Sorry! My English is bat ;) !!!
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6671
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Why don't spiders see some content?

Post by HiFiKabin »

AbuHossam wrote: Sat Mar 18, 2023 8:01 pm @HiFiKabin

Yes, the problem is in my language
I am really sorry.

But what about permissions? Can you point me right?
Just make sure that the bot group have permissions to read the forums you want them to index (and give them no access to any you want them not to index)
User avatar
AbuHossam
Registered User
Posts: 290
Joined: Sun Sep 02, 2018 7:24 am

Re: Why don't spiders see some content?

Post by AbuHossam »

janus_zonstraal wrote: Sat Mar 18, 2023 8:18 pm Are you sure?
If I test it GB is able to see recent topics.
I think so, and I'm not sure.

But how did this belief come to me?

1. From webcache.googleusercontent.com If we see the page saved by Google, we will not find the Recent Topics offered by this plugin.

2. in GSC, If we make Test Live URL, then View Tested Page.. we will see HTML + SCREENSHOT come without the Recent Topics.

Are these conclusions correct? : I'm not sure.
Sorry, I'm using google translate. Try to understand the meaning of my words.
User avatar
janus_zonstraal
Registered User
Posts: 6418
Joined: Sat Aug 30, 2014 1:30 pm

Re: Why don't spiders see some content?

Post by janus_zonstraal »

Go to ACP => Permissions => Group permissions => bots => Advanced Permissions => Misk => Recent Topics: can view Recent topics. yes or no

Use the browser plugin "User-Agent Switcher" and choose "see page as a Google bot"
Sorry! My English is bat ;) !!!
User avatar
AbuHossam
Registered User
Posts: 290
Joined: Sun Sep 02, 2018 7:24 am

Re: Why don't spiders see some content?

Post by AbuHossam »

janus_zonstraal wrote: Sun Mar 19, 2023 7:49 am Go to ACP => Permissions => Group permissions => bots => Advanced Permissions => Misk => Recent Topics: can view Recent topics. yes or no
2023-03-19_102433.jpg
janus_zonstraal wrote: Sun Mar 19, 2023 7:49 am "see page as a Google bot"
Where is this option?
Sorry, I'm using google translate. Try to understand the meaning of my words.
User avatar
janus_zonstraal
Registered User
Posts: 6418
Joined: Sat Aug 30, 2014 1:30 pm

Re: Why don't spiders see some content?

Post by janus_zonstraal »

Where is this option?
Did you install the browser plugin?
Sorry! My English is bat ;) !!!
User avatar
AbuHossam
Registered User
Posts: 290
Joined: Sun Sep 02, 2018 7:24 am

Re: Why don't spiders see some content?

Post by AbuHossam »

janus_zonstraal wrote: Sun Mar 19, 2023 8:48 am Did you install the browser plugin?
EDIT

I found it on Firefox.

EDIT#2

And the bot sees the latest posts normally.
thank you bro.
Last edited by AbuHossam on Sun Mar 19, 2023 9:05 am, edited 1 time in total.
Sorry, I'm using google translate. Try to understand the meaning of my words.
User avatar
janus_zonstraal
Registered User
Posts: 6418
Joined: Sat Aug 30, 2014 1:30 pm

Re: Why don't spiders see some content?

Post by janus_zonstraal »

Sorry! My English is bat ;) !!!
User avatar
AbuHossam
Registered User
Posts: 290
Joined: Sun Sep 02, 2018 7:24 am

Re: Why don't spiders see some content?

Post by AbuHossam »

Now, Google bots also see recent topics GSC :idea: :idea: :idea:

Thank You @janus_zonstraal This is very valuable information.
Sorry, I'm using google translate. Try to understand the meaning of my words.
Post Reply

Return to “[3.3.x] Support Forum”