Page 33 of 37

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Tue Jan 29, 2013 1:18 am
by nneonneo
I would, but this version has some specific hacks for freeforums.

Later I am planning on properly integrating it and pushing it back up to the first-post converters.

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Tue Jan 29, 2013 1:24 am
by Prasas
@nneonneo
I have try updated PHPBB3 converter that you attach
and still give same error
Image

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Fri Feb 01, 2013 12:53 am
by hiddentapir
EDIT: I slept on it and found the solution myself: 'Advanced' profiles were still switched on (on jcink it's called portal style). Anyone having the "Member doesn't exist" issue -- that could be an easy fix :)

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Sat Feb 02, 2013 7:30 am
by Prasas
@nneonneo
i do turn off all mod in my forum and the converter is work
thank you nneonneo

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Mon Feb 11, 2013 10:37 am
by irus_web
Is there a crawler to convert vBulletin to phpBB (or anything else)?

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Mon Feb 11, 2013 10:29 pm
by HGN
You are looking for a crawler (meaning you have no access to the database)?

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Sun Feb 17, 2013 4:35 pm
by feldon30
So I'm curious.

If ZetaBoards adds a line to their Terms and Conditions saying that the use of third party scripts to "scrape" forum posts is forbidden, and then sends an e-mail to phpbb.com requesting that this thread be deleted and/or all scripts removed, would we see the same thing happen that has happened with ProBoards?

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Fri Mar 01, 2013 12:51 pm
by orgijus
Hi,
I'm trying to use phpBB2 crawler to backup my forum database, yet without success.
Currently my forum is hosted by setbb.com, phpBB version 2.0.23. I want to move somewhere else because they refuse either to upgrade to phpBB3 or to provide me with database backup.
I followed the crawler instructions carefully. Downloading members seems to work ok but I can't download any topics (it says "completed" but 0 posts and 0 topics).
Have you got any ideas how to make it work?

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Fri Apr 05, 2013 1:12 am
by morscerta
hello guys!

this is my first post on the forum and would like to ask some help when i'm trying to convert yuku to phpbb.
I downloaded the latest version of the crawler, and follow the step-by-step within "settings.py."
after run it on python 2.7,it starts to download with no problems the forum structure, boards, admin list,etc... however, in the step of downloading the threads and posts, it returns the following message:
Topic 583, Board 4 ... Error: Topic is empty!
Topic 584, Board 4 ... Error: Topic is empty!
Topic 73, Board 4 ... Error: Topic is empty!
Topic 78, Board 4 ... Error: Topic is empty!
Topic 607, Board 4 ... Error: Topic is empty!
looking here on this topic, i found this post informing about a possible misconfiguration on time and date of the board: viewtopic.php?f=65&t=1761395#p11208015

But after make sure that the information contained in "settings.py" and the board are the same, I keep getting the same error.

here go a print of my board and the "settings.py" file configuration:

Image




could someone give me a hint to how solve this?
Thank you.

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Mon Apr 15, 2013 11:46 am
by Belcegor
Hi, sorry for my english.

Is there a posibility to do a crawler for multiforos.es?

Im trying to use the phpbb2 and nothing, my forum is phpbb2.

I do all the instructions and i get only some users and 0 topics.

If you need more information, please, tell me.

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Mon Apr 29, 2013 9:21 pm
by Lumpy Burgertushie
I just used this to crawl a phpbb2 board from one of the free hosts. It worked ok. took a long time.
over 48 hours to get 12,230 members and 6500 posts.

had to keep starting over the script and change the members to 1 so it wouldn't do them again and finally I got the right combination of things that allowed it to get the topics and posts.

once setup in phpbb2 all of the members are listed as guests so there is no profile info showing up .

any idea how to make all of the users show up as registered again.

they all show up as active in the memberlist.

thanks,
robert

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Mon Apr 29, 2013 9:50 pm
by nneonneo
@orgijus: Hard to say. The hosts may have customized the phpBB templates enough to fool the converter. Sadly there is no workaround except to edit the regular expressions in the script yourself.

@morscerta: Seems right. Is it a ezBoard forum converted up to Yuku, by any chance?

@Belcegor: no plans at the moment. Try setting language to English. However, some multiforum systems use custom extensions to phpBB and require special modifications to make the converter work.

@Lumpy: Well, unfortunately, you have to crawl the members and the topics/posts in the same run, or they don't get linked up properly. (It sucks, but that's the way it's written now).

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Mon Apr 29, 2013 9:52 pm
by Lumpy Burgertushie
nneonneo wrote:@orgijus: Hard to say. The hosts may have customized the phpBB templates enough to fool the converter. Sadly there is no workaround except to edit the regular expressions in the script yourself.

@morscerta: Seems right. Is it a ezBoard forum converted up to Yuku, by any chance?

@Belcegor: no plans at the moment. Try setting language to English. However, some multiforum systems use custom extensions to phpBB and require special modifications to make the converter work.

@Lumpy: Well, unfortunately, you have to crawl the members and the topics/posts in the same run, or they don't get linked up properly. (It sucks, but that's the way it's written now).
ah, that makes sense. I will have to start over. thanks for the fast response.

robert

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Mon Apr 29, 2013 10:38 pm
by Lumpy Burgertushie
next question;

the highest user ID is 13,320 I just deleted all but 454 of those users.

now, if I start over and put in that 13320 number it will have to go through all of those numbers again and take another 48 hours to do so.

do I have to put that ID number in the script for it to work? or can I just give it the actual number of users?

thanks
robert

Re: [CONVERT] Crawler Converters (Forumer, ZetaBoards, etc.)

Posted: Tue Apr 30, 2013 1:42 am
by Lumpy Burgertushie
phpbbplanet phpbb2 board:

getting this error when trying to get the members:

Code: Select all

Traceback (most recent call last):
  File "D:\a1phpbb\1phpbb3\MODs\Converters\phpBB2\members_topics_posts_phpBB.py", line 259, in <module>
    dat[3]=re.findall('<input [^>]*name="email"[^>]*value="([^"]*)" />', admindata)[0]
IndexError: list index out of range

I can remove the sid in the setting file and do not get the error. the script seems to be running fine however it is not putting anything but the anonymous user in the sql file.

I have let it run for over 175 members and stopped it and the anonymous user is all that is in the file. and it is in there twice.

any ideas?

robert