[CONVERT] Forumotion converter

[nneonneo]

By request, I've created a Forumotion converter. This only works with phpBB3 boards, and will convert to phpBB3. Some things are lost, e.g. user passwords and attachments.

Before asking a question here, make sure it's not already covered in the (short) FAQ, and make sure you are using the newest version of the converter.

Troubleshooting
Every topic comes back with "Topic is empty!"

• Make sure you are using the newest version of the converter (posted here)
• Ensure that your date settings are configured properly (the change must be made in your User CP/user preferences, and NOT the administration panel)
• Make sure that your forum is using the phpBB3 version skin
• Try creating a brand new admin account and converting from that one.

"Exception: Empty admin page -- double check cookie?"

• Make sure you are using the newest version of the converter (posted here)
• Try redoing the cookie step.
• If the members step succeeded in earlier conversions, but is now failing, try waiting about 24-48 hours for the ACP to reset.

General tips

• Double-check to make sure all the ACP and profile changes in Instructions.txt were carried out exactly as stated.
• Make sure to read the Instructions file completely before starting.
• Not every post in this topic is relevant to the current version of the converter. If you think someone else may have posted about your problem, start with the most recent posts.

EDIT [Mar 31 2008]: Fixed a little member-conversion bug. Oops.
EDIT [Apr 1 2008]: Another conversion bug fixed.
EDIT [Aug 1 2008]: Bunch of little bugs fixed, mainly for highly customized boards. Implemented a recursive subforum crawler, updated BBCode conversion, added topic view parsing, etc.
EDIT [Aug 19 2008]: Updates for new Forumotion code.
EDIT [Oct 28 2008]: Updates for new Forumotion code.
EDIT [Nov 2 2008]: Updated woefully incomplete Instructions file.
EDIT [Nov 7 2008]: Updated converter to cope with new Forumotion code, updated category & forum detection
EDIT [Apr 15 2009]: Updated to version 0.2.7.
EDIT [Apr 25 2009]: Updated to version 0.2.8.
EDIT [Aug 26 2009]: Updated to version 0.2.9: update to cope with new code, add support for "advanced profile"
EDIT [Sept 20 2009]: Updated to version 0.3.0: minor fixes.
EDIT [Jan 31 2010]: Updated to version 0.3.1: fixes for post sorting, emotes, URLs, and various other minor changes.
EDIT [Mar 3 2010]: Updated documentation.
EDIT [Mar 18 2010]: Updated to version 0.3.2: fix for forum-topic association problems with HTML forum titles.
EDIT [Mar 25 2010]: Updated documentation.
EDIT [Jun 12 2010]: Updated to version 0.3.3: many minor fixes and updates.
EDIT [Sept 20 2010]: Updated to version 0.3.4: many more minor fixes.
EDIT [Nov 13 2010]: Updated to version 0.3.5: cope with recent Forumotion changes.
EDIT [Dec 17 2010]: Updated to version 0.3.6: major speed improvements, username conversion fixes, updates to cope with Forumotion's new URL style.
EDIT [Oct 18 2011]: Updated to version 0.3.7: minor fixes, fix member conversion.
EDIT [Nov 20 2013]: Updated to version 0.4.1: updates for new Forumotion code
As of writing, it has been downloaded about 3800 times.

[lightyagami69]

Member ID 1
Traceback (most recent call last):
File "C:\Documents and Settings\123\Desktop\Forumotion\Forumotion\members_topics_posts_phpBB3.py", line 199, in <module>
date=re.findall("""<span style="vertical-align: top;">(.+?)&nbsp; </span>""",i)[0]
IndexError: list index out of range

Member ID 2
Traceback (most recent call last):
File "C:\Documents and Settings\123\Desktop\Forumotion\Forumotion\members_topics_posts_phpBB3.py", line 199, in <module>
date=re.findall("""<span style="vertical-align: top;">(.+?)&nbsp; </span>""",i)[0]
IndexError: list index out of range

Member ID 3
Traceback (most recent call last):
File "C:\Documents and Settings\123\Desktop\Forumotion\Forumotion\members_topics_posts_phpBB3.py", line 199, in <module>
date=re.findall("""<span style="vertical-align: top;">(.+?)&nbsp; </span>""",i)[0]
IndexError: list index out of range

Member ID 4
Traceback (most recent call last):
File "C:\Documents and Settings\123\Desktop\Forumotion\Forumotion\members_topics_posts_phpBB3.py", line 199, in <module>
date=re.findall("""<span style="vertical-align: top;">(.+?)&nbsp; </span>""",i)[0]
IndexError: list index out of range

Member ID 5
Traceback (most recent call last):
File "C:\Documents and Settings\123\Desktop\Forumotion\Forumotion\members_topics_posts_phpBB3.py", line 199, in <module>
date=re.findall("""<span style="vertical-align: top;">(.+?)&nbsp; </span>""",i)[0]
IndexError: list index out of range

Member ID 6
Traceback (most recent call last):
File "C:\Documents and Settings\123\Desktop\Forumotion\Forumotion\members_topics_posts_phpBB3.py", line 199, in <module>
date=re.findall("""<span style="vertical-align: top;">(.+?)&nbsp; </span>""",i)[0]
IndexError: list index out of range


...till my last member, 308.

why?

Is this because my board is not english?

I tried several times and it always occur.

Any suggestion? I desperately need the db~

[nneonneo]

Updated the converter: that error should no longer occur.

[MistyIRC]

I was using this converter on a friend's board at http://sova.soulsboard.com. When I used it, I encountered this...

Member 54 ... Downloading - 24576 bytes W
arning: Member 54 doesn't exist!
Member 55 ... Downloading - 24576 bytes W
arning: Member 55 doesn't exist!
Member 56 ... Downloading - 24576 bytes W
arning: Member 56 doesn't exist!
Member 57 ... Downloading - 24576 bytes W
arning: Member 57 doesn't exist!

So, being a Python programmer, I took a look at your code and noticed that it searches for <dd> and <dt> tags, which the forum I'm working on lacks. What's wrong?

[MistyIRC]

okay i figured out THAT problem - i was using the PHPBB2 skin. I changed to phpBB3, and now it loads the members properly. However, it does NOT load the forums correctly, and the problem seems to be with the index page and re_forums, which seems to expect <span> when the forum is using <div>. Any ideas?

[nneonneo]

I fixed that a couple of weeks ago (Forumotion changed their display code), but as I went on vacation, I haven't had the time to test and update the code here.

The new code is now uploaded to the first post.

[sotirisk]

Hi.
Thanks for the converter.

I would like to ask for a better instruction file, cause I can't find any sql batch files nor topics_post.py, but only these:

Code: Select all

ls -larth
total 20K
-rw-r--r-- 1 root root  588 2008-07-24 22:24 split_sql.py
-rw-r--r-- 1 root root 1.7K 2008-08-02 10:21 common.py
drwxr-xr-x 3 root root 4.0K 2008-11-02 17:05 ..
drwxr-xr-x 2 root root 4.0K 2008-11-02 17:30 Forumotion
drwxr-xr-x 3 root root 4.0K 2008-11-02 17:32 .

and these:

Code: Select all

 ls -larth
total 48K
-rw-r--r-- 1 root root 1.4K 2008-07-24 22:24 pm_passwords.py
-rw-r--r-- 1 root root 3.7K 2008-07-24 22:24 Instructions.txt
-rw-r--r-- 1 root root  25K 2008-08-19 21:51 members_topics_posts_phpBB3.py
-rw-r--r-- 1 root root 2.4K 2008-11-02 17:28 settings.py
drwxr-xr-x 2 root root 4.0K 2008-11-02 17:30 .
drwxr-xr-x 3 root root 4.0K 2008-11-02 17:32 ..

Another thing is that I can't understand if you're talking about the forumotion forum or the phpbb3 forum (for example, the COOKIEDATA variable should be filled from the data from forumotion?).

Thanks a lot.

[nneonneo]

Thanks for letting me know. I've updated the Instructions file, as well as uploading a newer version of the script.

If you find any errors in the new Instructions file, let me know.

[NiCkkkDoN]

nneonneo i want your help plz. i dont understand how to use your convetor. i m already read your Instructions file. but i cant understand. how to use this convert plz tell me i have my forumotion forum with phpbb3 and own domain & host.

[nneonneo]

Have you installed Python and edited settings.py? You need to be more specific in what you need help with.

[sotirisk]

Hello nneonneo,

I have this error message (on line 287 of members_topics_posts_phpBB3)

Code: Select all

# python members_topics_posts_phpBB3.py
  File "members_topics_posts_phpBB3.py", line 287
    out.write(','.join(["(%i, %i, %i, '%s', '%s', %i, '%s', '%s', '%s', 'en', 1, %i, '%s', %i, '', '', '%s', '', '', 't', 'a', 't', 'd', '%s', '', '', '%s', '%s', '%s', '%s', '%s', '', %i, '%s', '%s', '%s', '', '', 1, 2)" %(dat[0],dat[19],5 if dat[19] else 2,dat[1],dat[1].lower(),dat[11],dat[17],dat[3],str(crc32(dat[3]))+str(len(dat[3])),1 if dat[19] else 0,'AA0000' if dat[19] else '',dat[9],dat[6],dat[18],dat[8],dat[12],dat[13],dat[14],dat[15],dat[16],dat[5],dat[21]

Thanks a lot.

[nneonneo]

That's not the whole error...

Are you using Python 2.5?

[sotirisk]

Sorry for that, my mistake, I used a wrong path (of the older python2.4) . . .
It worked with python 2.5 but it doesn't generate the topics. (topics_posts_phpBB3.sql is only 84 bytes).
It maybe a locale problem, cause the forum that is to be converted is in Greek language.

Code: Select all

# ls -larth
total 144K
-rw-r--r-- 1 root root 4.3K 2008-07-24 21:35 add_phpbb3_bots.py
-rw-r--r-- 1 root root 1.4K 2008-07-24 22:24 pm_passwords.py
-rw-r--r-- 1 root root  25K 2008-10-28 00:18 members_topics_posts_phpBB3.py
-rw-r--r-- 1 root root 3.9K 2008-11-02 11:08 Instructions.txt
-rw-r--r-- 1 root root 2.4K 2008-11-06 04:18 settings.py
-rw-r--r-- 1 root root 1.3K 2008-11-06 06:33 settings.pyc
-rw-r--r-- 1 root root    0 2008-11-06 06:33 critical_error.log
drwxr-xr-x 3 root root 4.0K 2008-11-06 06:33 ..
-rw-r--r-- 1 root root 1.5K 2008-11-06 06:42 convert_error.log
drwxr-xr-x 2 root root 4.0K 2008-11-06 06:42 .
-rw-r--r-- 1 root root 2.1K 2008-11-06 06:53 pm_passwords.txt
-rw-r--r-- 1 root root  51K 2008-11-06 06:53 members_phpBB3.sql
-rw-r--r-- 1 root root   84 2008-11-06 06:54 topics_posts_phpBB3.sql
-rw-r--r-- 1 root root  16K 2008-11-06 06:54 categories_forums_phpBB3.sql

[Karl1987]

i have a question? in this line.

Code: Select all

When you set up your forum software, what prefix did you use (default will depend on the exact software used; it's usually the product name plus an underscore)
	COOKIEDATA
		Get this by entering this into the address bar while viewing any page in your Forumotion forum:
			javascript:document.cookie
		and copying the entire text of the page that appears.
		The COOKIEDATA line should look like
			COOKIEDATA='<Cookie Data retrieved from the prompt message>'
		with the single quotes around your data.

mmmm for example, how can login whit javascript:document.cookie in my forum http://testkarl.activoforo.com please helpme

[nneonneo]

So, what you do first is login to the Forumotion forum normally.

Then, while you are on one of the Forumotion pages, type "javascript:document.cookie" (no quotes) into the address bar and press enter. The page should be replaced by a few lines of code, which you then copy and paste into COOKIEDATA between the ' ' characters.