Save All My Posts

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Get Involved
Post Reply
BigVolv
Registered User
Posts: 5
Joined: Fri Aug 22, 2008 9:51 pm

Save All My Posts

Post by BigVolv »

One of my favorite phpBB forums is in danger of being shut down. I'd like to save all my posts (over 5000) to my computer, as there are a lot of good memories. I recall reading something here about a way to do this back in the v2 days, but I can't find the post today. IIRC someone wrote a tool that would search and copy all your posts to a text file. Can this still be done in v3?
marian0810
Former Team Member
Posts: 3011
Joined: Mon May 21, 2007 9:17 pm
Location: The Netherlands
Name: Marian
Contact:

Re: Save All My Posts

Post by marian0810 »

Yes I remember that very well... :cry: It was never released though.

http://www.phpbb.com/community/viewtopi ... 7&t=562619

There's no such function in phpBB3 so I've moved your topic to MOD requests.
You and me, time and space. You watch us run!
BigVolv
Registered User
Posts: 5
Joined: Fri Aug 22, 2008 9:51 pm

Re: Save All My Posts

Post by BigVolv »

I'm not sure this fits as a mod request, becasue I am not an administrator of this board, only a member.
marian0810
Former Team Member
Posts: 3011
Joined: Mon May 21, 2007 9:17 pm
Location: The Netherlands
Name: Marian
Contact:

Re: Save All My Posts

Post by marian0810 »

In that case I think your only option is to copy and paste them all by hand.
You and me, time and space. You watch us run!
User avatar
4_seven
I've Been Banned!
Posts: 5155
Joined: Wed Apr 30, 2008 1:41 am

Re: Save All My Posts

Post by 4_seven »

it gives web-spider/grab programms. with this programms you can spider/grab complete sites.
eg. http://www.xaldon.de/products_webspider.html

on big sites it can take some days, but it works.
Current Mods | Mod Base | php(BB) programming | No help via PM
BigVolv
Registered User
Posts: 5
Joined: Fri Aug 22, 2008 9:51 pm

Re: Save All My Posts

Post by BigVolv »

Moderatadores, could you please move this back to the phpBB Discussion forum, since this is not a Mod request?
User avatar
4_seven
I've Been Banned!
Posts: 5155
Joined: Wed Apr 30, 2008 1:41 am

Re: Save All My Posts

Post by 4_seven »

Have you start the spider engine. no time to loose ;)
Current Mods | Mod Base | php(BB) programming | No help via PM
BigVolv
Registered User
Posts: 5
Joined: Fri Aug 22, 2008 9:51 pm

Re: Save All My Posts

Post by BigVolv »

I don't read German.
marian0810
Former Team Member
Posts: 3011
Joined: Mon May 21, 2007 9:17 pm
Location: The Netherlands
Name: Marian
Contact:

Re: Save All My Posts

Post by marian0810 »

Moved back to discussion :)
You and me, time and space. You watch us run!
User avatar
4_seven
I've Been Banned!
Posts: 5155
Joined: Wed Apr 30, 2008 1:41 am

Re: Save All My Posts

Post by 4_seven »

BigVolv wrote:I don't read German.
Than translate it or search for a freeware with multilanguage..
Current Mods | Mod Base | php(BB) programming | No help via PM
User avatar
igorw
Former Team Member
Posts: 8024
Joined: Fri Dec 16, 2005 12:23 pm
Location: {postrow.POSTER_FROM}
Name: Igor Wiedler

Re: Save All My Posts

Post by igorw »

If you know how to write a scraper, it should be relatively easy to implement. Let me describe how one would do it.
  1. Make a request to http://www.phpbb.com/community/search.p ... igorw&ch=0 (substitute "igorw" for your username)
  2. Adjust the "start" parameter to loop through all the pages. First page is 0, second is 15, third is 30, and so on.
  3. Extract all the post IDs
  4. For each post id, make a request to http://www.phpbb.com/community/posting. ... e=edit&p=x, replace x with the post id. Extract the content of the textarea tag, htmlspecialchars_decode it, store it.
  5. Use something like curl_multi to parallelize the requests.
  6. Use something like Symfony2's BrowserKit component to easily parse the contents of the page and read data out of it using CSS selectors
  7. That's it!
Not too hard for a coder to implement.
Igor Wiedler | area51 | GitHub | trashbin | Formerly known as evil less than three
User avatar
3Di
Former Team Member
Posts: 16147
Joined: Mon Apr 04, 2005 11:09 pm
Location: Milano 🇮🇹 Frankfurt 🇩🇪
Name: Marco
Contact:

Re: Save All My Posts

Post by 3Di »

🆓 Free support for our extensions also provided here: phpBB Studio
🚀 Looking for a specific feature or alternative option? We will rock you!
Please PM me only to request paid works. Thx. Want to compensate me for my interest? Donate
My development's activity º PhpStorm's proud user º Extensions, Scripts, MOD porting, Update/Upgrades
User avatar
drathbun
Former Team Member
Posts: 12204
Joined: Thu Jun 06, 2002 3:51 pm
Location: TOPICS_TABLE
Contact:

Re: Save All My Posts

Post by drathbun »

For what it's worth, some board owners / hosts frown on such activity because it can use excessive bandwidth and system resources.
I blog about phpBB: phpBBDoctor blog
Still using phpbb2? So am I! Click below for details
Image
Post Reply

Return to “phpBB Discussion”