Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Get help with installation and running phpBB 3.2.x here. Please do not post bug reports, feature requests, or extension related questions here.
WWu777
Registered User
Posts: 600
Joined: Tue Aug 14, 2007 12:40 pm
Contact:

Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WWu777 » Fri Sep 20, 2019 8:51 am

Dear Support,
Yesterday my forum crashed and server too. When Bluehost support rebooted the server, the forum was still crashed, specifically in two tables: phpbb_sessions and phpbb_posts. The first one was fixed, but the second one was still corrupted and would not repair. When I tried to repair using phpmyadmin and WHM, it had long lines about "file missing and skipped" etc.

Then eventually, it showed the table phpbb_posts as being repaired and Ok. However, for some reason, all the forum posts were gone! From 2007 til now! You can see the post topics and titles, but when you click on them, you get this:

http://www.happierabroad.com/forum/view ... =3&t=39479
Information
The requested topic does not exist.
What the heck happened? Usually when the forum crashes and that table is corrupted, I run the repair command several times and it fixes it and the posts show up again. But this time, somehow the table EJECTED the data and is no longer attached to it, even though the table is marked as Ok and repaired. But all the posts data is missing!

I tried my usual repair command in MYSQL in phpmyadmin: "REPAIR TABLE phpbb_posts USE_FRM;" which usually works but this time didn't.

What can be done? I don't have any recent backups. My last backup was over 6 months ago I think. Because I am traveling and have thousands of things to do and not enough time for such things. I do not have automated backup because I am on VPS and my VPS has limited storage space, not enough for automatic backups of my site, like I had before on shared hosting. I followed bad advice from my friend Stefan, who recommended I move to VPS hosting, but in doing so, my problems and costs have been multiplied with no benefits! It was the worst mistake and advice I ever received! I was far better off on shared hosting where my site was backed up daily, and server overloads resulted in backup servers coming to help pool their resources, rather than my whole server and site crashing on VPS without backup. I don't understand why you have to pay more on VPS when the benefits on shared hosting are way better and more stable and protected. Stupid.

Anyway, the good news is that all the posts must still be there. Because my database is still the same size at over 2 GB. So the data from all the posts must still be there, right? The problem is reconnecting it all with the table "phpbb_posts". How do you do that? Is there an SQL Query Command that will do it?

I am currently working with Bluehost tech support to fix this. They said they are working on it but it's been 24 hours already and they haven't fixed it yet. Can they? Do webhost admins have special professional tools that can fix such things beyond what the layman has?

What should I do? If I backup my database now, can someone offline, like some database specialist, or software program, some how fix it by reconnecting the post data to the table "phpbb_posts"?

There must be some way to fix it right? I mean computer problems are all fixable. It's just a matter of time and expertise and technical steps and capability right? It's not like bringing the dead back to life. Technical problems always have technical solutions right? It's just a matter of looking deep enough. There are even programs that recover deleted files by re-scrambling the empty space to whatever data was in the deleted file. So with computers, anything is possible right?

Any advice or suggestions? Thanks in advance.
Last edited by WWu777 on Fri Sep 20, 2019 9:20 am, edited 2 times in total.

WWu777
Registered User
Posts: 600
Joined: Tue Aug 14, 2007 12:40 pm
Contact:

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WWu777 » Fri Sep 20, 2019 8:58 am

Addendum:

Furthermore, another table is also crashed and unrepairable, the one called "phpbb_search_wordlist". It claims that it cannot create a TMP file and is unrepairable. Does anyone know what that means and how to fix it? How do I let it create a TMP file? Thanks.

Also when I try to post something, it shows this error message:

http://www.happierabroad.com/forum/post ... =post&f=33

Code: Select all

General Error
SQL ERROR [ mysqli ]

Table './happier2_HappierAbroad/phpbb_search_wordlist' is marked as crashed and last (automatic?) repair failed [144]

SQL

SELECT word_id, word_text FROM phpbb_search_wordlist WHERE word_text IN ('important', 'announcement', 'everyone', 'the', 'forum', 'has', 'crashed', 'and', 'this', 'time', 'database', 'table', 'phpbb', 'posts', 'too', 'didn', 'repair', 'correctly', 'hence', 'all', 'seem', 'gone', 'from', 'somehow', 'ejected', 'data', 'attached', 'don', 'know', 'how', 'why', 'seems', 'someone', 'out', 'there', 'wants', 'badly', 'remove', 'our', 'content', 'internet', 'because', 'truthful', 'honest', 'taboo', 'working', 'now', 'with', 'webhost', 'staff', 'fix', 'will', 'also', 'try', 'see', 'support', 'software', 'can', 'help', 'does', 'anyone', 'anything', 'about', 'tables', 'mysql', 'problem', 'must', 'still', 'btw', 'size', 'same', 'over', 'form', 'but', 'detached', 'any', 'you', 'may', 'have', 'pay', 'professional', 'thanks', 'for', 'your', 'patience', 'urgent', 'crash', 'resulted', 'post')

BACKTRACE

FILE: (not given by php)
LINE: (not given by php)
CALL: msg_handler()

FILE: [ROOT]/phpbb/db/driver/driver.php
LINE: 993
CALL: trigger_error()

FILE: [ROOT]/phpbb/db/driver/mysqli.php
LINE: 193
CALL: phpbb\db\driver\driver->sql_error()

FILE: [ROOT]/phpbb/db/driver/factory.php
LINE: 329
CALL: phpbb\db\driver\mysqli->sql_query()

FILE: [ROOT]/phpbb/search/fulltext_native.php
LINE: 1451
CALL: phpbb\db\driver\factory->sql_query()

FILE: [ROOT]/includes/functions_posting.php
LINE: 2209
CALL: phpbb\search\fulltext_native->index()

FILE: [ROOT]/posting.php
LINE: 1445
CALL: submit_post()

User avatar
Mick
Support Team Member
Support Team Member
Posts: 21572
Joined: Fri Aug 29, 2008 9:49 am
Location: Caerdydd

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by Mick » Fri Sep 20, 2019 9:03 am

What does your host have to say about it? If they’ve got issues with servers crashing they should be repairing them and anything caused by it.
"The more connected we get the more alone we become" - Kyle Broflovski

User avatar
WelshPaul
Registered User
Posts: 329
Joined: Tue Aug 19, 2014 2:09 pm

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WelshPaul » Fri Sep 20, 2019 9:06 am

Nothing wrong with a VPS if you know what your doing! You start off on shared hosting and as your site and traffic grows you eventually have to move up to a VPS and on to a dedicated server. Oh and you can back up a VPS and it doesn't have to use any of your VPS storage space but I guess BLUEHOST doesn't offer that? If your VPS is crashing regularly or every now and then to the point where it's corrupting your database then you should get a VPS with the required CPU, RAM and storage space to handle your sites traffic. My VPS has been online since 2015 and has never crashed! I also have weekly VPS backups and daily database backups (I'm not with BLUEHOST).

For future reference, use David63's Auto database backup and Dropbox upload for autobackup extension so that at the very least you will have a daily backup of your database and it won't use any of your VPS storage space.

Anyway, is this a managed VPS? If it is then BLUEHOST should be looking into what's happening and fixing it as Mick points out above.

WWu777
Registered User
Posts: 600
Joined: Tue Aug 14, 2007 12:40 pm
Contact:

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WWu777 » Fri Sep 20, 2019 9:35 am

WWu777 wrote:
Fri Sep 20, 2019 8:58 am
Addendum:

Furthermore, another table is also crashed and unrepairable, the one called "phpbb_search_wordlist". It claims that it cannot create a TMP file and is unrepairable. Does anyone know what that means and how to fix it? How do I let it create a TMP file? Thanks.
Update:

Ok I fixed the table "phpbb_search_wordlist" in phpmyadmin, so now posts can be submitted in my forum without error messages. However, all the posts are still gone and we are still trying to repair that.

I fixed it by entering this long command string in MYSQL according to the instructions here:

viewtopic.php?p=10485205#p10485205

WWu777
Registered User
Posts: 600
Joined: Tue Aug 14, 2007 12:40 pm
Contact:

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WWu777 » Fri Sep 20, 2019 9:45 am

Mick wrote:
Fri Sep 20, 2019 9:03 am
What does your host have to say about it? If they’ve got issues with servers crashing they should be repairing them and anything caused by it.
Yes for the past few months, my server has been crashing a lot. Sometimes daily! That is unacceptable. My webhost, Bluehost, doesn't know why, even when they look at their logs. Their VPS support staff said I must have too much traffic in my forum, or too many commands in MYSQL are being run at once, or my forum or database are not being optimized, etc. It could also be that hackers and spam bots have overloaded my server or caused it to crash too. I don't know. How can I know? The server logs don't say much.

Recently my forum has tripled in traffic. There are now 300 to 400 people online at the same time during peak hours. So I figured the increased traffic must be the cause. So I upgraded my VPS resources. I doubled the RAM from 2 GB to 4 GB, and added one more CPU core so make it three CPU cores. But I did not add storage space. So far, it's prevented the crashes from occurring, until yesterday.

However, this has added a lot more cost to my monthly hosting fee though. Bluehost does not allow you to upgrade your VPS plan. They said you have to cancel your plan and create a new account in order to upgrade. So stupid. They should be more progressive than that.

So I got two choices:

1. Upgrade my VPS plan by creating a new account and migrating my site over. Or add resources to my current plan and pay a lot more in hosting fees, more than double.

2. Migrate back to premium shared hosting, where resources are backed up from other servers so that if my server is overloaded, it will be protected by resources from backup servers. Plus I get unlimited storage space and bandwidth and free daily backups of my site and database.

I don't see why VPS is supposed to be better and cost more? With VPS when my server is overloaded, my site crashes and so does my server. Then I have to do live chat with Bluehost and have them reboot it, which I've done hundreds of times. But on premium shared hosting (note: premium, not standard shared hosting), my resources are backed up so server overloads are protected from crashing. You don't get this kind of protection on VPS. So how is that better? Plus VPS has limited storage space, and if you don't have enough for an automated backup, you have to purchase more storage space, which costs a lot each month. But on shared hosting, your storage space is unlimited.

Yes premium shared hosting is cheaper than VPS. Go figure. I don't get the logic of that. Can anyone explain?

Ever since moving to VPS, my problems and costs have multiplied greatly. How is that an advantage? Why pay more for more problems and less stability? I don't get it.

User avatar
david63
Registered User
Posts: 16540
Joined: Thu Dec 19, 2002 8:08 am
Location: Lancashire, UK
Name: David Wood
Contact:

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by david63 » Fri Sep 20, 2019 9:50 am

It might be a fairly obvious statement - but why did you not restore your database from the latest backup?
David
Remember: You only know what you know and - you don't know what you don't know!
My CDB Contributions | How to install an extension
I will not be accepting translations for any of my extensions in Github - please post any translations in the appropriate topic.
No support requests via PM or email as they will be ignored

WWu777
Registered User
Posts: 600
Joined: Tue Aug 14, 2007 12:40 pm
Contact:

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WWu777 » Fri Sep 20, 2019 9:54 am

WelshPaul wrote:
Fri Sep 20, 2019 9:06 am
Nothing wrong with a VPS if you know what your doing! You start off on shared hosting and as your site and traffic grows you eventually have to move up to a VPS and on to a dedicated server. Oh and you can back up a VPS and it doesn't have to use any of your VPS storage space but I guess BLUEHOST doesn't offer that? If your VPS is crashing regularly or every now and then to the point where it's corrupting your database then you should get a VPS with the required CPU, RAM and storage space to handle your sites traffic. My VPS has been online since 2015 and has never crashed! I also have weekly VPS backups and daily database backups (I'm not with BLUEHOST).

For future reference, use David63's Auto database backup and Dropbox upload for autobackup extension so that at the very least you will have a daily backup of your database and it won't use any of your VPS storage space.

Anyway, is this a managed VPS? If it is then BLUEHOST should be looking into what's happening and fixing it as Mick points out above.
How can that be? I thought Bluehost was one of the best in the business? Their YouTube ads sure make it seem that way. No of course Bluehost VPS has no free backups. Only shared hosting does.

How much CPU and RAM does my VPS need? I had only 2 GB RAM and 2 CPU cores. I doubled that and now my forum doesn't crash anymore except for yesterday. How much resources does your VPS have?

Who is David 63? Where is his backup program or method? The thing is, my forum databse is over 2 GB! HUGE! It's very hard to back that up. If I try to use mysqldump it always times out and gives an error message. So what do forum owners with huge databases like mine usually do to back them up?

They just use the automated backup on their server right? Or is there any other way? Would David 63 have a solution?

No my VPS is not managed. That would cost a lot more. Shared hosting is managed though. I don't get why VPS is better than shared hosting. It seems shared hosting is better in every way and more stable too. Why would anyone pay more for VPS? What's the advantage? I asked Bluehost staff and they don't know what the advantage is either. lol. Maybe the ego gratification of running your own server? lol

Bluehost is looking into it now. The last time a major crash happened it took them 36 hours to fix it. We are keeping our fingers crossed.

User avatar
WelshPaul
Registered User
Posts: 329
Joined: Tue Aug 19, 2014 2:09 pm

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WelshPaul » Fri Sep 20, 2019 9:57 am

No shared hosting provider will host a site indefinitely. They all have their individual limits and if you reach them then they will terminate or suspend your hosting account and your website will go down. That's why you have VPS and Dedicated server options.

Have you exported the posts table and looked through it to confirm that the "missing posts" are still located in the table?

WWu777
Registered User
Posts: 600
Joined: Tue Aug 14, 2007 12:40 pm
Contact:

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WWu777 » Fri Sep 20, 2019 9:58 am

david63 wrote:
Fri Sep 20, 2019 9:50 am
It might be a fairly obvious statement - but why did you not restore your database from the latest backup?
I don't have any latest backup. There is no free backup on VPS and if I set it to automate the backups, daily or weekly, it will use up my storage space on VPS, more than I have. So I would have to pay a lot more to double my storage space. On shared hosting there were free automated backups. But my advisors gave me bad advice to move to VPS where I enjoyed none of the benefits I had on shared hosting, but more problems, more crashes, and more costs. Totally illogical. Yet that's what website experts recommended. I don't know why.

I have a manual backup from cpanel from 6 months ago but I don't want to lose all the posts in the last 6 months. The content is priceless.

Plus I don't even know if the backup was done properly, because my forum database is over 2 GB, so backups usually time out and fail. MySQLDumper definitely cannot back up a large database. So how can cpanel in my webhost do it completely?

User avatar
Mick
Support Team Member
Support Team Member
Posts: 21572
Joined: Fri Aug 29, 2008 9:49 am
Location: Caerdydd

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by Mick » Fri Sep 20, 2019 10:04 am

If it were me I’d follow the instructions for backing up in Transferring Your Board to a New Host or Domain, save the dB to my local machine and look for another host. Always assuming of course that your present host can’t fix the problem.
"The more connected we get the more alone we become" - Kyle Broflovski

WWu777
Registered User
Posts: 600
Joined: Tue Aug 14, 2007 12:40 pm
Contact:

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WWu777 » Fri Sep 20, 2019 10:12 am

WelshPaul wrote:
Fri Sep 20, 2019 9:57 am
No shared hosting provider will host a site indefinitely. They all have their individual limits and if you reach them then they will terminate or suspend your hosting account and your website will go down. That's why you have VPS and Dedicated server options.

Have you exported the posts table and looked through it to confirm that the "missing posts" are still located in the table?
Then how come the webhosts always advertise "unlimited hosting space" to new accounts to get you to sign up? What is unlimited exactly?

Ok I just tried that. The phpbb_posts table is empty and doesn't have the posts in them. But the post data must be there, because the database size is still over 2 GB.

All computer problems must have a technical solution right? It's just a matter of looking deep enough.

User avatar
WelshPaul
Registered User
Posts: 329
Joined: Tue Aug 19, 2014 2:09 pm

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WelshPaul » Fri Sep 20, 2019 10:14 am

WWu777 wrote:
Fri Sep 20, 2019 9:54 am
How can that be? I thought Bluehost was one of the best in the business? Their YouTube ads sure make it seem that way. No of course Bluehost VPS has no free backups. Only shared hosting does.
Having looked at Bluehost's offering, I would never use them! I maintain my own VPS, there is no help or support from the host as its unmanaged but you do get support regarding billing or the user control panel used to create a vps and upscale or downscale it. If you don't know how to setup, secure and maintain a VPS or Dedicated server then you should always look for a managed option but be warned, the cost is much higher. It's all subjective though! Also not all shared hosting providers offer free backups so one should never assume your going to get that.
WWu777 wrote:
Fri Sep 20, 2019 9:54 am
How much CPU and RAM does my VPS need? I had only 2 GB RAM and 2 CPU cores. I doubled that and now my forum doesn't crash anymore except for yesterday. How much resources does your VPS have?
I have a 4GB / 2 CPU / 80GB VPS running Centos 7 but I can upgrade my RAM, CPU or storage space to a maximum of 192 GB / 32 CPU /12 TB at anytime to meet extra demand. It's not all about hardware though, you must make sure that you configure PHP, MySQL, apache etc to use the limited resources equally and safely in order to prevent crashes. If you have a 192 GB / 32 CPU /12 TB VPS but MySQL config has a limit of 1GB because you never updated it to reflect the new limits then MySQL will not use the extra hardware and will crash.
WWu777 wrote:
Fri Sep 20, 2019 9:54 am
Who is David 63? Where is his backup program or method? The thing is, my forum databse is over 2 GB! HUGE! It's very hard to back that up. If I try to use mysqldump it always times out and gives an error message. So what do forum owners with huge databases like mine usually do to back them up?

They just use the automated backup on their server right? Or is there any other way? Would David 63 have a solution?
He's posted in this thread. Check out his extensions!

WWu777
Registered User
Posts: 600
Joined: Tue Aug 14, 2007 12:40 pm
Contact:

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WWu777 » Fri Sep 20, 2019 10:15 am

Mick wrote:
Fri Sep 20, 2019 10:04 am
If it were me I’d follow the instructions for backing up in Transferring Your Board to a New Host or Domain, save the dB to my local machine and look for another host. Always assuming of course that your present host can’t fix the problem.
But on your article:
https://www.phpbb.com/support/docs/en/3 ... or-domain/

All the DB backup methods won't work. Especially those from ACP or phpmyadmin. Because if your DB is over a certain size, it will time out and result in error messages. Even mysqldumper cannot do it. My DB size is over 2 GB. It has thousands of topics since 2007.

How can you back that up? What do other forum owners do in my situation usually?

User avatar
WelshPaul
Registered User
Posts: 329
Joined: Tue Aug 19, 2014 2:09 pm

Re: Help! "phpbb_posts" table crashed and ejected all data! All posts in forum gone! What can be done?

Post by WelshPaul » Fri Sep 20, 2019 10:15 am

WWu777 wrote:
Fri Sep 20, 2019 10:12 am
WelshPaul wrote:
Fri Sep 20, 2019 9:57 am
No shared hosting provider will host a site indefinitely. They all have their individual limits and if you reach them then they will terminate or suspend your hosting account and your website will go down. That's why you have VPS and Dedicated server options.

Have you exported the posts table and looked through it to confirm that the "missing posts" are still located in the table?
Then how come the webhosts always advertise "unlimited hosting space" to new accounts to get you to sign up? What is unlimited exactly?
Simply put - They lie!

Post Reply

Return to “[3.2.x] Support Forum”