Discuss: The return of the database / Recent Downtime

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Get Involved
User avatar
MichaelC
Consultant
Consultant
Posts: 3642
Joined: Mon Dec 21, 2009 3:36 pm
Location: Surrey, UK
Name: Michael Cullum
Contact:

Discuss: The return of the database / Recent Downtime

Post by MichaelC » Sun Aug 09, 2015 1:43 am

Please discuss the announcement and blog post here.
:)
Formerly known as Unknown Bliss.
Formerly Website Team Lead/Manager & Development Team.
Please don't PM me for support (or stuff that belongs in the forums or tracker) but otherwise feel free

User avatar
optimusvault
Registered User
Posts: 108
Joined: Tue Jul 28, 2015 2:51 am
Name: Aaron

Re: Discuss: The return of the database

Post by optimusvault » Sun Aug 09, 2015 1:51 am

Announcement
The requested topic does not exist.
Cheers,
Aaron

User avatar
MichaelC
Consultant
Consultant
Posts: 3642
Joined: Mon Dec 21, 2009 3:36 pm
Location: Surrey, UK
Name: Michael Cullum
Contact:

Re: Discuss: The return of the database

Post by MichaelC » Sun Aug 09, 2015 1:53 am

optimusvault wrote:Announcement
The requested topic does not exist.
We post these topics to get the link, then edit it into the announcement just before approving it. You were just very quick and caught us in between those two things. It's up there now. :)
:)
Formerly known as Unknown Bliss.
Formerly Website Team Lead/Manager & Development Team.
Please don't PM me for support (or stuff that belongs in the forums or tracker) but otherwise feel free

User avatar
optimusvault
Registered User
Posts: 108
Joined: Tue Jul 28, 2015 2:51 am
Name: Aaron

Re: Discuss: The return of the database / Recent Downtime

Post by optimusvault » Sun Aug 09, 2015 1:55 am

I see :p

Thanks for fixing all of the issues. Sucks phpBB was down as I missed you guys! But glad you're back now :)
Cheers,
Aaron

User avatar
Lumpy Burgertushie
Registered User
Posts: 66748
Joined: Mon May 02, 2005 3:11 am
Contact:

Re: Discuss: The return of the database / Recent Downtime

Post by Lumpy Burgertushie » Sun Aug 09, 2015 2:51 am

I figured someone just tripped over the plug on their way out the door for another beer.


robert
I'm baaaaaccckkkk. still doing work on donation basis. PM your needs.

Premium phpBB 3.2 Styles by PlanetStyles.net

If a tree falls in the forest and nobody is there, does it make a sound?

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 4019
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Discuss: The return of the database / Recent Downtime

Post by HiFiKabin » Sun Aug 09, 2015 10:42 am

I still think that they don't feed the hamsters enough

Image

User avatar
SiteSplat
Registered User
Posts: 74
Joined: Sun Sep 07, 2014 7:17 pm
Contact:

Re: Discuss: The return of the database / Recent Downtime

Post by SiteSplat » Mon Aug 10, 2015 12:33 am

Looks like there is most likely some DB tables corruption around. For example:

viewtopic.php?f=461&t=2286276

Shows 7 replies , but there are 2 posts in total. Older stuff seems to be in limbo :)

User avatar
RMcGirr83
Recognised Extension Developer
Posts: 21034
Joined: Wed Jun 22, 2005 4:33 pm
Location: Your display
Name: Rich McGirr
Contact:

Re: Discuss: The return of the database / Recent Downtime

Post by RMcGirr83 » Mon Aug 10, 2015 12:39 am

:cry: but at least we have ssl instead of a good database backup plan.
In times of change, learners inherit the earth, while the learned find themselves beautifully equipped to deal with a world that no longer exists - Eric Hoffer
Former Modifications/Extensions Team Member | My extensions
Appreciate the extensions/mods/support then buy me a beer
All requests for support via PM will be ignored

User avatar
MichaelC
Consultant
Consultant
Posts: 3642
Joined: Mon Dec 21, 2009 3:36 pm
Location: Surrey, UK
Name: Michael Cullum
Contact:

Re: Discuss: The return of the database / Recent Downtime

Post by MichaelC » Mon Aug 10, 2015 1:02 am

SiteSplat wrote:Looks like there is most likely some DB tables corruption around. For example:

viewtopic.php?f=461&t=2286276

Shows 7 replies , but there are 2 posts in total. Older stuff seems to be in limbo :)
Yeah, that's because some posts made to those topics are missing but we'd rather leave odd post counts like that in place so that we can identify where posts disappeared from in the future (such as realising that a post is a reply to a post that is no longer there as opposed to just a random post). I don't think a few off counts hurt?

But thanks for pointing this out. :)
RMcGirr83 wrote::cry: but at least we have ssl instead of a good database backup plan.
This is handled by OSL as previously stated and it was a rare situation in that the backups are taken from SQL2 and it was fixing SQL2 so backups could recommence that then caused issues to SQL1.

OSL are making numerous changes to ensure that their backup infrastructure is a lot more steadfast (As you can read about here) and we are also working on making our own daily database backups for redundancy in light of this incident (so we will have two independent backup systems backing up to different locations). OSL did have a good backup plan in place (It is considered good/common industry practice to backup from your slave/second SQL server in order to prevent load on your primary SQL1) but of course in this rare edge case that proved problematic which is why we will be working to make it an even greater backup plan. :)

I might add that SSL is important to us as we highly value our users security and privacy, but requires relatively little work to implement (A few uploads and a few lines added to a virtual host as you know) compared to our new backup infrastructure which we are looking to implement which requires the setting up of various new systems and a lot of man hours in order to ensure it's reliability. Our number one priority is our commitment to your security and, by extension, the security of the data you put on phpbb.com.
:)
Formerly known as Unknown Bliss.
Formerly Website Team Lead/Manager & Development Team.
Please don't PM me for support (or stuff that belongs in the forums or tracker) but otherwise feel free

User avatar
Ger
Recognised Extension Developer
Posts: 1882
Joined: Wed Jan 02, 2008 7:35 pm
Location: 192.168.1.100
Contact:

Re: Discuss: The return of the database / Recent Downtime

Post by Ger » Mon Aug 10, 2015 8:01 am

RMcGirr83 wrote::cry: but at least we have ssl instead of a good database backup plan.
Well there's a constructive comment :?

Those things have absolutely no correlation. Why nag? Situation is bad enough as it is and the nice people providing all this for us are working to improve it.
My extensions:
Simple CMS, Feed post bot, Avatar Resize, Modbreak, Magic OGP, Live topic update, Modern Quote, Quoted Where (GDPR) and Autoresponder.
Newest: FAQ manager for 3.2

Like my work? Buy me a coffee to keep it coming. :ugeek:
-Available for custom work-

User avatar
RMcGirr83
Recognised Extension Developer
Posts: 21034
Joined: Wed Jun 22, 2005 4:33 pm
Location: Your display
Name: Rich McGirr
Contact:

Re: Discuss: The return of the database / Recent Downtime

Post by RMcGirr83 » Mon Aug 10, 2015 9:34 am

It isn't a "nag" it is an observation. If it were my "toy", which it isn't, I would ensure that I had a good db backup plan in place. Redundancy is nice but clearly wasn't enough in this case. I still, to this day, do not understand the need for ssl on a forum site. But that's a discussion for another topic/day.
In times of change, learners inherit the earth, while the learned find themselves beautifully equipped to deal with a world that no longer exists - Eric Hoffer
Former Modifications/Extensions Team Member | My extensions
Appreciate the extensions/mods/support then buy me a beer
All requests for support via PM will be ignored

robertm96
Registered User
Posts: 2
Joined: Thu Jul 23, 2015 12:14 pm

Re: Discuss: The return of the database / Recent Downtime

Post by robertm96 » Mon Aug 10, 2015 12:09 pm

Feed that hamster please :D :D :D

Khaos-Rage
Registered User
Posts: 71
Joined: Sun Jul 13, 2008 4:31 am

Re: Discuss: The return of the database / Recent Downtime

Post by Khaos-Rage » Mon Aug 10, 2015 3:11 pm

OSL wrote:As mentioned previously, mysql1 and mysql2 were unexpectedly set up in master-master replication configuration. Therefore, though slave replication on mysql2 was stopped, mysql2 was still sending commands to mysql1. This caused databases to be dropped on both machines.
yolo? :geek:

User avatar
mrgtb
Registered User
Posts: 563
Joined: Wed Oct 03, 2007 10:51 am

Re: Discuss: The return of the database / Recent Downtime

Post by mrgtb » Tue Aug 18, 2015 9:28 am

RMcGirr83 wrote:It isn't a "nag" it is an observation. If it were my "toy", which it isn't, I would ensure that I had a good db backup plan in place. Redundancy is nice but clearly wasn't enough in this case. I still, to this day, do not understand the need for ssl on a forum site. But that's a discussion for another topic/day.
Neither do I also, but since Google hinted (said) they'd start ranking sites higher using SLL. Every man and his dog has jumped on making their forum use SLL since. Too many people follow what Google says do...

There's been a number of issues with this site going down this year, doesn't look very good for the site in general it keep happening too regular.

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 4019
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Discuss: The return of the database / Recent Downtime

Post by HiFiKabin » Tue Aug 18, 2015 9:41 am

mrgtb wrote:
RMcGirr83 wrote:It isn't a "nag" it is an observation. If it were my "toy", which it isn't, I would ensure that I had a good db backup plan in place. Redundancy is nice but clearly wasn't enough in this case. I still, to this day, do not understand the need for ssl on a forum site. But that's a discussion for another topic/day.
Neither do I also, but since Google hinted (said) they'd start ranking sites higher using SLL. Every man and his dog has jumped on making their forum use SLL since. Too many people follow what Google says do...

There's been a number of issues with this site going down this year, doesn't look very good for the site in general it keep happening too regular.
IIRC the ranking hike Google give if you have a secure certificate is less than 1%.

Hardly worth it IMHO

Post Reply

Return to “phpBB Discussion”