Too many attachements in file directory

Get help with installation and running phpBB 3.0.x here. Please do not post bug reports, feature requests, or MOD-related questions here.
Scam Warning
Forum rules
END OF SUPPORT: 1 January 2017 (announcement)
Bramster.
Registered User
Posts: 151
Joined: Thu Mar 04, 2010 7:42 am

Too many attachements in file directory

Post by Bramster. » Sun Mar 13, 2011 1:58 pm

My hostingprovider is complaining (and expecting problems) because my files directory (where the attachements are stored) contains almost 80000 files.

What to do now ?

What are my options ?

All suggestions are welcome.

Bramster

Bramster.
Registered User
Posts: 151
Joined: Thu Mar 04, 2010 7:42 am

Re: Too many attachements in file directory

Post by Bramster. » Mon Mar 14, 2011 6:28 pm

No one with similar problems or suggestiosn for a solution ?

I did find a MOD ( http://www.phpbb.com/community/viewtopi ... &t=1967455 ), but after posting in that thread the moderator announced that mod Abandoned :cry:

Bramster.
Registered User
Posts: 151
Joined: Thu Mar 04, 2010 7:42 am

Re: Too many attachements in file directory

Post by Bramster. » Fri Mar 18, 2011 7:00 pm

No one ? :-(

I guess this is one of the limitations of phpbb ?

But I am still confident that there is a fix out there somewhere.

User avatar
KevC
Support Team Member
Support Team Member
Posts: 69299
Joined: Fri Jun 04, 2004 10:44 am
Location: Oxford, UK
Contact:

Re: Too many attachements in file directory

Post by KevC » Sat Mar 19, 2011 11:50 am

Either buy most hosting storage space or delete the oldest ones.
-:|:- Support Request Template -:|:-
Image
Cheap UK Hosting
"In the land of the blind the little green bloke with no pupils is king - init!"

User avatar
stevemaury
Support Team Member
Support Team Member
Posts: 50669
Joined: Thu Nov 02, 2006 12:21 am
Location: The U.P.
Name: Steve
Contact:

Re: Too many attachements in file directory

Post by stevemaury » Sat Mar 19, 2011 6:11 pm

No fix, because nothing is broken. That's how many attachments you have. Is there some phpBB issue here? Does you host have any particular reason for complaining? Is there some limit on the number of files in a folder? If so, it has nothing to do with phpBB.
For REALLY good and VERY inexpensive hosting CLICK HERE

I can stop all your spam. I can upgrade or update your Board. PM or email me. (Paid support)

Bramster.
Registered User
Posts: 151
Joined: Thu Mar 04, 2010 7:42 am

Re: Too many attachements in file directory

Post by Bramster. » Sat Mar 19, 2011 8:30 pm

Thank you all for your replies.

> Either buy most hosting storage space or delete the oldest ones.

I have enough hosting space. The host has a problem with one directory holding over 80000 files.

Deleting files is not an option of course.

I was hoping there would be a fix or mod that enabled me to use a different directory for each month for example, so that there would not too (according to my host) many files in one directory.

> No fix, because nothing is broken. That's how many attachments you have.

I was not asking to fix a broken thing I was hoping for a fix to the problem.

> Is there some limit on the number of files in a folder? If so, it has nothing to do with phpBB.

Of course it has to do with phpbb. Afterall that software put all the files in one directory. Too bad it does not spread the files over more directories.

Or is my problem the sign of a bad hosting provider ?

User avatar
stevemaury
Support Team Member
Support Team Member
Posts: 50669
Joined: Thu Nov 02, 2006 12:21 am
Location: The U.P.
Name: Steve
Contact:

Re: Too many attachements in file directory

Post by stevemaury » Sun Mar 20, 2011 1:33 am

Yes, you have a hosting problem There is no reason why two folders with 40,000 files each are any better than one with 80,000 files.
For REALLY good and VERY inexpensive hosting CLICK HERE

I can stop all your spam. I can upgrade or update your Board. PM or email me. (Paid support)

Bramster.
Registered User
Posts: 151
Joined: Thu Mar 04, 2010 7:42 am

Re: Too many attachements in file directory

Post by Bramster. » Wed Mar 30, 2011 7:50 pm

I was informed that the lower the number of files the lower the access time

User avatar
D¡cky
Former Team Member
Posts: 11812
Joined: Tue Jan 25, 2005 8:38 pm
Location: New Hampshire, USA
Name: Richard Foote
Contact:

Re: Too many attachements in file directory

Post by D¡cky » Thu Mar 31, 2011 5:40 am

The number of files has no affect as far as your board is concerned. If your host has a backup process in place, the number of files will slow down the backups. Another problem that having so many files in one directory is that some FTP programs will handle only 2000 files at a time, so you could be in trouble if you were to make a backup yourself of the attachment directory.

I have a gallery running with 82,000+ images at a host and they told me I had to remove some of the images because the host has a limit of 15,000 files. It didn't take me long to move to a different host.

There is a MOD to have attachments on a remote server, but I don't believe it will help with the attachments you presently have. I believe there has also been talk of allowing attachments in multiple directories, but I don't think anything ever came of it.

I don't know of any solution to your present problem other than to move or ask your present host if they have a plan that will allow you to have 80,000+ files.
Have you hugged someone today?

Bramster.
Registered User
Posts: 151
Joined: Thu Mar 04, 2010 7:42 am

Re: Too many attachements in file directory

Post by Bramster. » Thu Mar 31, 2011 8:50 am

Thanks for your response, FTP was indeed a problem, only 5000 where listed. But the host fixed that.

At the moment the host accepts it but is not happy about it.

My previous host never complained about this situation, unfortunately he closed up shop so I had nop choice but to move.

I surely hope the next phpbb version will address this problem.

Bramster.
Registered User
Posts: 151
Joined: Thu Mar 04, 2010 7:42 am

Re: Too many attachements in file directory

Post by Bramster. » Sat Aug 18, 2012 1:25 pm

The number of files has reached 100 000 and I am battling with the hosting provider again. He stated that so many files in one folder is "not done" and that several standard Linux statements have trouble with this number of files.

Any one knows of any recent phpbb mod solution, or are my only options changing host / convincing the host to raise the limit ?

User avatar
D¡cky
Former Team Member
Posts: 11812
Joined: Tue Jan 25, 2005 8:38 pm
Location: New Hampshire, USA
Name: Richard Foote
Contact:

Re: Too many attachements in file directory

Post by D¡cky » Sat Aug 18, 2012 2:22 pm

There is a ticket with links to discussion topics and a link to a MOD which adds this feature to your board, Split attachments directory into subdirectories
Have you hugged someone today?

User avatar
Oyabun1
Former Team Member
Posts: 23162
Joined: Sun May 17, 2009 1:05 pm
Location: Australia
Name: Bill

Re: Too many attachements in file directory

Post by Oyabun1 » Sat Aug 18, 2012 10:08 pm

There is a MOD in development, [RC] Attachments in subfolders. Because it's not validated we can't say if it works or not but a number of users seem to have had success with it.
                      Support Request Template
3.0.x: Knowledge Base Styles Support MOD Requests
3.1.x: Knowledge BaseStyles SupportExtension Requests

wile
Registered User
Posts: 57
Joined: Mon Apr 30, 2007 4:21 pm

Re: Too many attachements in file directory

Post by wile » Wed Dec 18, 2013 12:23 pm

I expect that phpBB should solve this issue.

Using MOD is not a good solution as logic how attachments are structured is pretty important also from future updates point of view. If I make custom rule how files are stored it can later cause me issues with missing or incorrectly linked attachments.

Other solutions are :
- changing hosting
- changing forum software

User avatar
Lumpy Burgertushie
Registered User
Posts: 66569
Joined: Mon May 02, 2005 3:11 am
Contact:

Re: Too many attachements in file directory

Post by Lumpy Burgertushie » Wed Dec 18, 2013 3:14 pm

I would think that if this was a problem with phpbb that it would show up for more than just a few of the very many users with large boards. This is simply not an issue with a host that knows what they are doing. I doubt that any other bulletin board sofware of even blogs spread their avatars/attachments etc. around to multiple directories on the server.

find a better host, it is just that simple.


robert
I'm baaaaaccckkkk. still doing work on donation basis. PM your needs.

Premium phpBB 3.2 Styles by PlanetStyles.net

If a tree falls in the forest and nobody is there, does it make a sound?

Locked

Return to “[3.0.x] Support Forum”