Import performance improvements?

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Ideas Centre
Post Reply
urzh
Registered User
Posts: 395
Joined: Mon Aug 05, 2019 1:51 pm
Name: Robert

Import performance improvements?

Post by urzh »

I know this goes beyond PHPBB support, but wondering if some others ran into this and know of an easy solution..

I have an ACP script copying posts to a new PHPBB board I have. It's doing so through an ACP extension. The import started out very fast (100's of posts in a few seconds, and now is up to 140,000 posts and importing around 5 posts a minute.

Running MySQL(i) 5.7.32

MY.CNF:
log_timestamps = SYSTEM
explicit_defaults_for_timestamp = 1
table_open_cache = 500
max_connections = 300
interactive_timeout = 300
wait_timeout = 300
innodb_buffer_pool_size= 48M


What can I quickly or change in MySQL (my.cnf) to drastically improve performance? I am MySQL on running 12-Core Intel with 64GB Ram.

Or, is this an issue with PHP perhaps? Running PHP v 7.4.12

PHP.INI:
memory_limit = 512M
max_input_time = 300
max_execution_time = 300
post_max_size = 50M
upload_max_filesize = 82M
User avatar
Mick
Support Team Member
Support Team Member
Posts: 26503
Joined: Fri Aug 29, 2008 9:49 am

Re: Import performance improvements?

Post by Mick »

Which extension?
  • "The more connected we get the more alone we become" - Kyle Broflovski©
  • "The good news is hell is just the product of a morbid human imagination.
    The bad news is, whatever humans can imagine, they can usually create.
    " - Harmony Cobel
User avatar
AmigoJack
Registered User
Posts: 6108
Joined: Tue Jun 15, 2010 11:33 am
Location: グリーン ヒル ゾーン
Contact:

Re: Import performance improvements?

Post by AmigoJack »

urzh wrote: Sat May 14, 2022 7:39 pmMySQL(i) 5.7.32
That's the driver, not your actual DBMS.
  • "The problem is probably not my English but you do not want to understand correctly. ... We will not come anybody anyway, nevertheless, it's best to shit this." Affin, 2018-11-20
  • "But this shit is not here for you. You can follow with your. Maybe the question, instead, was for you, who know, so you shoved us how you are." axe70, 2020-10-10
  • "My reaction is not to everyone, especially to you." Raptiye, 2021-02-28
User avatar
Dog Cow
Registered User
Posts: 2507
Joined: Fri Jan 28, 2005 12:14 am
Contact:

Re: Import performance improvements?

Post by Dog Cow »

AmigoJack wrote: Mon May 16, 2022 6:54 am
urzh wrote: Sat May 14, 2022 7:39 pmMySQL(i) 5.7.32
That's the driver, not your actual DBMS.
It's pretty safe to say that the driver indicates his actual DBMS. :?
User avatar
AmigoJack
Registered User
Posts: 6108
Joined: Tue Jun 15, 2010 11:33 am
Location: グリーン ヒル ゾーン
Contact:

Re: Import performance improvements?

Post by AmigoJack »

Dog Cow wrote: Mon May 16, 2022 3:01 pm :?
No, it could still be MariaDB with different support than MySQL, especially on recent versions. It's like telling/knowing the difference between Unicode and UTF-8.
  • "The problem is probably not my English but you do not want to understand correctly. ... We will not come anybody anyway, nevertheless, it's best to shit this." Affin, 2018-11-20
  • "But this shit is not here for you. You can follow with your. Maybe the question, instead, was for you, who know, so you shoved us how you are." axe70, 2020-10-10
  • "My reaction is not to everyone, especially to you." Raptiye, 2021-02-28
User avatar
Steve
Registered User
Posts: 1480
Joined: Tue Apr 07, 2009 7:48 pm
Name: Steven Clark
Contact:

Re: Import performance improvements?

Post by Steve »

It’s not you have MariaDB and MySQL in the same groups, The collation can be different.
@ The Chief Medical Officers guideline for men is that: You are safest not to drink regularly more than 14 units per week.
- I drank that today++ :lol: 🍺
Post Reply

Return to “phpBB Discussion”