[digikam] [Bug 325653] New: database migration is very slow

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 325653] New: database migration is very slow

Thomas Bleher
https://bugs.kde.org/show_bug.cgi?id=325653

            Bug ID: 325653
           Summary: database migration is very slow
    Classification: Unclassified
           Product: digikam
           Version: 3.3.0
          Platform: unspecified
                OS: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: NOR
         Component: Database
          Assignee: [hidden email]
          Reporter: [hidden email]

I recently wanted to migrate my digikam database from MySQL to SQLite. However,
the database migration is extremely slow. top(1) reported that the digikam
process consumed more than 1700 minutes for the migration. At 90,000 pictures,
that is more than one second per picture! The resulting database is 150MB
large, so this is a throughput of 1.5kB/s. This is on a two-core Intel Celeron
CPU 847 @ 1.10GHz with 4GB of RAM and a local MySQL database.
Clearly this could be optimized a lot. A mysqldump of the original database
finishes in less than 8 seconds!

Peeking at the process with a debugger, it seems that most of the time is spent
in the Qt event loop. Maybe the progress bar is repainted for every row in the
database?

Reproducible: Always

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 325653] MIGRATION : database conversion is very slow

Gilles Caulier-4
https://bugs.kde.org/show_bug.cgi?id=325653

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]
            Summary|database migration is very  |MIGRATION : database
                   |slow                        |conversion is very slow

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 325653] MIGRATION : database conversion is very slow

Gilles Caulier-4
In reply to this post by Thomas Bleher
https://bugs.kde.org/show_bug.cgi?id=325653

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|Database                    |Database-Migration

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 325653] MIGRATION : database conversion is very slow

bugzilla_noreply
In reply to this post by Thomas Bleher
https://bugs.kde.org/show_bug.cgi?id=325653

--- Comment #1 from [hidden email] ---
This file still valid using last digiKam 5.0.0 ?

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 325653] MIGRATION : database conversion is very slow

bugzilla_noreply
In reply to this post by Thomas Bleher
https://bugs.kde.org/show_bug.cgi?id=325653

--- Comment #2 from Thomas Bleher <[hidden email]> ---
Sorry, at the moment I don't have time to update to digiKam 5.0.0 and set up
appropriate tests (still on digiKam 4.9.0).

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 325653] MIGRATION : database conversion is very slow

bugzilla_noreply
In reply to this post by Thomas Bleher
https://bugs.kde.org/show_bug.cgi?id=325653

--- Comment #3 from [hidden email] ---
And with 4.9.0, the problem is reproducible ?

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 325653] MIGRATION : database conversion is very slow

bugzilla_noreply
In reply to this post by Thomas Bleher
https://bugs.kde.org/show_bug.cgi?id=325653

--- Comment #4 from [hidden email] ---
Can you reproduce the problem using digiKam Linux AppImage bundle ? The last
bundle is available at this url:

https://drive.google.com/drive/folders/0BzeiVr-byqt5Y0tIRWVWelRJenM

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.