[digikam] [Bug 368468] New: digiKam hanging at start up with a collection that has >100000 sub folders

classic Classic list List threaded Threaded
14 messages Options
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] New: digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

            Bug ID: 368468
           Summary: digiKam hanging at start up with a collection that has
                    >100000 sub folders
           Product: digikam
           Version: 5.2.0
          Platform: Compiled Sources
                OS: Linux
            Status: UNCONFIRMED
          Severity: crash
          Priority: NOR
         Component: AlbumsView
          Assignee: [hidden email]
          Reporter: [hidden email]

digiKam will scan the collection for pictures but it hangs when trying to
display the actual collection tree in the album view.

Reproducible: Always

Steps to Reproduce:
1. Remove all sqlite databases
2. Create a new root collection somewhere.
3. Create the huge hierarchy inside with this little script :

for ((i=1;i<=110000;i++)); do mkdir -p testdir/$i; done

4. Start digiKam in a console through GDB and setup root local collection to
the root dir of huge hierarchy.

Actual Results:  
digiKam will scan the collection for pictures but it hangs when trying to
display the actual collection tree in the album view.

Expected Results:  
The collection tree (ie the sub folders) should be visualised.

Problem became apparent when adding a directory that contained an OSX Photos
library. Logging showed it actually scans and finds all the images but hangs
after the discovery process, at that point it's trying to create the album tree
but does not complete.

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email],
                   |                            |[hidden email]

--- Comment #1 from [hidden email] ---
Originally, this problem have been discovered under OSX.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #2 from Maik Qualmann <[hidden email]> ---
Git commit 38c411cfe17cbc0746151594f889be1363a1023b by Maik Qualmann.
Committed on 26/09/2016 at 17:58.
Pushed by mqualmann into branch 'master'.

optimization ModelCompleter and AlbumWatch

M  +1    -4    libs/album/albumwatch.cpp
M  +36   -38   libs/widgets/common/modelcompleter.cpp
M  +1    -2    libs/widgets/common/modelcompleter.h

http://commits.kde.org/digikam/38c411cfe17cbc0746151594f889be1363a1023b

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #3 from Maik Qualmann <[hidden email]> ---
This commit reduce the loading from albums at me from 6:00 minutes to 1:30
minutes at 10.000 albums.

Maik

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #4 from [hidden email] ---
Lars,

A feedback from you using current code from git/master, including Maik patch
will be appreciate.

Thanks in advance

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #5 from Lars Van Casteren <[hidden email]> ---
Thanks for the effort.
I am on a (backpack) holiday until 27/10 but i'll try my best to test it
somewhere in between.

Lars

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #6 from Maik Qualmann <[hidden email]> ---
Git commit 4ebe5585c7f9c37842c541304cdd0e63912c7cb8 by Maik Qualmann.
Committed on 27/09/2016 at 20:34.
Pushed by mqualmann into branch 'master'.

optimization ImageAlbumFilterModel

M  +55   -13   libs/models/imagealbumfiltermodel.cpp
M  +5    -0    libs/models/imagealbumfiltermodel.h

http://commits.kde.org/digikam/4ebe5585c7f9c37842c541304cdd0e63912c7cb8

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #7 from Maik Qualmann <[hidden email]> ---
Now here less than 1 minute for 10.000 albums. But I think 100.000 albums are
not really to handle.

Maik

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #8 from [hidden email] ---
Lars,

Can you review last commits from Maik using current 5.3.0 AppImage bundle for
Linux ?

https://drive.google.com/open?id=0BzeiVr-byqt5Y0tIRWVWelRJenM

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #9 from [hidden email] ---
Lars,

Any feedback with current AppImage bundle for Linux ?

https://drive.google.com/drive/folders/0BzeiVr-byqt5Y0tIRWVWelRJenM

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|AlbumsView                  |Database-Scan

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #10 from [hidden email] ---
new 5.6.0 pre-release as bundle is available here :

https://drive.google.com/drive/folders/0BzeiVr-byqt5Y0tIRWVWelRJenM

Please check if this problem still reproducible with these versions.

Thanks in advance

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #11 from [hidden email] ---
digiKam 5.6.0 is now released and available as bundle for Linux, MacOS and
Windows.

https://www.digikam.org/news/2017-06-21-5.6.0-release-announcement/

Can you check if problem still exists with this version ?

Thanks in advance

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 368468] digiKam hanging at start up with a collection that has >100000 sub folders

bugzilla_noreply
In reply to this post by bugzilla_noreply
https://bugs.kde.org/show_bug.cgi?id=368468

--- Comment #12 from [hidden email] ---
New digiKam 5.7.0 are built with current implementation as pre-release bundles:

https://drive.google.com/drive/folders/0BzeiVr-byqt5Y0tIRWVWelRJenM

Problem still reproducible ?

--
You are receiving this mail because:
You are the assignee for the bug.