[Bug 178325] New: Rebuild all thumbnails consumes large amounts of memory when processing at the end

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

[Bug 178325] New: Rebuild all thumbnails consumes large amounts of memory when processing at the end

Marcus D. Hanwell
http://bugs.kde.org/show_bug.cgi?id=178325

           Summary: Rebuild all thumbnails consumes large amounts of memory
                    when processing at the end
           Product: digikam
           Version: unspecified
          Platform: Compiled Sources
        OS/Version: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: NOR
         Component: general
        AssignedTo: [hidden email]
        ReportedBy: [hidden email]


Version:           0.10.0_beta6 (using Devel)
Compiler:          GNU GCC 4.3.2
OS:                Linux
Installed from:    Compiled sources

I tried rebuilding all thumbnails on my photo collection today. It took quite a
long time and didn't seem to use both cores, but the main issue was right at
the end when progress was 100%. It said "Processing..." and consumed more and
more memory as I waited for it to complete. It got to the stage where it was
causing large amounts of swapping and the system became very unresponsive.

I had to kill digikam in order to regain control of my desktop session. When I
restarted digikam it seems like the thumbnails I built have been kept as
thumbnails are shown very quickly. I haven't looked at the relevant code yet
but I assume it was collecting the thumbnails up in some way. I am comfortable
with C++, Qt and KDE programming and would be happy to help debug this issue if
you have any ideas of where to start. I assume it is caused by the size of my
image collection and so debugging would require hours to get to that point
again.

My system is an AMD Athlon X2 dual core, 2GB of RAM and the photos reside on an
ext3 RAID5 partition. The thumbs were being generated on a separate partition
(/home/myuser/Pictures) where the photos have their own partition
(/home/photos). The photo partition has 74GB of used space, mixture of JPEG,
NEF and a few AVIs. I will upgrade to the latest beta to check if that helps at
all.

New digikam is looking great already. Thanks.


--
Configure bugmail: http://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 178325] Rebuild all thumbnails consumes large amounts of memory when processing at the end

Marcus D. Hanwell
http://bugs.kde.org/show_bug.cgi?id=178325





--- Comment #1 from Marcus D. Hanwell <marcus cryos org>  2008-12-21 02:15:01 ---
I wanted to confirm that after upgrading to 0.10.0_beta7 I observed the same
issue. Out of control memory consumption on the processing step. Sat at 100%,
it appears to process the same image over and over again - only one file name
in view. It is difficult to diagnose further as my system becomes extremely
unresponsive as it swaps madly.


--
Configure bugmail: http://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 178325] Rebuild all thumbnails consumes large amounts of memory when processing at the end

Gilles Caulier-4
In reply to this post by Marcus D. Hanwell
http://bugs.kde.org/show_bug.cgi?id=178325


Gilles Caulier caulier gilles gmail com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|general                     |Thumbnails
            Version|unspecified                 |0.10.0-beta6




--
Configure bugmail: http://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 178325] Rebuild all thumbnails consumes large amounts of memory when processing at the end

Marcel Wiesweg
In reply to this post by Marcus D. Hanwell
http://bugs.kde.org/show_bug.cgi?id=178325





--- Comment #2 from Marcel Wiesweg <marcel wiesweg gmx de>  2008-12-21 16:21:37 ---
SVN commit 899774 by mwiesweg:

Ensure that the thumbnail that is announced is really the next in our list.
Only in this case remove from list and advance.

CCBUG: 178325

 M  +4 -1      batchthumbsgenerator.cpp  


WebSVN link: http://websvn.kde.org/?view=rev&revision=899774


--
Configure bugmail: http://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 178325] Rebuild all thumbnails consumes large amounts of memory when processing at the end

Marcel Wiesweg
In reply to this post by Marcus D. Hanwell
http://bugs.kde.org/show_bug.cgi?id=178325


Marcel Wiesweg marcel wiesweg gmx de changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]




--- Comment #3 from Marcel Wiesweg <marcel wiesweg gmx de>  2008-12-21 16:24:43 ---
I have found a possible problem resulting in an endless loop. Please check
again if this fixes a problem.

If you feel that you are again getting to your endless loop, find out the PID
of digikam, and attach gdb with the command "gdb att <PID>". If you get out of
memory before, it may be necessary to run digikam directly under gdb and
interrupt with Ctrl+C.


--
Configure bugmail: http://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 178325] Rebuild all thumbnails consumes large amounts of memory when processing at the end

Marcus D. Hanwell
In reply to this post by Marcus D. Hanwell
http://bugs.kde.org/show_bug.cgi?id=178325





--- Comment #4 from Marcus D. Hanwell <marcus cryos org>  2008-12-23 22:15:02 ---
Looks like you fixed it, thank you. I checked with current SVN head and it is
indeed working. Completed in 2:33 with no errors. Thanks for getting to this so
quickly. I will try to keep an eye on head from now on. Thanks.


--
Configure bugmail: http://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 178325] Rebuild all thumbnails consumes large amounts of memory when processing at the end

Gilles Caulier-4
In reply to this post by Marcus D. Hanwell
http://bugs.kde.org/show_bug.cgi?id=178325


Gilles Caulier caulier gilles gmail com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
         Resolution|                            |FIXED




--- Comment #5 from Gilles Caulier <caulier gilles gmail com>  2008-12-23 22:21:43 ---
Thanks Marcus for feedback

I close this file now.

Gilles Caulier


--
Configure bugmail: http://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 178325] Rebuild all thumbnails consumes large amounts of memory when processing at the end

Gilles Caulier-4
In reply to this post by Marcus D. Hanwell
https://bugs.kde.org/show_bug.cgi?id=178325


Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|0.10.0-beta6                |0.10.0




--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 178325] Rebuild all thumbnails consumes large amounts of memory when processing at the end

bugzilla_noreply
In reply to this post by Marcus D. Hanwell
https://bugs.kde.org/show_bug.cgi?id=178325

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|Thumbs-Image                |Thumbs-Engine
                 CC|                            |[hidden email]

--
You are receiving this mail because:
You are the assignee for the bug.