[Bug 216145] New: Infinite Loop when scanning large folders

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[Bug 216145] New: Infinite Loop when scanning large folders

Bugzilla from kde-bugzilla@dharty.com
https://bugs.kde.org/show_bug.cgi?id=216145

           Summary: Infinite Loop when scanning large folders
           Product: digikam
           Version: unspecified
          Platform: Gentoo Packages
        OS/Version: Linux
            Status: UNCONFIRMED
          Severity: crash
          Priority: NOR
         Component: general
        AssignedTo: [hidden email]
        ReportedBy: [hidden email]


Version:           digikam-0.10.0-r1 (using KDE 4.3.3)
OS:                Linux
Installed from:    Gentoo Packages

A user was having problems (unrelated to digikam) with her KDE4.3.3 plasma
workspace.  We had recently upgraded the systems from kde3.5.  I moved her
.kde4 directory to a backup location and logged her in again.  This fixed the
desktop problems we were having but of course all of her previous [application]
settings had to be redone.

We started digikam and pointed it at her "Pictures" directory.  
The users "Pictures" folder had a link to a network drive with 19G of images in
it: eg

./Pictures (digikam images folder)
    digikamdb.4 (200M+)
    SomeLocalFolders
    LinkToNetworkFolder (19G)


The digikam dialog said it was scanning images in the folders.  This went on
for hours.  I noticed the digikam4.db file was reaching several hundred
megabytes in size.  Eventually the information at the bootom of this message
started coming out slowly.  I let it run for a while until I noticed the
message sets repeating (after about 257 messages) at which point I killed the
process.

As mentioned earlier the users "Pictures" folder had a link to a network drive
with 19G of images in it: eg

./Pictures (digikam images folder)
    digikamdb.4 (200M+)
    SomeLocalFolders
    LinkToNetworkFolder (19G)

When I removed the link, the program was able to start correctly, and the
digikamdb.4 file returned to a sane size (279k).

There are other users on the network with access to the same network folder in
a setup similar to the structure listed above (and same KDE and digikam
versions).  Their .db files are on the order of 5M or so.

This particular users digikam had been working fine previously.  I tried
replacing her ./share/apps/digikam and ./share/config/digikamrc with files from
her original .kde4 directory to see if it helped, but the same errors occurred.

Below is the repeating section of output created by digikam while "Scanning the
folders".  I have removed some [200] of the repeating lines and added some
comments inside brackets < like this >:

Note
------------------ output ------------------------
$digikam

<pause of several minutes while dialog indicates folders are being scanned >

Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored.
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.  
Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored.
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.

< there is no OlympusCs directory in any of the images folders >
< this message repeats some 200 times >

Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored.
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.  
Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored.
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.  
libpng warning: zTXt: CRC error
libpng warning: zTXt: CRC error
libpng warning: zTXt: CRC error
libpng warning: zTXt: CRC error
Warning: XMP toolkit support not compiled in.
Warning: Failed to decode XMP metadata.
Warning: XMP toolkit support not compiled in.
Warning: Failed to decode XMP metadata.
Warning: XMP toolkit support not compiled in.
Warning: Failed to decode XMP metadata.
Warning: XMP toolkit support not compiled in.
Warning: Failed to decode XMP metadata.
Warning: XMP toolkit support not compiled in.
Warning: Failed to decode XMP metadata.
Warning: Directory NikonPreview, entry 0x0201: Data area exceeds data buffer,
ignoring it.
Error: Directory NikonPreview with 2020 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory Sony with 1c00 entries considered invalid; not read.
Error: Directory NikonPreview with 2020 entries considered invalid; not read.
Warning: Directory NikonPreview, entry 0x0201: Data area exceeds data buffer,
ignoring it.
Error: Directory NikonPreview with 2020 entries considered invalid; not read.
Error: Directory NikonPreview with 2020 entries considered invalid; not read.
Warning: Directory NikonPreview, entry 0x0201: Data area exceeds data buffer,
ignoring it.
Warning: Directory NikonPreview, entry 0x0201: Data area exceeds data buffer,
ignoring it.
Warning: XMP toolkit support not compiled in.
Warning: Failed to decode XMP metadata.
Warning: XMP toolkit support not compiled in.
Warning: Failed to decode XMP metadata.

< then the process starts over again >

Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored.
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.  

< ... >


------------------end output ---------------------

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 216145] Infinite Loop when scanning large folders

Gilles Caulier-4
https://bugs.kde.org/show_bug.cgi?id=216145


Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|general                     |Metadata




--- Comment #1 from Gilles Caulier <caulier gilles gmail com>  2009-11-25 21:05:40 ---
Sound like a problem with your Exiv2 which hasn't compiled with XMP support...

Gilles Caulier

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 216145] Infinite Loop when scanning large folders

Marcel Wiesweg
In reply to this post by Bugzilla from kde-bugzilla@dharty.com
https://bugs.kde.org/show_bug.cgi?id=216145


Marcel Wiesweg <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]




--- Comment #2 from Marcel Wiesweg <marcel wiesweg gmx de>  2009-11-25 22:42:12 ---
The error messages do not explain any underlying problem leading to an endless
loop. Nonetheless, I would recommend to update digikam to recent 1.0 beta and
libexiv2 to version 0.18.2. Switch on debug message for digikam (kdebugdialog,
code 50003) - usually you see on the console which files are currently scanned,
and if there is a loop.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 216145] Infinite Loop when scanning large folders

Gilles Caulier-4
In reply to this post by Bugzilla from kde-bugzilla@dharty.com
https://bugs.kde.org/show_bug.cgi?id=216145





--- Comment #3 from Gilles Caulier <caulier gilles gmail com>  2009-12-25 20:13:54 ---
digiKam 1.0.0 is out since few days...

http://www.digikam.org/drupal/node/491

Please try with this version coming with more than 400 bug-fixes.

Thanks in advance

Gilles Caulier

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 216145] Infinite Loop when scanning large folders

Gilles Caulier-4
In reply to this post by Bugzilla from kde-bugzilla@dharty.com
https://bugs.kde.org/show_bug.cgi?id=216145





--- Comment #4 from Gilles Caulier <caulier gilles gmail com>  2010-01-25 21:51:06 ---
digiKam 1.1. release will be done in few days. Please check if this entry still
valid.

Thanks in advance

Gilles Caulier

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 216145] Infinite Loop when scanning large folders

Gilles Caulier-4
In reply to this post by Bugzilla from kde-bugzilla@dharty.com
https://bugs.kde.org/show_bug.cgi?id=216145





--- Comment #5 from Gilles Caulier <caulier gilles gmail com>  2010-04-04 10:45:03 ---
digiKam and Kipi-plugins 1.2.0 are out. Please check if crash is still valid
there.

Thanks in advance

Gilles Caulier

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 216145] Infinite Loop when scanning large folders

Gilles Caulier-4
In reply to this post by Bugzilla from kde-bugzilla@dharty.com
https://bugs.kde.org/show_bug.cgi?id=216145


Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|unspecified                 |0.10.0




--- Comment #6 from Gilles Caulier <caulier gilles gmail com>  2010-06-07 10:17:23 ---
No report there from user since a long time. Please try again with digiKam and
kipi-plugins 1.2.0, else i will close this file...

Gilles Caulier

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[Bug 216145] Infinite Loop when scanning large folders

Gilles Caulier-4
In reply to this post by Bugzilla from kde-bugzilla@dharty.com
https://bugs.kde.org/show_bug.cgi?id=216145


Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |NEEDSINFO
                 CC|                            |[hidden email]
         Resolution|                            |FIXED




--- Comment #7 from Gilles Caulier <caulier gilles gmail com>  2010-06-07 14:40:56 ---
We need user feedback there to continue...

Gilles Caulier

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel