[digikam] [Bug 372650] New: When tagging multiple images a few sidecars get truncated, on OS X.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

            Bug ID: 372650
           Summary: When tagging multiple images a few sidecars get
                    truncated, on OS X.
           Product: digikam
           Version: 5.3.0
          Platform: Mac OS X Disk Images
                OS: OS X
            Status: UNCONFIRMED
          Severity: normal
          Priority: NOR
         Component: Tags
          Assignee: [hidden email]
          Reporter: [hidden email]
  Target Milestone: ---

Digikam is configured to write to sidecars only.
Select multiple images, e.g. about 100.
Apply the same tag to all of them, using the Captions pane.
For most images the sidecars are updated correctly, but for a few of them the
sidecars are truncated to just their first line. This affects a different
subset of files each time a tag is applied, apparently at random.
The console output shows most sidecars being written without error messages,
while for the few files concerned it shows:

digikam.metaengine: Exiv2 ( 3 ) :  XMP Toolkit error 101: Unregistered schema
namespace URI
digikam.metaengine: Exiv2 ( 3 ) :  Failed to encode XMP metadata.

This behaviour happens on OS X.
Running under linux (ubuntu) in a virtual machine I do NOT see the same
problem.

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|Tags                        |Metadata-Sidecar
                 CC|                            |[hidden email]

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #1 from Philip Tuckey <[hidden email]> ---
This problem also occurs when writing metadata to the image files. To test
this, I changed the digikam preferences to not use sidecars. The test images
are jpegs and I am writing just one tag to them, "print". The console shows a
few error messages the same as in the initial report, and for a few files the
metadata is NOT written. Again, this is running on OS X, updated to Sierra (the
initial report was under El Capitan).

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #2 from [hidden email] ---
I build a new version of OSX installer for next release 5.4.0, using Exiv2
shared lib 0.26-svn not yet released, but including more than 200 bugfixes. It
will be interesting to see if this file still reproducible.

The OSX installer is available here :

https://drive.google.com/drive/folders/0BzeiVr-byqt5Y0tIRWVWelRJenM

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

Philip Tuckey <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|When tagging multiple       |On OS X, when tagging
                   |images a few sidecars get   |multiple images metadata is
                   |truncated, on OS X.         |not correctly written to
                   |                            |some image files or
                   |                            |sidecars.

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

Philip Tuckey <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|Metadata-Sidecar            |Metadata

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #3 from Philip Tuckey <[hidden email]> ---
Thank you for doing that Gilles. I have tested the new version and the
behaviour is the same: occasional errors in writing metadata to image files or
sidecars, when updating many images at once. (I updated the bug title and
component to be more precise.)
Another way to trigger the problem is "Album->Write Metadata to Images", which
is consistent since it rewrites the metadata of all images, and unfortunate as
one wants to use this menu item to clean up the metadata.
This does not seem to be a "straightforward" bug in Exiv2, as the problem does
not occur under linux, it is specific to OS X. The apparently random occurrence
may suggest some kind of overflow error. Is the bug necessarily in Exiv2, could
it be in digikam?

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|5.3.0                       |5.4.0

--- Comment #4 from [hidden email] ---
This is a good question.

The DK implementation is a high level wrapper to preapre metadata to write a
good place. It's Qt code, mostly portable as well..

Al low level operations are managed at end by Exiv2. If the problem become on
access to files, well, this can be an Exiv2 dysfunction.

To investiguate, if you are able to reproduce the problem easily, is to run DK
from a console. The binary is :

/opt/digikam/Applications/KF5/digikam.app/Contents/MacOS/digikam

Just run it and catch all the debug statements printed on the console when
problem occurs.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #5 from Philip Tuckey <[hidden email]> ---
I gave the console error messages in the initial description, but I will upload
a full console log asap. It seems to me that those error messages don't tell us
whether the problem is a bug in Exiv2, or if digikam is providing bad data to
Exiv2 (only occasionally of course). We would need digikam to print out the
data each time it calls Exiv2.

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #6 from Philip Tuckey <[hidden email]> ---
I have run a couple of examples using 100 copies of the same jpg image, i.e.
$ for i in {0..99}; do cp image.jpg test/image$i.jpg; done
I will upload relevant files following this message.

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #7 from Philip Tuckey <[hidden email]> ---
Created attachment 103079
  --> https://bugs.kde.org/attachment.cgi?id=103079&action=edit
Console log showing metadata writing to image files.

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #8 from Philip Tuckey <[hidden email]> ---
During that run, metadata was not correctly written to 7 images: image0.jpg, 3,
9, 12, 26, 38, 87. All others were written correctly.

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #9 from Philip Tuckey <[hidden email]> ---
Created attachment 103080
  --> https://bugs.kde.org/attachment.cgi?id=103080&action=edit
The original test image.

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #10 from Philip Tuckey <[hidden email]> ---
Created attachment 103081
  --> https://bugs.kde.org/attachment.cgi?id=103081&action=edit
image0.jpg - shows incomplete metadata

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #11 from Philip Tuckey <[hidden email]> ---
Created attachment 103082
  --> https://bugs.kde.org/attachment.cgi?id=103082&action=edit
image1.jpg - shows complete metadata

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #12 from Philip Tuckey <[hidden email]> ---
Created attachment 103083
  --> https://bugs.kde.org/attachment.cgi?id=103083&action=edit
Console log showing metadata writing to sidecars.

During this run, the sidecars for 5 images were truncated: image12.jpg, 24, 36,
76, 81. All the other sidecars were correctly written (as far as I can tell).

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #13 from Philip Tuckey <[hidden email]> ---
Created attachment 103084
  --> https://bugs.kde.org/attachment.cgi?id=103084&action=edit
image12.jpg.xmp - shows a truncated sidecar

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #14 from Philip Tuckey <[hidden email]> ---
Created attachment 103086
  --> https://bugs.kde.org/attachment.cgi?id=103086&action=edit
image0.jpg.xmp - example of a complete sidecar

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #15 from [hidden email] ---
Did you set a configuration to write comment to ACDSEE XMP namespace ?

digikam.metaengine: Will write Metadata to file
"/Users/test/Pictures/test/image0.jpg"
digikam.metaengine: xmlACDSee "<Categories><Category
Assigned=\"1\">blabla</Category></Categories>"
digikam.general: -------------------------- New Keywords ("blabla")

Gilles

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=372650

--- Comment #16 from Philip Tuckey <[hidden email]> ---
Not to my knowledge. I set up a test account and started up digikam with a

--
You are receiving this mail because:
You are the assignee for the bug.