Write Metadata takes long time

[Juergen-3]

Hallo.

I have the problem that it takes a long time for digikam to write
metadate into files.

Technical details are :

Suse 11.0

AMD : Linux linux-4qg7 2.6.25.20-0.6-default #1 SMP 2010-01-14 18:58:36
+0100 x86_64 x86_64 x86_64 GNU/Linux

KDE 3.5.9 "release 49.2"

Digikam : V 1.1.0 with KDE Version 4.4.0 release 224

So, back to my problem.

Downloading images from my kardreader takes much longer than it did in
previous versions. But, I can not tell you exact how long that is.

But, what makes the current version useless for me is that it takes so
long to write tags into my image files.

It almost an hour to write just one Tag : Special->Original to 111 images.

The images are JPG images taken with my "Nikon D90" and they are about 3
- 6 MB big.

For 12 Images to get one new tag added it took 3,44 minutes.

My settings regarding metadata are :

Rotate preview images according exif information
Set exif information to normal after rotation
Save image tags as "Keywords" tags embedded in metadata in files
Save image captions in metadata in files
Save image timestamp in metadata in files.

--
Greetings

Jürgen Flosbach

e-mail : [hidden email]
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Brice Boyer-2]

2010/2/19 Juergen <[hidden email]>

Hallo.

I have the problem that it takes a long time for digikam to write
metadate into files.

Technical details are :

Suse 11.0

AMD : Linux linux-4qg7 2.6.25.20-0.6-default #1 SMP 2010-01-14 18:58:36
+0100 x86_64 x86_64 x86_64 GNU/Linux

KDE 3.5.9 "release 49.2"

Digikam : V 1.1.0 with KDE Version 4.4.0 release 224

So, back to my problem.

Downloading images from my kardreader takes much longer than it did in
previous versions. But, I can not tell you exact how long that is.

But, what makes the current version useless for me is that it takes so
long to write tags into my image files.

It almost an hour to write just one Tag : Special->Original to 111 images.

The images are JPG images taken with my "Nikon D90" and they are about 3
- 6 MB big.

For 12 Images to get one new tag added it took 3,44 minutes.

My settings regarding metadata are :

Rotate preview images according exif information
Set exif information to normal after rotation
Save image tags as "Keywords" tags embedded in metadata in files
Save image captions in metadata in files
Save image timestamp in metadata in files.

--
Greetings

Jürgen Flosbach

e-mail : [hidden email]
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

Hello.

I got the same "problem" (with my nikon files). That's exiv 0.19 fault. just go back to 0.18. (see #224094)
hope it helps.

--
                                                     Brice

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Gilles Caulier-4]

2010/2/19 Brice Boyer <[hidden email]>:

>
> 2010/2/19 Juergen <[hidden email]>
>>
>> Hallo.
>>
>> I have the problem that it takes a long time for digikam to write
>> metadate into files.
>>
>> Technical details are :
>>
>> Suse 11.0
>>
>> AMD : Linux linux-4qg7 2.6.25.20-0.6-default #1 SMP 2010-01-14 18:58:36
>> +0100 x86_64 x86_64 x86_64 GNU/Linux
>>
>> KDE 3.5.9 "release 49.2"
>>
>> Digikam : V 1.1.0 with KDE Version 4.4.0 release 224
>>
>> So, back to my problem.
>>
>> Downloading images from my kardreader takes much longer than it did in
>> previous versions. But, I can not tell you exact how long that is.
>>
>> But, what makes the current version useless for me is that it takes so
>> long to write tags into my image files.
>>
>> It almost an hour to write just one Tag : Special->Original to 111 images.
>>
>> The images are JPG images taken with my "Nikon D90" and they are about 3
>> - 6 MB big.
>>
>> For 12 Images to get one new tag added it took 3,44 minutes.
>>
>> My settings regarding metadata are :
>>
>> Rotate preview images according exif information
>> Set exif information to normal after rotation
>> Save image tags as "Keywords" tags embedded in metadata in files
>> Save image captions in metadata in files
>> Save image timestamp in metadata in files.
>>
>> --
>> Greetings
>>
>> Jürgen Flosbach
>>
>> e-mail : [hidden email]
>> _______________________________________________
>> Digikam-users mailing list
>> [hidden email]
>> https://mail.kde.org/mailman/listinfo/digikam-users
>
> Hello.
>
> I got the same "problem" (with my nikon files). That's exiv 0.19 fault. just
> go back to 0.18. (see #224094)
> hope it helps.

Please report this problem to Exiv2 bugzilla. Thanks

Gilles
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Juergen-3]

Am 19.02.2010 20:34, schrieb Brice Boyer:
>
> 2010/2/19 Juergen <[hidden email] <mailto:[hidden email]>>
>
>     Hallo.
>
>     I have the problem that it takes a long time for digikam to write
>     metadate into files.

<SNIP>

>     --
>     Greetings
>
>     Jürgen Flosbach
>
>     e-mail : [hidden email] <mailto:[hidden email]>
>     _______________________________________________
>     Digikam-users mailing list
>     [hidden email] <mailto:[hidden email]>
>     https://mail.kde.org/mailman/listinfo/digikam-users
>
>
> Hello.
>
> I got the same "problem" (with my nikon files). That's exiv 0.19 fault.
> just go back to 0.18. (see #224094)
> hope it helps.
>
> --

No. This didn't help in my case.

I changed back to exiv2 version 0.18 and there was no change,
I changed back to exiv2 version 0.16 and there was no change either.

What parts in the software are involved so that I can try going back
step bey step and see where the problem goes away?

What is for sure is that it has to do with writing metadata and,
probably with NINON metadata. Because, my daughter has a CANON Powershot
and metadata there are written in a flash.


--
Greetings

Jürgen Flosbach

e-mail : [hidden email]
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Johannes Wienke-3]

Am 20.02.2010 16:20 schrieb Juergen:

> Am 19.02.2010 20:34, schrieb Brice Boyer:
>>
>> 2010/2/19 Juergen <[hidden email] <mailto:[hidden email]>>
>>
>>     Hallo.
>>
>>     I have the problem that it takes a long time for digikam to write
>>     metadate into files.
>
>> I got the same "problem" (with my nikon files). That's exiv 0.19 fault.
>> just go back to 0.18. (see #224094)
>> hope it helps.
>>
>> --
>
> No. This didn't help in my case.
>
> I changed back to exiv2 version 0.18 and there was no change,
> I changed back to exiv2 version 0.16 and there was no change either.
>
> What parts in the software are involved so that I can try going back
> step bey step and see where the problem goes away?

Is the problem reproducible with the exiv2 command line?

Johannes.


_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Juergen-3]

Am 20.02.2010 16:22, schrieb Johannes Wienke:

> Am 20.02.2010 16:20 schrieb Juergen:
>> Am 19.02.2010 20:34, schrieb Brice Boyer:
>>>
>>> 2010/2/19 Juergen<[hidden email]<mailto:[hidden email]>>
>>>
>>>      Hallo.
>>>
>>>      I have the problem that it takes a long time for digikam to write
>>>      metadate into files.
>>
>>> I got the same "problem" (with my nikon files). That's exiv 0.19 fault.
>>> just go back to 0.18. (see #224094)
>>> hope it helps.
>>>
>>> --
>>
>> No. This didn't help in my case.
>>
>> I changed back to exiv2 version 0.18 and there was no change,
>> I changed back to exiv2 version 0.16 and there was no change either.
>>
>> What parts in the software are involved so that I can try going back
>> step bey step and see where the problem goes away?
>
> Is the problem reproducible with the exiv2 command line?

Do you know how the command goes ? I copied 20 Files taken with my D90
and with Tags in them into a test folder.

Before I write a new tag into them I tried to find the old ones. But I
couldn"t find them with exif2.

I saw them in the IPTC part but not in the exif part.

I also saw them with the prog "jhead".

First, before I write a new tag to this test files. How can I check on
the old ones in the exif section ?


--
Greetings

Jürgen Flosbach

e-mail : [hidden email]
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Johannes Wienke-3]

Am 21.02.2010 21:48 schrieb Juergen:

> Am 20.02.2010 16:22, schrieb Johannes Wienke:
>> Am 20.02.2010 16:20 schrieb Juergen:
>>> Am 19.02.2010 20:34, schrieb Brice Boyer:
>>>> 2010/2/19 Juergen<[hidden email]<mailto:[hidden email]>>
>>>>
>>>>      Hallo.
>>>>
>>>>      I have the problem that it takes a long time for digikam to write
>>>>      metadate into files.
>>>> I got the same "problem" (with my nikon files). That's exiv 0.19 fault.
>>>> just go back to 0.18. (see #224094)
>>>> hope it helps.
>>>>
>>>> --
>>> No. This didn't help in my case.
>>>
>>> I changed back to exiv2 version 0.18 and there was no change,
>>> I changed back to exiv2 version 0.16 and there was no change either.
>>>
>>> What parts in the software are involved so that I can try going back
>>> step bey step and see where the problem goes away?
>> Is the problem reproducible with the exiv2 command line?
>
> Do you know how the command goes ? I copied 20 Files taken with my D90
> and with Tags in them into a test folder.
>
> Before I write a new tag into them I tried to find the old ones. But I
> couldn"t find them with exif2.
>
> I saw them in the IPTC part but not in the exif part.
>
> I also saw them with the prog "jhead".
>
> First, before I write a new tag to this test files. How can I check on
> the old ones in the exif section ?

exiv2 -pa should print everything. but I would have too search through
the man page, too for more details.

Johannes



_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Juergen-3]

Am 20.02.2010 16:22, schrieb Johannes Wienke:

> Am 20.02.2010 16:20 schrieb Juergen:
>> Am 19.02.2010 20:34, schrieb Brice Boyer:
>>>
>>> 2010/2/19 Juergen<[hidden email]<mailto:[hidden email]>>
>>>
>>>      Hallo.
>>>
>>>      I have the problem that it takes a long time for digikam to write
>>>      metadate into files.
>>
>>> I got the same "problem" (with my nikon files). That's exiv 0.19 fault.
>>> just go back to 0.18. (see #224094)
>>> hope it helps.
>>>
>>> --
>>
>> No. This didn't help in my case.
>>
>> I changed back to exiv2 version 0.18 and there was no change,
>> I changed back to exiv2 version 0.16 and there was no change either.
>>
>> What parts in the software are involved so that I can try going back
>> step bey step and see where the problem goes away?
>
> Is the problem reproducible with the exiv2 command line?

No. The problem is not with exiv2 cmd line.

I have 155 D90 Test Images.

I wrote a comment to all files and this took 7.7sec
I added a Tag to the XMP part and this took 17.2sec


--
With regards

Juergen

e-mail : [hidden email]
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Johannes Wienke-3]

Am 22.02.2010 11:44 schrieb Juergen:

> Am 20.02.2010 16:22, schrieb Johannes Wienke:
>> Am 20.02.2010 16:20 schrieb Juergen:
>>> Am 19.02.2010 20:34, schrieb Brice Boyer:
>>>>
>>>> 2010/2/19 Juergen<[hidden email]<mailto:[hidden email]>>
>>>>
>>>>      Hallo.
>>>>
>>>>      I have the problem that it takes a long time for digikam to write
>>>>      metadate into files.
>>>
>>>> I got the same "problem" (with my nikon files). That's exiv 0.19 fault.
>>>> just go back to 0.18. (see #224094)
>>>> hope it helps.
>>>>
>>>> --
>>>
>>> No. This didn't help in my case.
>>>
>>> I changed back to exiv2 version 0.18 and there was no change,
>>> I changed back to exiv2 version 0.16 and there was no change either.
>>>
>>> What parts in the software are involved so that I can try going back
>>> step bey step and see where the problem goes away?
>>
>> Is the problem reproducible with the exiv2 command line?
>
> No. The problem is not with exiv2 cmd line.
>
> I have 155 D90 Test Images.
>
> I wrote a comment to all files and this took 7.7sec
> I added a Tag to the XMP part and this took 17.2sec

Please open a bug report at bugs.kde.org, again explaining exactly what
you did in digikam and on the command line and attach one or two image
files for testing.

Thanks,
Johannes



_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

What filesystem are you using? All barrier-enabled filesystems will be slow as
hell with sqlite3 or in general heavy disk usage.

Filesystems that will be 20times slower for example are:
EXT4 (barriers on)
XFS (barriers on)

If you are using one of the above FS, try disabling barriers:

EXT4:
mount -o defaults,rw,barrier=0,async,noatime,nodiratime

XFS:
mount -o defaults,rw,nobarrier,async,noatime,nodiratime,logbufs=8

Andi


On Friday 19 February 2010 14:20:10 Juergen wrote:

> Hallo.
>
> I have the problem that it takes a long time for digikam to write
> metadate into files.
>
> Technical details are :
>
> Suse 11.0
>
> AMD : Linux linux-4qg7 2.6.25.20-0.6-default #1 SMP 2010-01-14 18:58:36
> +0100 x86_64 x86_64 x86_64 GNU/Linux
>
> KDE 3.5.9 "release 49.2"
>
> Digikam : V 1.1.0 with KDE Version 4.4.0 release 224
>
> So, back to my problem.
>
> Downloading images from my kardreader takes much longer than it did in
> previous versions. But, I can not tell you exact how long that is.
>
> But, what makes the current version useless for me is that it takes so
> long to write tags into my image files.
>
> It almost an hour to write just one Tag : Special->Original to 111 images.
>
> The images are JPG images taken with my "Nikon D90" and they are about 3
> - 6 MB big.
>
> For 12 Images to get one new tag added it took 3,44 minutes.
>
> My settings regarding metadata are :
>
> Rotate preview images according exif information
> Set exif information to normal after rotation
> Save image tags as "Keywords" tags embedded in metadata in files
> Save image captions in metadata in files
> Save image timestamp in metadata in files.

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

The "20times slower" is only true for my hardware of course, no general
assumption... :-)


On Monday 22 February 2010 20:47:40 Andi Clemens wrote:

> What filesystem are you using? All barrier-enabled filesystems will be slow
> as hell with sqlite3 or in general heavy disk usage.
>
> Filesystems that will be 20times slower for example are:
> EXT4 (barriers on)
> XFS (barriers on)
>
> If you are using one of the above FS, try disabling barriers:
>
> EXT4:
> mount -o defaults,rw,barrier=0,async,noatime,nodiratime
>
> XFS:
> mount -o defaults,rw,nobarrier,async,noatime,nodiratime,logbufs=8
>
> Andi
>
> On Friday 19 February 2010 14:20:10 Juergen wrote:
> > Hallo.
> >
> > I have the problem that it takes a long time for digikam to write
> > metadate into files.
> >
> > Technical details are :
> >
> > Suse 11.0
> >
> > AMD : Linux linux-4qg7 2.6.25.20-0.6-default #1 SMP 2010-01-14 18:58:36
> > +0100 x86_64 x86_64 x86_64 GNU/Linux
> >
> > KDE 3.5.9 "release 49.2"
> >
> > Digikam : V 1.1.0 with KDE Version 4.4.0 release 224
> >
> > So, back to my problem.
> >
> > Downloading images from my kardreader takes much longer than it did in
> > previous versions. But, I can not tell you exact how long that is.
> >
> > But, what makes the current version useless for me is that it takes so
> > long to write tags into my image files.
> >
> > It almost an hour to write just one Tag : Special->Original to 111
> > images.
> >
> > The images are JPG images taken with my "Nikon D90" and they are about 3
> > - 6 MB big.
> >
> > For 12 Images to get one new tag added it took 3,44 minutes.
> >
> > My settings regarding metadata are :
> >
> > Rotate preview images according exif information
> > Set exif information to normal after rotation
> > Save image tags as "Keywords" tags embedded in metadata in files
> > Save image captions in metadata in files
> > Save image timestamp in metadata in files.
>
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Juergen-3]

Am 22.02.2010 20:52, schrieb Andi Clemens:

> The "20times slower" is only true for my hardware of course, no general
> assumption... :-)
>
>
> On Monday 22 February 2010 20:47:40 Andi Clemens wrote:
>> What filesystem are you using? All barrier-enabled filesystems will be slow
>> as hell with sqlite3 or in general heavy disk usage.
>>
>> Filesystems that will be 20times slower for example are:
>> EXT4 (barriers on)
>> XFS (barriers on)
>>
>> If you are using one of the above FS, try disabling barriers:
>>
>> EXT4:
>> mount -o defaults,rw,barrier=0,async,noatime,nodiratime
>>
>> XFS:
>> mount -o defaults,rw,nobarrier,async,noatime,nodiratime,logbufs=8
>>
>> Andi

Hi Andi

I use the ext3 filesystem.

And, I have the feeling that it has nothing to do with filesystem
because, as posted in my last mail, if I use exiv2 cmd line the tags are
written fast to my files.

Also, if I write the tags to image my daughter has taken with her Canon
Powershot it goes in a flash.

With these Canon Files digikam has no problems.


Juergen
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Gilles Caulier-4]

2010/2/25 Daniel Larsson <[hidden email]>:
> If sqlite3 is slow how about a change to mysql? I have a faint memory that
> this change was discussed some time ago. I have tested with and without
> barriers but the "20times slower" is not true on my hardware. Only a few %
> in difference. A think sqlite3 handles small amounts of data, up to ~30 000
> pictures well, but I have over 450 000 pictures on my drives and then its
> slow, realy slow.

MySql port is done in a separate branche in svn. code will be merged
to 1.3.0 release... planed in one month, no more. You must be patient
to test (:=)))

Gilles Caulier
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Gilles Caulier-4]

Look there :

http://www.flickr.com/photos/digikam/4329961366/in/pool-digikam-labs
http://www.flickr.com/photos/digikam/4329227145/in/pool-digikam-labs/

Gilles Caulier

2010/2/26 Gilles Caulier <[hidden email]>:

> 2010/2/25 Daniel Larsson <[hidden email]>:
>> If sqlite3 is slow how about a change to mysql? I have a faint memory that
>> this change was discussed some time ago. I have tested with and without
>> barriers but the "20times slower" is not true on my hardware. Only a few %
>> in difference. A think sqlite3 handles small amounts of data, up to ~30 000
>> pictures well, but I have over 450 000 pictures on my drives and then its
>> slow, realy slow.
>
> MySql port is done in a separate branche in svn. code will be merged
> to 1.3.0 release... planed in one month, no more. You must be patient
> to test (:=)))
>
> Gilles Caulier
>

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Sveinn í Felli]

Gilles, those videos you have are all Creative Commons ?
;-)

Sveinn í Felli

Þann fös 26.feb 2010 06:06, skrifaði Gilles Caulier:

> Look there :
>
> http://www.flickr.com/photos/digikam/4329961366/in/pool-digikam-labs
> http://www.flickr.com/photos/digikam/4329227145/in/pool-digikam-labs/
>
> Gilles Caulier
>
> 2010/2/26 Gilles Caulier<[hidden email]>:
>> 2010/2/25 Daniel Larsson<[hidden email]>:
>>> If sqlite3 is slow how about a change to mysql? I have a faint memory that
>>> this change was discussed some time ago. I have tested with and without
>>> barriers but the "20times slower" is not true on my hardware. Only a few %
>>> in difference. A think sqlite3 handles small amounts of data, up to ~30 000
>>> pictures well, but I have over 450 000 pictures on my drives and then its
>>> slow, realy slow.
>>
>> MySql port is done in a separate branche in svn. code will be merged
>> to 1.3.0 release... planed in one month, no more. You must be patient
>> to test (:=)))
>>
>> Gilles Caulier
>>
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

[Gilles Caulier-4]

2010/2/26 Sveinn í Felli <[hidden email]>:
> Gilles, those videos you have are all Creative Commons ?
> ;-)

yes, of course, to promote digiKam (:=)))

Gilles

>
> Sveinn í Felli
>
> Þann fös 26.feb 2010 06:06, skrifaði Gilles Caulier:
>> Look there :
>>
>> http://www.flickr.com/photos/digikam/4329961366/in/pool-digikam-labs
>> http://www.flickr.com/photos/digikam/4329227145/in/pool-digikam-labs/
>>
>> Gilles Caulier
>>
>> 2010/2/26 Gilles Caulier<[hidden email]>:
>>> 2010/2/25 Daniel Larsson<[hidden email]>:
>>>> If sqlite3 is slow how about a change to mysql? I have a faint memory that
>>>> this change was discussed some time ago. I have tested with and without
>>>> barriers but the "20times slower" is not true on my hardware. Only a few %
>>>> in difference. A think sqlite3 handles small amounts of data, up to ~30 000
>>>> pictures well, but I have over 450 000 pictures on my drives and then its
>>>> slow, realy slow.
>>>
>>> MySql port is done in a separate branche in svn. code will be merged
>>> to 1.3.0 release... planed in one month, no more. You must be patient
>>> to test (:=)))
>>>
>>> Gilles Caulier
>>>
>> _______________________________________________
>> Digikam-users mailing list
>> [hidden email]
>> https://mail.kde.org/mailman/listinfo/digikam-users
>
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users
>

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

I will be patient and I am really locking forward to test with MySql.

/D.L.

> From: [hidden email]
> Date: Fri, 26 Feb 2010 07:04:09 +0100
> To: [hidden email]
> Subject: Re: [Digikam-users] Write Metadata takes long time
>
> 2010/2/25 Daniel Larsson <[hidden email]>:
> > If sqlite3 is slow how about a change to mysql? I have a faint memory that
> > this change was discussed some time ago. I have tested with and without
> > barriers but the "20times slower" is not true on my hardware. Only a few %
> > in difference. A think sqlite3 handles small amounts of data, up to ~30 000
> > pictures well, but I have over 450 000 pictures on my drives and then its
> > slow, realy slow.
>
> MySql port is done in a separate branche in svn. code will be merged
> to 1.3.0 release... planed in one month, no more. You must be patient
> to test (:=)))
>
> Gilles Caulier
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users

---

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users