Import of many photos

classic Classic list List threaded Threaded
14 messages Options
Reply | Threaded
Open this post in threaded view
|

Import of many photos

Anders Lund
Hi list,

I'm trying to import several thousands of photos into digikam, a collection
recovered fro a harddisk that was damaged.

I tried to just import the cr2 folder, which contains several folders of 1000
images each, but the dialog to select a target album never becomes usable, it
is just a square.  My process window in KDE just shows digikam using 25% CPU
constantly, probably it just fully takes up a core of the 4 in the quadcore
system. Maybe it is retrieving thumbnails...

Anyone have an idea for how to import images in one go? My next attempt is to
import them folder by folder, but that will require a lot of work,
unfortunately.

Kindly,
Anders
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Andrew Goodbody
On 26/11/14 18:54, Anders Lund wrote:
> Anyone have an idea for how to import images in one go? My next attempt is to
> import them folder by folder, but that will require a lot of work,
> unfortunately.

Don't use digikam to import the images. Simply move the files to the
place in the file system where you want them to be. Then start digikam.
If they are under an existing collection then they will be found
automatically. If they are not under an existing collection then you can
just add their location as a new collection.

Andrew
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Anders Lund
Onsdag den 26. november 2014 21:38:35 skrev Andrew Goodbody:

> On 26/11/14 18:54, Anders Lund wrote:
> > Anyone have an idea for how to import images in one go? My next attempt is
> > to import them folder by folder, but that will require a lot of work,
> > unfortunately.
>
> Don't use digikam to import the images. Simply move the files to the
> place in the file system where you want them to be. Then start digikam.
> If they are under an existing collection then they will be found
> automatically. If they are not under an existing collection then you can
> just add their location as a new collection.

I actually want to use digikam, because it can rename them and sort them into
albums. I may be able to get the digikam database to work, but only after they
are sorted/renamed I think. :)

Kindly,
Anders
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Jürgen Karbach
Am Mittwoch, 26. November 2014, 22:41:29 schrieb Anders Lund:
> I actually want to use digikam, because it can rename them and sort them
> into  albums. I may be able to get the digikam database to work, but only
> after they are sorted/renamed I think.

In this case it would be handy to use Rapid Photo Downloader. It can rename
the files like DK, creates subfolders by date, extention, Jobcode, metadata,
Cam, Cam-SNR, ...
You also can backup (copy) this files simultaneously to up to 3 drives.
If your files are at several devices, you can „download‟ simultaneously from
multiple drives.
After Rapid Photo Downloader has done its job, you start Digikam which is
looking for new images to assign to the database. (check digikams prefs
before!)

Regards

H. Jürgen Karbach

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Anders Lund
In reply to this post by Anders Lund
Today i try to import directries of 1000 cr2 files one at a time. Digikam
imported the 1000 photos, and then froze. Ḯ'm waiting in the hope that
sometime it will be done, but I have MANY directories of 1000 photos to
import. Feels buggy.

Anders

Onsdag den 26. november 2014 19:54:19 skrev Anders Lund:

> Hi list,
>
> I'm trying to import several thousands of photos into digikam, a collection
> recovered fro a harddisk that was damaged.
>
> I tried to just import the cr2 folder, which contains several folders of
> 1000 images each, but the dialog to select a target album never becomes
> usable, it is just a square.  My process window in KDE just shows digikam
> using 25% CPU constantly, probably it just fully takes up a core of the 4
> in the quadcore system. Maybe it is retrieving thumbnails...
>
> Anyone have an idea for how to import images in one go? My next attempt is
> to import them folder by folder, but that will require a lot of work,
> unfortunately.
>
> Kindly,
> Anders
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Anders Lund
Fredag den 28. november 2014 22:18:52 skrev Anders Lund:
> Today i try to import directries of 1000 cr2 files one at a time. Digikam
> imported the 1000 photos, and then froze. Ḯ'm waiting in the hope that
> sometime it will be done, but I have MANY directories of 1000 photos to
> import. Feels buggy.

After several minutes (more than 15) digikam unfroze again. Whatever it does
in that time, freezing the ui is not smart.

1000 photos is not that much!

Anders

> Anders
>
> Onsdag den 26. november 2014 19:54:19 skrev Anders Lund:
> > Hi list,
> >
> > I'm trying to import several thousands of photos into digikam, a
> > collection
> > recovered fro a harddisk that was damaged.
> >
> > I tried to just import the cr2 folder, which contains several folders of
> > 1000 images each, but the dialog to select a target album never becomes
> > usable, it is just a square.  My process window in KDE just shows digikam
> > using 25% CPU constantly, probably it just fully takes up a core of the 4
> > in the quadcore system. Maybe it is retrieving thumbnails...
> >
> > Anyone have an idea for how to import images in one go? My next attempt is
> > to import them folder by folder, but that will require a lot of work,
> > unfortunately.
> >
> > Kindly,
> > Anders
> > _______________________________________________
> > Digikam-users mailing list
> > [hidden email]
> > https://mail.kde.org/mailman/listinfo/digikam-users
>
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Boudewijn
On Friday 28 November 2014 22:53:42 Anders Lund wrote:

> Fredag den 28. november 2014 22:18:52 skrev Anders Lund:
> > Today i try to import directries of 1000 cr2 files one at a time. Digikam
> > imported the 1000 photos, and then froze. Ḯ'm waiting in the hope that
> > sometime it will be done, but I have MANY directories of 1000 photos to
> > import. Feels buggy.
>
> After several minutes (more than 15) digikam unfroze again. Whatever it does
> in that time, freezing the ui is not smart.
>
> 1000 photos is not that much!

I have no answer/solution, but perhaps it helps. My PC becomes very busy when
dropping many photos in Digikam or updating tags (I write the tags to the
image file, not database only, so date modified changes). In my case it is
minidlna, that scans the directories on change and imports the images (or
reimports, in case of tags updated). It makes DK close to freezing as well. I
always thought minidlna to be the culprit; if I disable it for a while DK will
freeze for a shorter while.

Could there be a backgroundprocess in your case that gives your system a hard
time while importing photos?

Best regards,

Boudewijn
_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Anders Lund
Søndag den 30. november 2014 01:16:06 skrev Boudewijn:

> On Friday 28 November 2014 22:53:42 Anders Lund wrote:
> > Fredag den 28. november 2014 22:18:52 skrev Anders Lund:
> > > Today i try to import directries of 1000 cr2 files one at a time.
> > > Digikam
> > > imported the 1000 photos, and then froze. Ḯ'm waiting in the hope that
> > > sometime it will be done, but I have MANY directories of 1000 photos to
> > > import. Feels buggy.
> >
> > After several minutes (more than 15) digikam unfroze again. Whatever it
> > does in that time, freezing the ui is not smart.
> >
> > 1000 photos is not that much!
>
> I have no answer/solution, but perhaps it helps. My PC becomes very busy
> when dropping many photos in Digikam or updating tags (I write the tags to
> the image file, not database only, so date modified changes). In my case it
> is minidlna, that scans the directories on change and imports the images
> (or reimports, in case of tags updated). It makes DK close to freezing as
> well. I always thought minidlna to be the culprit; if I disable it for a
> while DK will freeze for a shorter while.
>
> Could there be a backgroundprocess in your case that gives your system a
> hard time while importing photos?

I thought about the face detection or something like that could slow things
down. There appears to be quite a lot of things going on that freezes the gui
even after the notification that the import is done.

Digikam says just autorotating, but in my case few images actually need to be
rotated, even if they are all tested.

Nothing special should be happening. During most of the time after the images
are imported, the KDE process table shows digikam using 2-3%CPU. During the
import 25% - using one core, I guess.

Kindly,
Anders

> Best regards,
>
> Boudewijn
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

tosca
Same problem here, as I'm used to tag photo by dozens. Digikam is still working in the background when I tag the next few ones, then others ... I sometimes had to wait for about 2 hours till it finished! In the past, I even thought it was completely frozen, as the progress bars in the low right corner doesn't seem to move; in fact, it says the same thing for everey picture, so one cannot see if it is actually working or completely stuck.

I don't use face detection, rotating has already been done before. So I'm only tagging, writing description and such on pictures that have been imported and edited a while ago.

Marie-Noëlle

2014-11-30 1:32 GMT+01:00 Anders Lund <[hidden email]>:
Søndag den 30. november 2014 01:16:06 skrev Boudewijn:
> On Friday 28 November 2014 22:53:42 Anders Lund wrote:
> > Fredag den 28. november 2014 22:18:52 skrev Anders Lund:
> > > Today i try to import directries of 1000 cr2 files one at a time.
> > > Digikam
> > > imported the 1000 photos, and then froze. Ḯ'm waiting in the hope that
> > > sometime it will be done, but I have MANY directories of 1000 photos to
> > > import. Feels buggy.
> >
> > After several minutes (more than 15) digikam unfroze again. Whatever it
> > does in that time, freezing the ui is not smart.
> >
> > 1000 photos is not that much!
>
> I have no answer/solution, but perhaps it helps. My PC becomes very busy
> when dropping many photos in Digikam or updating tags (I write the tags to
> the image file, not database only, so date modified changes). In my case it
> is minidlna, that scans the directories on change and imports the images
> (or reimports, in case of tags updated). It makes DK close to freezing as
> well. I always thought minidlna to be the culprit; if I disable it for a
> while DK will freeze for a shorter while.
>
> Could there be a backgroundprocess in your case that gives your system a
> hard time while importing photos?

I thought about the face detection or something like that could slow things
down. There appears to be quite a lot of things going on that freezes the gui
even after the notification that the import is done.

Digikam says just autorotating, but in my case few images actually need to be
rotated, even if they are all tested.

Nothing special should be happening. During most of the time after the images
are imported, the KDE process table shows digikam using 2-3%CPU. During the
import 25% - using one core, I guess.

Kindly,
Anders

> Best regards,
>
> Boudewijn
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users



--

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Gilles Caulier-4
Import don't know face management.

Problem are related to Sqlite lock and crash. There are a lots of reports in bugzilla. Solutions : update libsqlite AND QtSql plugin to don't see this dysfunction.

Gilles Caulier

2014-11-30 10:13 GMT+01:00 Marie-Noëlle Augendre <[hidden email]>:
Same problem here, as I'm used to tag photo by dozens. Digikam is still working in the background when I tag the next few ones, then others ... I sometimes had to wait for about 2 hours till it finished! In the past, I even thought it was completely frozen, as the progress bars in the low right corner doesn't seem to move; in fact, it says the same thing for everey picture, so one cannot see if it is actually working or completely stuck.

I don't use face detection, rotating has already been done before. So I'm only tagging, writing description and such on pictures that have been imported and edited a while ago.

Marie-Noëlle

2014-11-30 1:32 GMT+01:00 Anders Lund <[hidden email]>:
Søndag den 30. november 2014 01:16:06 skrev Boudewijn:
> On Friday 28 November 2014 22:53:42 Anders Lund wrote:
> > Fredag den 28. november 2014 22:18:52 skrev Anders Lund:
> > > Today i try to import directries of 1000 cr2 files one at a time.
> > > Digikam
> > > imported the 1000 photos, and then froze. Ḯ'm waiting in the hope that
> > > sometime it will be done, but I have MANY directories of 1000 photos to
> > > import. Feels buggy.
> >
> > After several minutes (more than 15) digikam unfroze again. Whatever it
> > does in that time, freezing the ui is not smart.
> >
> > 1000 photos is not that much!
>
> I have no answer/solution, but perhaps it helps. My PC becomes very busy
> when dropping many photos in Digikam or updating tags (I write the tags to
> the image file, not database only, so date modified changes). In my case it
> is minidlna, that scans the directories on change and imports the images
> (or reimports, in case of tags updated). It makes DK close to freezing as
> well. I always thought minidlna to be the culprit; if I disable it for a
> while DK will freeze for a shorter while.
>
> Could there be a backgroundprocess in your case that gives your system a
> hard time while importing photos?

I thought about the face detection or something like that could slow things
down. There appears to be quite a lot of things going on that freezes the gui
even after the notification that the import is done.

Digikam says just autorotating, but in my case few images actually need to be
rotated, even if they are all tested.

Nothing special should be happening. During most of the time after the images
are imported, the KDE process table shows digikam using 2-3%CPU. During the
import 25% - using one core, I guess.

Kindly,
Anders

> Best regards,
>
> Boudewijn
> _______________________________________________
> Digikam-users mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users



--

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users



_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Anders Lund
Søndag den 30. november 2014 10:42:10 skrev Gilles Caulier:
> Import don't know face management.
>
> Problem are related to Sqlite lock and crash. There are a lots of reports
> in bugzilla. Solutions : update libsqlite AND QtSql plugin to don't see
> this dysfunction.

Running Arch Linux, I am usually up to date.

Kindly,
Anders

> Gilles Caulier
>
> 2014-11-30 10:13 GMT+01:00 Marie-Noëlle Augendre <[hidden email]>:
> > Same problem here, as I'm used to tag photo by dozens. Digikam is still
> > working in the background when I tag the next few ones, then others ... I
> > sometimes had to wait for about 2 hours till it finished! In the past, I
> > even thought it was completely frozen, as the progress bars in the low
> > right corner doesn't seem to move; in fact, it says the same thing for
> > everey picture, so one cannot see if it is actually working or completely
> > stuck.
> >
> > I don't use face detection, rotating has already been done before. So I'm
> > only tagging, writing description and such on pictures that have been
> > imported and edited a while ago.
> >
> > Marie-Noëlle
> >
> > 2014-11-30 1:32 GMT+01:00 Anders Lund <[hidden email]>:
> >> Søndag den 30. november 2014 01:16:06 skrev Boudewijn:
> >> > On Friday 28 November 2014 22:53:42 Anders Lund wrote:
> >> > > Fredag den 28. november 2014 22:18:52 skrev Anders Lund:
> >> > > > Today i try to import directries of 1000 cr2 files one at a time.
> >> > > > Digikam
> >> > > > imported the 1000 photos, and then froze. Ḯ'm waiting in the hope
> >>
> >> that
> >>
> >> > > > sometime it will be done, but I have MANY directories of 1000
> >>
> >> photos to
> >>
> >> > > > import. Feels buggy.
> >> > >
> >> > > After several minutes (more than 15) digikam unfroze again. Whatever
> >>
> >> it
> >>
> >> > > does in that time, freezing the ui is not smart.
> >> > >
> >> > > 1000 photos is not that much!
> >> >
> >> > I have no answer/solution, but perhaps it helps. My PC becomes very
> >> > busy
> >> > when dropping many photos in Digikam or updating tags (I write the tags
> >>
> >> to
> >>
> >> > the image file, not database only, so date modified changes). In my
> >>
> >> case it
> >>
> >> > is minidlna, that scans the directories on change and imports the
> >> > images
> >> > (or reimports, in case of tags updated). It makes DK close to freezing
> >>
> >> as
> >>
> >> > well. I always thought minidlna to be the culprit; if I disable it for
> >> > a
> >> > while DK will freeze for a shorter while.
> >> >
> >> > Could there be a backgroundprocess in your case that gives your system
> >> > a
> >> > hard time while importing photos?
> >>
> >> I thought about the face detection or something like that could slow
> >> things
> >> down. There appears to be quite a lot of things going on that freezes the
> >> gui
> >> even after the notification that the import is done.
> >>
> >> Digikam says just autorotating, but in my case few images actually need
> >> to be
> >> rotated, even if they are all tested.
> >>
> >> Nothing special should be happening. During most of the time after the
> >> images
> >> are imported, the KDE process table shows digikam using 2-3%CPU. During
> >> the
> >> import 25% - using one core, I guess.
> >>
> >> Kindly,
> >> Anders
> >>
> >> > Best regards,
> >> >
> >> > Boudewijn
> >> > _______________________________________________
> >> > Digikam-users mailing list
> >> > [hidden email]
> >> > https://mail.kde.org/mailman/listinfo/digikam-users
> >>
> >> _______________________________________________
> >> Digikam-users mailing list
> >> [hidden email]
> >> https://mail.kde.org/mailman/listinfo/digikam-users
> >
> > --
> >
> > *Les calendriers 2015 sont disponibles sur le site lulu.com :*
> > <http://www.lulu.com/spotlight/mnaugendre>
> >
> > [image:
> > http://www.lulu.com/shop/marie-no%C3%ABlle-augendre/calendrier-aubrac-2015
> > /calendar/product-21867668.html]
> > <http://www.lulu.com/shop/marie-no%C3%ABlle-augendre/calendrier-aubrac-20
> > 15/calendar/product-21867668.html>[image:
> > http://www.lulu.com/shop/marie-no%C3%ABlle-augendre/lumi%C3%A8res-en-lang
> > uedoc-roussillon-calendrier-2015/calendar/product-21867751.html]
> > <http://www.lulu.com/shop/marie-no%C3%ABlle-augendre/lumi%C3%A8res-en-lan
> > guedoc-roussillon-calendrier-2015/calendar/product-21867751.html>
> >
> > Site personnel <http://marie-noelle-augendre.com/>, Photographe en
> > Cévennes <http://www.facebook.com/PhotographeEnCevennes> sur Facebook, et
> > la photothèque Cévennes Plurielles <http://www.cevennes-plurielles.com>
> >
> > _______________________________________________
> > Digikam-users mailing list
> > [hidden email]
> > https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

tosca
In reply to this post by Gilles Caulier-4
How can I do that?
I make a 'yum update' several times a week, so my system is supposed to be up-to-date... from my distro point of view, at least.

Marie-Noëlle


2014-11-30 10:42 GMT+01:00 Gilles Caulier <[hidden email]>:
Import don't know face management.

Problem are related to Sqlite lock and crash. There are a lots of reports in bugzilla. Solutions : update libsqlite AND QtSql plugin to don't see this dysfunction.

Gilles Caulier




--

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

Gilles Caulier-4
yes, this is the right way.

In fact, following this entry in bugzilla give some important information about libsqlite version to use :


Read well the story, it's long. At end you will seen which min libsqlite version to use.

Here i cannot see libsqlite lock (and crash).

As libsqlite is used in a lots of opensource project, to prevent broken binary compatibilty, packager freeze lib version used by distro.

The best way is to report this problem as UPSTREAM to distro managers.

Gilles






2014-11-30 11:52 GMT+01:00 Marie-Noëlle Augendre <[hidden email]>:
How can I do that?
I make a 'yum update' several times a week, so my system is supposed to be up-to-date... from my distro point of view, at least.

Marie-Noëlle


2014-11-30 10:42 GMT+01:00 Gilles Caulier <[hidden email]>:
Import don't know face management.

Problem are related to Sqlite lock and crash. There are a lots of reports in bugzilla. Solutions : update libsqlite AND QtSql plugin to don't see this dysfunction.

Gilles Caulier




--

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users



_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users
Reply | Threaded
Open this post in threaded view
|

Re: Import of many photos

tosca
Last information about the version seems to be a few months old...
I'm now running sqlite-3.8.7 and downgrading doesn't seem to be an option, as other programs require the last version.

Marie-Noëlle

2014-11-30 12:30 GMT+01:00 Gilles Caulier <[hidden email]>:
yes, this is the right way.

In fact, following this entry in bugzilla give some important information about libsqlite version to use :


Read well the story, it's long. At end you will seen which min libsqlite version to use.

Here i cannot see libsqlite lock (and crash).

As libsqlite is used in a lots of opensource project, to prevent broken binary compatibilty, packager freeze lib version used by distro.

The best way is to report this problem as UPSTREAM to distro managers.

Gilles






--

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users