Digikam file takes up a lot of space
Locked
Digikam file takes up a lot of space
 
|
Hi All,
I use digiKam to tag camera trap images for research purposes. I run it on macOS Sierra version 10.12.6 with 2.9 GHz i5 processor, 8 GB RAM, and 120 GB hard drive.
In my database folder there is a file called: "thumbnails-digikam.db" which takes up over 38 GB of space and I am constantly running out of space on my MacBook. I was told that you should not store your database on an
external drive. Is this true? If I change the directory of my database to an external hard drive would this affect it in anyway?
What about on Windows OS, can you have the database directory on a external hard drive?
Thank you for your time.
Kind Regards, |
Re: Digikam file takes up a lot of space
|
|
Le 06/01/2018 à 11:06, WILDLIFE-HELP A.N. a écrit :
> In my database folder there is a file called: "thumbnails-digikam.db" > which takes up over 38 GB are you sure? for around 50.000 images I use only 4Gb for this file! may be you can use mysql on remote? jdd -- http://dodin.org |
Re: Digikam file takes up a lot of space
|
|
Hi JDD,
Thank you for the quick response!
Yes, it's over 38GB. I have about 400,000 photos that I've finished tagging and continuously get more and more. What I do is I'll put about 10,000 images in the collections album, tag them, write metadata to each file, then move them back to my hard drive
and put untagged images in the albums/collections folder again.
I will have a look at the mysql settings in a minute.
Kind Regards,
Philip
Sent from my Samsung Galaxy smartphone.
-------- Original message --------
From: [hidden email]
Date: 2018/01/06 12:18 (GMT+02:00)
To: [hidden email]
Subject: Re: Digikam file takes up a lot of space
Le 06/01/2018 à 11:06, WILDLIFE-HELP A.N. a écrit :
> In my database folder there is a file called: "thumbnails-digikam.db" > which takes up over 38 GB are you sure? for around 50.000 images I use only 4Gb for this file! may be you can use mysql on remote? jdd -- http://dodin.org |
Re: Digikam file takes up a lot of space
|
|
In reply to this post by WILDLIFE-HELP A.N.
Hi Philip,
the thumbnails-digicam.db is NOT the database containing all the metadata, but stores the thumbnails of your collection (smaller size preview pictures). Thus digicam can even show you previews of pictures located on offline media not connected to your laptop currently. If you are running out of space, you could * either store your pictures on external media, after processing them I keep my images of the current project on my laptop and move the older ones to an external storage (asides of backup and archiving, of course) * or, if even this does not help, have digikam show the original pictures and skip generating thumbnails - which might make scrolling through your collection slower and you loose previews of offline collections digikam -> Preferences -> Preview -> Preview shows full picture - is, as far as I remember, the option to make it skip generating thumbnails. You can then delete thumbnails-digicam.db. If it is not regenerated by rescanning your collection on next start, this was the right setting. (Keep in mind: I am using a different interface language, so don’t stick to the letter for the names of the options mentioned before.) regards Manuel
|
Re: Digikam file takes up a lot of space
|
|
In reply to this post by WILDLIFE-HELP A.N.
Le 06/01/2018 à 11:24, WILDLIFE-HELP A.N. a écrit :
> Hi JDD, > > Thank you for the quick response! > > Yes, it's over 38GB. I have about 400,000 photos wow... on a 120Gb disk, it's not large :-) I use an usb3 5Tb disk as archive, it may be possible to have the database located there. Not as fast as my usual ssd but manageable (still sqlite) jdd -- http://dodin.org |
Re: Digikam file takes up a lot of space
|
|
In reply to this post by Manuel Bock
I will add detail here : the thumbnails database store small image using wavelets compression algorithm (PGF open source format). It's optimized a lots compared to open desktop way used in the past which store thumbnail in PNG (LZW compression). Gilles Caulier 2018-01-06 11:37 GMT+01:00 Manuel Bock <[hidden email]>:
|
Re: Digikam file takes up a lot of space
|
|
In reply to this post by jdd@dodin.org
Yes, my MacBook's SSD storage is very small and 38GB is a large percentage of it. Which is why I keep all images on a external and then copy and paste about 10,000 images from it to tag on laptop then when I'm done I move them back and take a new batch.
Sent from my Samsung Galaxy smartphone.
-------- Original message --------
From: [hidden email]
Date: 2018/01/06 12:38 (GMT+02:00)
To: [hidden email]
Subject: Re: Digikam file takes up a lot of space
Le 06/01/2018 à 11:24, WILDLIFE-HELP A.N. a écrit :
> Hi JDD, > > Thank you for the quick response! > > Yes, it's over 38GB. I have about 400,000 photos wow... on a 120Gb disk, it's not large :-) I use an usb3 5Tb disk as archive, it may be possible to have the database located there. Not as fast as my usual ssd but manageable (still sqlite) jdd -- http://dodin.org |
Re: Digikam file takes up a lot of space
|
|
In reply to this post by Gilles Caulier-4
Thanks for the advice Manuel and Gilles. I appreciate your time.
I will have a look at what I can do following your instructions.
Kind Regards,
Philip
Sent from my Samsung Galaxy smartphone.
-------- Original message --------
From: Gilles Caulier <[hidden email]>
Date: 2018/01/06 12:43 (GMT+02:00)
To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]>
Subject: Re: Digikam file takes up a lot of space
I will add detail here : the thumbnails database store small image using wavelets compression algorithm (PGF open source format). It's optimized a lots compared to open desktop way used in the past which store thumbnail in PNG (LZW compression).
Gilles Caulier
2018-01-06 11:37 GMT+01:00 Manuel Bock <[hidden email]>:
|
Re: Digikam file takes up a lot of space
|
|
In reply to this post by WILDLIFE-HELP A.N.
Thank you for the advice JDD
Sent from my Samsung Galaxy smartphone.
-------- Original message --------
From: "WILDLIFE-HELP A.N." <[hidden email]>
Date: 2018/01/06 12:45 (GMT+02:00)
To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]>
Subject: Re: Digikam file takes up a lot of space
Yes, my MacBook's SSD storage is very small and 38GB is a large percentage of it. Which is why I keep all images on a external and then copy and paste about 10,000 images from it to tag on laptop then when I'm done I move them back and take a new batch.
Sent from my Samsung Galaxy smartphone.
-------- Original message --------
From: [hidden email]
Date: 2018/01/06 12:38 (GMT+02:00)
To: [hidden email]
Subject: Re: Digikam file takes up a lot of space
Le 06/01/2018 à 11:24, WILDLIFE-HELP A.N. a écrit :
> Hi JDD, > > Thank you for the quick response! > > Yes, it's over 38GB. I have about 400,000 photos wow... on a 120Gb disk, it's not large :-) I use an usb3 5Tb disk as archive, it may be possible to have the database located there. Not as fast as my usual ssd but manageable (still sqlite) jdd -- http://dodin.org |
Re: Digikam file takes up a lot of space
|
|
In reply to this post by WILDLIFE-HELP A.N.
There is also a maintenance tool for database. Some redondant entries in thumbnails file can grow up the size. The maintenance tool can help to remove invalid entries. Look in Tools/Maintenance/Perform DB cleaning section. Note : make a DB backup before to use, just in case. Gilles Caulier 2018-01-06 11:44 GMT+01:00 WILDLIFE-HELP A.N. <[hidden email]>:
|
Re: Digikam file takes up a lot of space
|
|
In reply to this post by WILDLIFE-HELP A.N.
Philip,
as mentioned, the thumbnails-digikam.db is speeding up the interactivity of working with large collections, as you especially. If deleting/disabling thumbnails would help you a lot, I’d rather question. At some point, missing storage storage is just to be improved by more storage space. You could either upgrade you internal ssd, if the model of the laptop allows for it, or you could add an sd-card-drive permanently - for example with a nifty adapter or so. Gilles defintively knows more details. I think, keeping the databases digikam.db and thumbnails-digikam.db in different locations is not possible currently and the request to have the sqlite databases on your internal drive comes from speed requirements plus from preventing you from starting digikam without having your databases connected. Right Gilles? If so, storing both databases on the nifty-drive would be slower but possible. regards Manuel
|
Re: Digikam file takes up a lot of space
|
|
In reply to this post by WILDLIFE-HELP A.N.
Every time you swap to a new batch of photos, just delete the thumbnails
database. You probably have thumbnails for all the photos you have ever tagged in there, which is not useful if they are not visible to digikam any more. In theory I think there is supposed to be some garbage collection that will remove obsolete entries but it does not happen immediately and who knows actually how well it works. With your comments it sounds like it is not doing its job very well. Andrew On 06/01/18 10:24, WILDLIFE-HELP A.N. wrote: > Hi JDD, > > Thank you for the quick response! > > Yes, it's over 38GB. I have about 400,000 photos that I've finished > tagging and continuously get more and more. What I do is I'll put about > 10,000 images in the collections album, tag them, write metadata to each > file, then move them back to my hard drive and put untagged images in > the albums/collections folder again. > > I will have a look at the mysql settings in a minute. > > Kind Regards, > Philip > > > > > Sent from my Samsung Galaxy smartphone. > > > -------- Original message -------- > From: [hidden email] > Date: 2018/01/06 12:18 (GMT+02:00) > To: [hidden email] > Subject: Re: Digikam file takes up a lot of space > > Le 06/01/2018 à 11:06, WILDLIFE-HELP A.N. a écrit : > >> In my database folder there is a file called: "thumbnails-digikam.db" >> which takes up over 38 GB > > are you sure? for around 50.000 images I use only 4Gb for this file! > > may be you can use mysql on remote? > > jdd > > -- > http://dodin.org |
«
Return to digikam-users
|
1 view|%1 views
| Free forum by Nabble | Edit this page |