[digiKam-users] Sharing Database/Collections

classic Classic list List threaded Threaded
29 messages Options
12
Reply | Threaded
Open this post in threaded view
|

[digiKam-users] Sharing Database/Collections

tsader
Is there a good way to share my collection on different computers like you
can with certain apps using dropbox?

I would like to be able to work on my collections on a laptop when away and
then be able to sync with my desktop.

Is this possible?

Thx



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

leoutation
On 9/10/19 5:44 PM, tsader wrote:
> Is there a good way to share my collection on different computers like you
> can with certain apps using dropbox?
>
> I would like to be able to work on my collections on a laptop when away and
> then be able to sync with my desktop.
>
> Is this possible?
>

Yes, I do it with rsync and ssh

--
Maderios
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

Tommy
Would you mind sharing the process?



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

woenx
In reply to this post by tsader
Yes, it's possible. There are several ways.

The easiest one: Share your pictures in a network folder, install digikam in
every computer you want to use it, and use that shared folder. If changes
and metadata are saved to the files or sidecars, other computers will detect
and  update the changes when you start digikam. For that, you will need a
server (NAS) with a hard drive containing your picture library.

Another option: as you mentioned, using some service like dropbox, google
drive, owncloud... and sync the picture folder. Use that folder in digikam.
All computers using that service should be automatically updated.




--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

tsader
But I wanna be able to work on the collections when I have no access to the
network folder.

I wanna be able to work on, organize my collections when I am away and then
sync the changes.

All I have figured out is how to use the same database but not the same
folder/images. I can see the same images/thumbnails but I am not able to
view them in previews





--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

Remco Viëtor
On mercredi 18 septembre 2019 15:37:20 CEST tsader wrote:
> But I wanna be able to work on the collections when I have no access to the
> network folder.
>
> I wanna be able to work on, organize my collections when I am away and then
> sync the changes.
>
Not possible if your collections are on a network share and you have no access
to it...

> All I have figured out is how to use the same database but not the same
> folder/images. I can see the same images/thumbnails but I am not able to
> view them in previews
>
That seems to indicate that you have duplicated the database to local storage.
Thumbnails are stored in the database.

Remco.


Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

AndriusWild
I would love to have such functionality too but that would require a whole lot coding for the devs to implement it.
 Maybe one day...


Sent from my Samsung Galaxy smartphone.

-------- Original message --------
From: Remco Viëtor <[hidden email]>
Date: 2019-09-18 8:35 a.m. (GMT-07:00)
To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]>
Subject: Re: [digiKam-users] Sharing Database/Collections

On mercredi 18 septembre 2019 15:37:20 CEST tsader wrote:
> But I wanna be able to work on the collections when I have no access to the
> network folder.
>
> I wanna be able to work on, organize my collections when I am away and then
> sync the changes.
>
Not possible if your collections are on a network share and you have no access
to it...

> All I have figured out is how to use the same database but not the same
> folder/images. I can see the same images/thumbnails but I am not able to
> view them in previews
>
That seems to indicate that you have duplicated the database to local storage.
Thumbnails are stored in the database.

Remco.


Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

tsader
I have been using Media Pro like this. I work on the same Catalog/Albums on
two different machines and have the image folder copied on both.

When I do all my work on one machine I later sync it with other by backing
up the Albums and Folder with chronosync which only syncs the changes and
not copying over everything again.

I tried that method with Digikam but it doesn't like the changes made to the
images folder or maybe I am not doing something right.



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

AndriusWild
I do not think digiKam can do that...




On Wed, Sep 18, 2019 at 10:19 AM tsader <[hidden email]> wrote:
I have been using Media Pro like this. I work on the same Catalog/Albums on
two different machines and have the image folder copied on both.

When I do all my work on one machine I later sync it with other by backing
up the Albums and Folder with chronosync which only syncs the changes and
not copying over everything again.

I tried that method with Digikam but it doesn't like the changes made to the
images folder or maybe I am not doing something right.



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

Tobias Bora
I just found an interesting way to do that if you are familiar with git, even if it's not really trivial. You can use the amazing "git annex" project to version control your collection, and even keep a partial version of it locally. Git-annex allows you to sync it between several ''remotes" (can be usb key, or even encrypted google doc…), and keep only the part of the collection you want locally (git-annex always make sure that the file is always present on at least one remote before dropping the files). And all classic text files are version controlled, as with classic git.

Now, the idea is to ask digikam to store metadata *in an external xmp files* (git-annex turn all big files in read only mode, so you won't be able to include metadata inside the photo directly). These xmp files would then be kept in the git repo, and you should now be able to merge the two repos when you synchronize again two remotes.

(NB: I've not tested this myself, but I know people have been using it)

Now, if you don't want to use sidecar xmp files, git-annex provides a wax to add metadata to any file. That way, you can say "keep on my computer only files with at least 3 stars". And I *think* (to be checked) that these metadata are also mergeable. Usually, they are exported from exif info, but you can specify manually new metadata for each file. The only issue is that digikam does not support this kind of tagging. I saw a thread where somebody wanted to implement git-annex metadata in digikam, but as far as I know the project was not finished.

Hope it can help,

--
tobiasBora

Le 18 septembre 2019 18:23:34 GMT+02:00, Andrey Goreev <[hidden email]> a écrit :
I do not think digiKam can do that...




On Wed, Sep 18, 2019 at 10:19 AM tsader <[hidden email]> wrote:
I have been using Media Pro like this. I work on the same Catalog/Albums on
two different machines and have the image folder copied on both.

When I do all my work on one machine I later sync it with other by backing
up the Albums and Folder with chronosync which only syncs the changes and
not copying over everything again.

I tried that method with Digikam but it doesn't like the changes made to the
images folder or maybe I am not doing something right.



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

tsader
I am not very familiar with Git-annex but I gave it another try with my way.
Also there doesn't seem to be a Mojave version

I have the Digikam databases on my Desktop and Albums/collection folders on
Desktop too.
Then I use Chronosync to backup both to my Laptop.

On my laptop, I open Digikam and in preferences, I have to link the
collections to the new location on my laptop.
Again, I make my changes, backup to my Dekstop.

It works fine except of course that I always have to change the location of
the collections in the preferences.
Which is ok I suppose.

The only downside is that if you delete a thumbnail and you keep it in the
digikam trash folder and then sync everything back to the other platform,
you won't see the change. You will see the same thumbnail in the collection
because it is linked to the new collection folder.

So one has to immediately delete the image permanently or things will become
confusing



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

Martin Burnicki-2
In reply to this post by AndriusWild
Andrey Goreev wrote:
> I do not think digiKam can do that...

Shouldn't this work if the collection is in a cloud folder like
Nextcloud (or Dropbox, FWIW)?

If you make changes to photo or an album (i.e. just the file or photo)
on one machine then the changes are synchronized to all machines that
share these folders, and if you start DK next time it will detect the
changes and update the local database accordingly.

But of course this is only going to work if you write tags and other
metadata to the image file or a sidecar file.

If you have configured DK to *not* write metadata (tags etc.) to the
files but keep them only in the DB you'd have to synchronize the
database in a consistent way, which can be much harder.

Martin
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

Sveinn í Felli-2
Þann 19.9.2019 08:49, skrifaði Martin Burnicki:

> Andrey Goreev wrote:
>> I do not think digiKam can do that...
>
> Shouldn't this work if the collection is in a cloud folder like
> Nextcloud (or Dropbox, FWIW)?
>
> If you make changes to photo or an album (i.e. just the file or photo)
> on one machine then the changes are synchronized to all machines that
> share these folders, and if you start DK next time it will detect the
> changes and update the local database accordingly.
>
> But of course this is only going to work if you write tags and other
> metadata to the image file or a sidecar file.
>
> If you have configured DK to *not* write metadata (tags etc.) to the
> files but keep them only in the DB you'd have to synchronize the
> database in a consistent way, which can be much harder.
>

IMHO it could be instructive to set up Nextcloud on a NAS over a LAN,
and try out how Digikam reacts to such synchronization - both databases
and image files. Probably I will test this kind of a setup, but not
until late October when time permits.

Nextcloud/OwnCloud has fine-grained access-controls for users/groups and
sharing, and has pretty advanced mechanisms for resolving conflicts in
case of simultaneous edits.

I presume that if using a synchronized database one would have to share
_all_ the files in each local collection _and_ the paths would have to
be the same on all devices, right?

Anything else obvious?

Best regards,
Sveinn í Felli
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

Gilles Caulier-4


Le jeu. 19 sept. 2019 à 11:33, Sveinn í Felli <[hidden email]> a écrit :
Þann 19.9.2019 08:49, skrifaði Martin Burnicki:
> Andrey Goreev wrote:
>> I do not think digiKam can do that...
>
> Shouldn't this work if the collection is in a cloud folder like
> Nextcloud (or Dropbox, FWIW)?
>
> If you make changes to photo or an album (i.e. just the file or photo)
> on one machine then the changes are synchronized to all machines that
> share these folders, and if you start DK next time it will detect the
> changes and update the local database accordingly.
>
> But of course this is only going to work if you write tags and other
> metadata to the image file or a sidecar file.
>
> If you have configured DK to *not* write metadata (tags etc.) to the
> files but keep them only in the DB you'd have to synchronize the
> database in a consistent way, which can be much harder.
>

IMHO it could be instructive to set up Nextcloud on a NAS over a LAN,
and try out how Digikam reacts to such synchronization - both databases
and image files. Probably I will test this kind of a setup, but not
until late October when time permits.

Nextcloud/OwnCloud has fine-grained access-controls for users/groups and
sharing, and has pretty advanced mechanisms for resolving conflicts in
case of simultaneous edits.

I presume that if using a synchronized database one would have to share
_all_ the files in each local collection _and_ the paths would have to
be the same on all devices, right?

yes, it's the best configuration but not the best design to work on multiple computer with a common database.

Also remember that no lock mechanism exists yet in DK database interface. So concurrent DB acess at the same time can corrupt data.

We have plenty of report/whish in bugzilla about this topic. We need to found a good student to work on this project. DB is an important part of DK.

Best

Gilles Caulier 

Anything else obvious?

Best regards,
Sveinn í Felli
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

Remco Viëtor
In reply to this post by Sveinn í Felli-2
On jeudi 19 septembre 2019 11:32:43 CEST Sveinn í Felli wrote:

> Þann 19.9.2019 08:49, skrifaði Martin Burnicki:
> > Andrey Goreev wrote:
> >> I do not think digiKam can do that...
> >
> > Shouldn't this work if the collection is in a cloud folder like
> > Nextcloud (or Dropbox, FWIW)?
> >
> > If you make changes to photo or an album (i.e. just the file or photo)
> > on one machine then the changes are synchronized to all machines that
> > share these folders, and if you start DK next time it will detect the
> > changes and update the local database accordingly.
> >
> > But of course this is only going to work if you write tags and other
> > metadata to the image file or a sidecar file.
> >
> > If you have configured DK to *not* write metadata (tags etc.) to the
> > files but keep them only in the DB you'd have to synchronize the
> > database in a consistent way, which can be much harder.
>
> IMHO it could be instructive to set up Nextcloud on a NAS over a LAN,
> and try out how Digikam reacts to such synchronization - both databases
> and image files. Probably I will test this kind of a setup, but not
> until late October when time permits.
>
> Nextcloud/OwnCloud has fine-grained access-controls for users/groups and
> sharing, and has pretty advanced mechanisms for resolving conflicts in
> case of simultaneous edits.
>
> I presume that if using a synchronized database one would have to share
> _all_ the files in each local collection _and_ the paths would have to
> be the same on all devices, right?
>
> Anything else obvious?

OP seems to want to be able to use a shared collection, and  modify it,
*without* network access, e.g. while travelling. That will mean he will have
to keep a copy of his collections on his local hard drive, and sync after each
trip.

If he's the only user of those collections, then the easiest would be to copy
collections and database(s) back and forth. That seems to be what he does now.

Having Digikam detect changes can be very slow, especially over a network (too
many files to read).

Remco.


Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

AndriusWild
In reply to this post by Sveinn í Felli-2
I thought the author wanted to cache images from NAS to a laptop while on LAN then work on the cached images while on a road and then sync the changes back to NAS when back home.

It is a brilliant idea but I don't think digiKam can do that.

Sent from my Samsung Galaxy smartphone.

-------- Original message --------
From: Sveinn í Felli <[hidden email]>
Date: 2019-09-19 3:32 a.m. (GMT-07:00)
Subject: Re: [digiKam-users] Sharing Database/Collections

Þann 19.9.2019 08:49, skrifaði Martin Burnicki:

> Andrey Goreev wrote:
>> I do not think digiKam can do that...
>
> Shouldn't this work if the collection is in a cloud folder like
> Nextcloud (or Dropbox, FWIW)?
>
> If you make changes to photo or an album (i.e. just the file or photo)
> on one machine then the changes are synchronized to all machines that
> share these folders, and if you start DK next time it will detect the
> changes and update the local database accordingly.
>
> But of course this is only going to work if you write tags and other
> metadata to the image file or a sidecar file.
>
> If you have configured DK to *not* write metadata (tags etc.) to the
> files but keep them only in the DB you'd have to synchronize the
> database in a consistent way, which can be much harder.
>

IMHO it could be instructive to set up Nextcloud on a NAS over a LAN,
and try out how Digikam reacts to such synchronization - both databases
and image files. Probably I will test this kind of a setup, but not
until late October when time permits.

Nextcloud/OwnCloud has fine-grained access-controls for users/groups and
sharing, and has pretty advanced mechanisms for resolving conflicts in
case of simultaneous edits.

I presume that if using a synchronized database one would have to share
_all_ the files in each local collection _and_ the paths would have to
be the same on all devices, right?

Anything else obvious?

Best regards,
Sveinn í Felli
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

Martin Burnicki-2
In reply to this post by Sveinn í Felli-2
Sveinn í Felli wrote:

> Þann 19.9.2019 08:49, skrifaði Martin Burnicki:
>> Andrey Goreev wrote:
>>> I do not think digiKam can do that...
>>
>> Shouldn't this work if the collection is in a cloud folder like
>> Nextcloud (or Dropbox, FWIW)?
>>
>> If you make changes to photo or an album (i.e. just the file or photo)
>> on one machine then the changes are synchronized to all machines that
>> share these folders, and if you start DK next time it will detect the
>> changes and update the local database accordingly.
>>
>> But of course this is only going to work if you write tags and other
>> metadata to the image file or a sidecar file.
>>
>> If you have configured DK to *not* write metadata (tags etc.) to the
>> files but keep them only in the DB you'd have to synchronize the
>> database in a consistent way, which can be much harder.
>>
>
> IMHO it could be instructive to set up Nextcloud on a NAS over a LAN,
> and try out how Digikam reacts to such synchronization - both databases
> and image files. Probably I will test this kind of a setup, but not
> until late October when time permits.

Hm, this sounds as if you intend to work directly on the NAS, across the
LAN. This won't work when the NAS is not accessible, e.g. from a laptop
that has no network connection.

My suggestion would be to have a local copy of the collection on the
laptop, so you can edit images, and reorder images and albums locally on
your laptop, as required.

When the laptop has a network connection again, the edited/moved files
and folders would be first synchronized to the cloud, and then to other
machines (e.g. PCs) that share the same collection folders.

If you start DK on one of the other machines it detects the changes and
updates its DB. This also works in the reverse direction: if you make
changes on the PC then the changes will be synchronized to the laptop
when the laptop is powered up next time with a network connection.

> Nextcloud/OwnCloud has fine-grained access-controls for users/groups and
> sharing, and has pretty advanced mechanisms for resolving conflicts in
> case of simultaneous edits.
>
> I presume that if using a synchronized database one would have to share
> _all_ the files in each local collection _and_ the paths would have to
> be the same on all devices, right?

Right. That's what I meant, see above. But of course you could organize
your collection in a way that only specific albums/folders are
synchronized via the cloud.

However, from my understanding, synchronizing the DB between the machine
will only work without problems if you use sqlite as DB, and if all
machines run the same DK version, i.e. expect the same DB layout.

If your DB uses mysql then I'd expect that you run into huge problems if
you try to synchronized the DB by just synchronizing its files.

If you keep the databases only locally then there should be no problems
at all, if you only synchronize files and folders, even if you run
different version of DK on different machines. But, as said earlier,
this works for metadata (tags etc.) only if they are written into the
image or sidecar files.

Martin
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

tsader
In reply to this post by Martin Burnicki-2
Unfortunately, Dropbox/Nextcloud isn't an option for me because I don't have
enough storage space in the cloud



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

BensonBear
In reply to this post by tsader
tsader wrote
> I would like to be able to work on my collections on a laptop when away
> and
> then be able to sync with my desktop.

This is what I want to do also.   You can sync the actual photos using
something like rsync, but the problem is the database.  You have to alter
the database so that it finds the collections on the one machine, then alter
it again so it finds the collections on the other machine.  

I thought that this would require only changing one line for each collection
in the AlbumRoots table.  This does seem to work, except that it  seems to
cause each individual photo to be  examined again by digikam when it starts
up.  I am fervently hoping that there is a way around this -- probably some
other necessary change I have overlooked.
 
In any case, this /will/ work provided  you don't mind digikam taking a long
time to start up each time you switch from one machine to the other.  Is
that adequate for you?




--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html
Reply | Threaded
Open this post in threaded view
|

Re: Sharing Database/Collections

leoutation
On 9/29/19 1:37 PM, BensonBear wrote:

> tsader wrote
>> I would like to be able to work on my collections on a laptop when away
>> and
>> then be able to sync with my desktop.
>
> This is what I want to do also.   You can sync the actual photos using
> something like rsync, but the problem is the database.  You have to alter
> the database so that it finds the collections on the one machine, then alter
> it again so it finds the collections on the other machine.
>

You can sync Mariadb databases with Replication
https://mariadb.com/kb/en/library/replication-overview/

HOWTO Use rsync To Synchronise MySQL Databases
http://mah.everybody.org/docs/mysql-rsync

--
Maderios
12