Backup options?? probably off topic
Locked
 
|
Hi All,
I am not sure this is the proper channel but I could not find any other digiKam forum Digikam strong area is organization and exporting to other places. Now, I am looking for backup options. The easiest way is just to copy all files from my local album to 2 external drives. Problem is Once I made the first copy, how can I keep updating only photos I have been changing. I am going back and editing old photos but no tin a very organized way. Does digiKam provide backup options like incremental backup (copy only what is new or changed)? Thanks! _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
Re: Backup options?? probably off topic
|
|
Hi Fabio,
Yes this is the wrong place to discuss this. Backup should be done by an external program or the operating system. I personally use rsync for incremental back ups. Other solutions exist, just search for "backup <your OS>". Regards, Christoph On Wednesday, July 17, 2013, Fabio wrote: Hi All, -- Christoph Siedentop 0176-399-422-45 _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
Re: Backup options?? probably off topic
|
|
I use Unison on Linux, works well for me.
On 17/07/13 09:01, Christoph Siedentop wrote: _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
Re: Backup options?? probably off topic
|
|
In reply to this post by Christoph Siedentop-2
At home, backup is done through local network using a NAS (12Tb). It's
a B3 device with RAID unit. http://www.excitostore.com/content/features On my host computer, i have the same HDD capacity. I run sync command to synchronize NAS with my whole digiKam collection. Gilles Caulier 2013/7/17 Christoph Siedentop <[hidden email]>: > Hi Fabio, > > Yes this is the wrong place to discuss this. Backup should be done by an > external program or the operating system. > > However, if you want to backup digikam it would be best to write your > metadata to sidecar xmp files. If all your tags, for example, are in the > database, you can back that up but it is easier if the data is right next to > each file. > > I personally use rsync for incremental back ups. Other solutions exist, just > search for "backup <your OS>". > > Regards, > Christoph > > > On Wednesday, July 17, 2013, Fabio wrote: >> >> Hi All, >> >> I am not sure this is the proper channel but I could not find any other >> digiKam forum >> >> Digikam strong area is organization and exporting to other places. Now, I >> am looking for backup options. The easiest way is just to copy all files >> from my local album to 2 external drives. Problem is Once I made the first >> copy, how can I keep updating only photos I have been changing. I am going >> back and editing old photos but no tin a very organized way. >> >> Does digiKam provide backup options like incremental backup (copy only >> what is new or changed)? >> >> >> Thanks! >> _______________________________________________ >> Digikam-users mailing list >> [hidden email] >> https://mail.kde.org/mailman/listinfo/digikam-users > > > > -- > Christoph Siedentop > 0176-399-422-45 > > _______________________________________________ > Digikam-users mailing list > [hidden email] > https://mail.kde.org/mailman/listinfo/digikam-users > Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
|
|
In reply to this post by Christoph Siedentop-2
I use grsync to do all my backups.
Marie-Noëlle 2013/7/17 Christoph Siedentop <[hidden email]> Hi Fabio, --  De l'AIgoual à l'Aubrac, un voyage photographique en Cévennes et Lozère
Un livre à offrir ou à s'offrir, en souscription jusqu'au 31 août 2013. Cliquer sur l'image ci-dessus ou ce lien pour en savoir plus _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
Re: Backup options?? probably off topic
|
|
In reply to this post by Gilles Caulier-4
I'm using BackupPc on linux to backup all my network
Claude Gelinas agr. Phyto Ressources Inc. Le 2013-07-17 à 04:12, Gilles Caulier <[hidden email]> a écrit : > At home, backup is done through local network using a NAS (12Tb). It's > a B3 device with RAID unit. > > http://www.excitostore.com/content/features > > On my host computer, i have the same HDD capacity. I run sync command > to synchronize NAS with my whole digiKam collection. > > Gilles Caulier > > 2013/7/17 Christoph Siedentop <[hidden email]>: >> Hi Fabio, >> >> Yes this is the wrong place to discuss this. Backup should be done by an >> external program or the operating system. >> >> However, if you want to backup digikam it would be best to write your >> metadata to sidecar xmp files. If all your tags, for example, are in the >> database, you can back that up but it is easier if the data is right next to >> each file. >> >> I personally use rsync for incremental back ups. Other solutions exist, just >> search for "backup <your OS>". >> >> Regards, >> Christoph >> >> >> On Wednesday, July 17, 2013, Fabio wrote: >>> >>> Hi All, >>> >>> I am not sure this is the proper channel but I could not find any other >>> digiKam forum >>> >>> Digikam strong area is organization and exporting to other places. Now, I >>> am looking for backup options. The easiest way is just to copy all files >>> from my local album to 2 external drives. Problem is Once I made the first >>> copy, how can I keep updating only photos I have been changing. I am going >>> back and editing old photos but no tin a very organized way. >>> >>> Does digiKam provide backup options like incremental backup (copy only >>> what is new or changed)? >>> >>> >>> Thanks! >>> _______________________________________________ >>> Digikam-users mailing list >>> [hidden email] >>> https://mail.kde.org/mailman/listinfo/digikam-users >> >> >> >> -- >> Christoph Siedentop >> 0176-399-422-45 >> >> _______________________________________________ >> Digikam-users mailing list >> [hidden email] >> https://mail.kde.org/mailman/listinfo/digikam-users > _______________________________________________ > Digikam-users mailing list > [hidden email] > https://mail.kde.org/mailman/listinfo/digikam-users > Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
|
|
I'm using DirSyncPo, it's Java; so it can be used on Win and Linux
|
Re: Backup options?? probably off topic
|
|
In reply to this post by Fabio
Fabio píše v Út 16. 07. 2013 v 22:34 -0400:
> Does digiKam provide backup options like incremental backup (copy only > what is new or changed)? > I use ZFS snapshots and their incremental export to a backup disk. Mac's OS X has Time Machine, which is kind of rsync with the use of hardlinks (hence providing snapshots while saving space). In other words, there is a lot of solutions available, just take your time to study and find what fits your needs and operating system. Milan -- http://milan-knizek.net/ About linux and photography (Czech only) O linuxu a fotografování _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
Re: Backup options?? probably off topic
|
|
In reply to this post by Fabio
On 17/07/13 12:34, Fabio wrote:
> Hi All, > > I am not sure this is the proper channel but I could not find any other > digiKam forum > > Digikam strong area is organization and exporting to other places. Now, > I am looking for backup options. The easiest way is just to copy all > files from my local album to 2 external drives. Problem is Once I made > the first copy, how can I keep updating only photos I have been > changing. I am going back and editing old photos but no tin a very > organized way. > > Does digiKam provide backup options like incremental backup (copy only > what is new or changed)? > > > Thanks! > _______________________________________________ > Digikam-users mailing list > [hidden email] > https://mail.kde.org/mailman/listinfo/digikam-users Fabio, Very large image collections, as created by digiKam, creates a unique scenario and so I think it is not that "off topic" to ask the question on this forum. The way that digiKam works is to catalog all the images and associated metadata in a database; usually stored in the top most directory of your albums. Although uncommon this lists has reports of people trying to recover their tags and metadata from corrupted databases as they have not ensured that this information is stored elsewhere. DigiKam provides the ability to save metadata to associated XMP files and to store metadata tags, copyright information and captions inside the files (JPGs only). I would recommend you do this -- it generally does not have a significant overhead. This option allows you, in the circumstance where you database becomes corrupt to recreate your database based on the information stored in these files. The next issue is conventional backup. Albums are just directories so are easily backed up using any of the packages mentioned (rsync, Unison, BackupPC, grsync, Timemachine). Ideally you should have all your electronic files backup, so asking the question is a little bit of a concern :). To help... 1. Solutions are either GUI-based or Script-based. GUI-based solutions are good to get you going. Script-based solutions require some level of "programming" so you will need to take the time to read the manual, construct a script and test it. 2. Ensure your backup creates a mirror of your original files. That way if your primary disk dies you can just start using one of your backups. Some incremental software bundles zip collections or compress the files and you need to uncompress and reconstruct your original collection if you wish to recover your files. This can be a nightmare! 3. You need to decide if you want some level of versioning. If you mirror your collection and corrupt a file unknowingly you can have the corrupt file copied to you backup resulting in the loss of the original good file. In general, due to size of most people's collections people don't create versions. If you use scripts however it is pretty easy to make copies of your collection for each month. Hard disk space is cheap and a script that copies originals to a safe place for a couple of months are not that hard to make. All that said, I will tell you what I use... On Windows I use RoboCopy. It is a command line program that can have instructions kept in a batch file. The program is free from Microsoft. The syntax is easy... for example... robocopy c:\images \\backup\images /mir /ns /R:2 /NP /NDL /Purge /tee I have tried a range of packages on Windows but the only software I liked was AllwaySync -- a good application for small collections. http://allwaysync.com/ *I now primarily use Linux*. All my backup is automated using rsync. This package is very much the same as RoboCopy. You insert a series of commands in a script file and run the script. My script creates a mirror of my entire network, including my image collection. Again the syntax is easy... another example... rsync -rltvz --stats --delete --ignore-errors /home/simon /media/backup In some situations, on Linux, where I want short term backup solutions I use FreeFileSync. It is easy to use and to create simple backup options. http://freefilesync.sourceforge.net/ Remember... A. Backing up large collections over a network can take forever. Make your initial backup by connecting your backup drive to your computer via USB or actually plugging it in (internally). Then move it to a remote location once the backups are completed. Incremental backups should not be too much of a load on a normal network. B. All backups require you to be able to "see" the backups. If you temporarily connect a USB drive this is not a problem for either Linux or Windows. When you work with remote computers however it is usually easier to mount the drives. On Windows this is done by mounting a directory on your backup drive to a letter. This allows you to insert your name and password once and have that mounted drive open whenever it is available. On Linux, this is a little trickier. Mounting is done using the mount command and requires a little effort and testing. The exact syntax depends entirely on the distro (e.g. Ubuntu, RedHat), hard disk format (e.g. ext3, ext4, NTFS, FAT32) and connection strategy (e.g. NFS, CIFS). -- Cheers Simon Simon Cropper - Open Content Creator Free and Open Source Software Workflow Guides ------------------------------------------------------------ Introduction http://www.fossworkflowguides.com GIS Packages http://www.fossworkflowguides.com/gis bash / Python http://www.fossworkflowguides.com/scripting _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
|
|
Le Thu, 18 Jul 2013 02:07:55 +0200, Simon Cropper
<[hidden email]> a écrit: > On 17/07/13 12:34, Fabio wrote: >> Hi All, >> >> I am not sure this is the proper channel but I could not find any other >> digiKam forum >> >> Digikam strong area is organization and exporting to other places. Now, >> I am looking for backup options. The easiest way is just to copy all >> files from my local album to 2 external drives. Problem is Once I made >> the first copy, how can I keep updating only photos I have been >> changing. I am going back and editing old photos but no tin a very >> organized way. >> >> Does digiKam provide backup options like incremental backup (copy only >> what is new or changed)? >> >> >> Thanks! >> _______________________________________________ >> Digikam-users mailing list >> [hidden email] >> https://mail.kde.org/mailman/listinfo/digikam-users > > Fabio, > > Very large image collections, as created by digiKam, creates a unique > scenario and so I think it is not that "off topic" to ask the question > on this forum. > > The way that digiKam works is to catalog all the images and associated > metadata in a database; usually stored in the top most directory of your > albums. Although uncommon this lists has reports of people trying to > recover their tags and metadata from corrupted databases as they have > not ensured that this information is stored elsewhere. > > DigiKam provides the ability to save metadata to associated XMP files > and to store metadata tags, copyright information and captions inside > the files (JPGs only). I would recommend you do this -- it generally > does not have a significant overhead. This option allows you, in the > circumstance where you database becomes corrupt to recreate your > database based on the information stored in these files. Storing metadata works with some RAW files too. I use Digikam for this almost without issues. I had two or three times some fright due to some Exvi2 issue few years ago, but most files had been repaired. XMP files could be a nice option too because it make much less MB to synchronize/backup, I should test again since the feature seems mature now, and for the story a "long" time ago backup for picture only if the included metadatas had changed was not possible since the file attribut "modify date" was not changed by Digikam, but it's fixed from a long time now. > The next issue is conventional backup. Albums are just directories so > are easily backed up using any of the packages mentioned (rsync, Unison, > BackupPC, grsync, Timemachine). Ideally you should have all your > electronic files backup, so asking the question is a little bit of a > concern :). > > To help... > 1. Solutions are either GUI-based or Script-based. GUI-based solutions > are good to get you going. Script-based solutions require some level of > "programming" so you will need to take the time to read the manual, > construct a script and test it. > 2. Ensure your backup creates a mirror of your original files. That way > if your primary disk dies you can just start using one of your backups. > Some incremental software bundles zip collections or compress the files > and you need to uncompress and reconstruct your original collection if > you wish to recover your files. This can be a nightmare! > 3. You need to decide if you want some level of versioning. If you > mirror your collection and corrupt a file unknowingly you can have the > corrupt file copied to you backup resulting in the loss of the original > good file. In general, due to size of most people's collections people > don't create versions. If you use scripts however it is pretty easy to > make copies of your collection for each month. Hard disk space is cheap > and a script that copies originals to a safe place for a couple of > months are not that hard to make. Versioning is a good question and YES, it take much much place on a hard drive. Since in my mind the main importance thing is my pictures integrity and only after comes the metadata/treatments preservation, here what I do : -I import my pictures with Rapid-photo-downloader which offers possibility to rename and organize the pictures in folder depending of their metadatas like digikam, but, unlike Digikam (except if I missed this new feature ?), permit to set a backup import location. This way I potentially always have my original picture (the better could be this backup location was a mirror RAID) - I try to backup my active working directory regularly with a sync program. > > All that said, I will tell you what I use... > > On Windows I use RoboCopy. It is a command line program that can have > instructions kept in a batch file. The program is free from Microsoft. > The syntax is easy... for example... > > robocopy c:\images \\backup\images /mir /ns /R:2 /NP /NDL /Purge /tee > > I have tried a range of packages on Windows but the only software I > liked was AllwaySync -- a good application for small collections. > > http://allwaysync.com/ > > *I now primarily use Linux*. All my backup is automated using rsync. > This package is very much the same as RoboCopy. You insert a series of > commands in a script file and run the script. My script creates a mirror > of my entire network, including my image collection. Again the syntax is > easy... another example... > > rsync -rltvz --stats --delete --ignore-errors /home/simon /media/backup > > In some situations, on Linux, where I want short term backup solutions I > use FreeFileSync. It is easy to use and to create simple backup options. > > http://freefilesync.sourceforge.net/ I was using FreeFileSync sometimes ago, but I was not sure it was still maintain. It is a good news it was since it is really a simple and efficient sync GUI programm with different sync mode. > > Remember... > A. Backing up large collections over a network can take forever. Make > your initial backup by connecting your backup drive to your computer via > USB or actually plugging it in (internally). Then move it to a remote > location once the backups are completed. Incremental backups should not > be too much of a load on a normal network. > B. All backups require you to be able to "see" the backups. If you > temporarily connect a USB drive this is not a problem for either Linux > or Windows. When you work with remote computers however it is usually > easier to mount the drives. On Windows this is done by mounting a > directory on your backup drive to a letter. This allows you to insert > your name and password once and have that mounted drive open whenever it > is available. On Linux, this is a little trickier. Mounting is done > using the mount command and requires a little effort and testing. The > exact syntax depends entirely on the distro (e.g. Ubuntu, RedHat), hard > disk format (e.g. ext3, ext4, NTFS, FAT32) and connection strategy (e.g. > NFS, CIFS). > -- Nicolas Boulesteix Photographe chasseur de lueurs http://www.photonoxx.fr _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
Re: Backup options?? probably off topic
|
|
In reply to this post by Simon Cropper-3
I agree with everything that has been said on this topic, just one thing
I would like to add. Once you have your backup strategy sorted - TEST IT!! Over the years I have come across many people who have religiously made backups on a regular basis only to find that when disaster happens they cannot retrieve from the backups they have made for whatever reason. Using a different computer, take your backups and try to recreate your system without using your original machine at all. Then you know it works:) Mick On 18/07/13 01:07, Simon Cropper wrote: > On 17/07/13 12:34, Fabio wrote: > ............ _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
Re: Backup options?? probably off topic
|
|
In reply to this post by Gilles Caulier-4
On Wednesday 17 July 2013 10:12:13 Gilles Caulier wrote:
> At home, backup is done through local network using a NAS (12Tb). It's > a B3 device with RAID unit. By the way, which RAID unit are you using? > > http://www.excitostore.com/content/features > > On my host computer, i have the same HDD capacity. I run sync command > to synchronize NAS with my whole digiKam collection. > > Gilles Caulier > > 2013/7/17 Christoph Siedentop <[hidden email]>: > > Hi Fabio, > > > > Yes this is the wrong place to discuss this. Backup should be done by an > > external program or the operating system. > > > > However, if you want to backup digikam it would be best to write your > > metadata to sidecar xmp files. If all your tags, for example, are in the > > database, you can back that up but it is easier if the data is right next > > to each file. > > > > I personally use rsync for incremental back ups. Other solutions exist, > > just search for "backup <your OS>". > > > > Regards, > > Christoph > > > > On Wednesday, July 17, 2013, Fabio wrote: > >> Hi All, > >> > >> I am not sure this is the proper channel but I could not find any other > >> digiKam forum > >> > >> Digikam strong area is organization and exporting to other places. Now, I > >> am looking for backup options. The easiest way is just to copy all files > >> from my local album to 2 external drives. Problem is Once I made the > >> first > >> copy, how can I keep updating only photos I have been changing. I am > >> going > >> back and editing old photos but no tin a very organized way. > >> > >> Does digiKam provide backup options like incremental backup (copy only > >> what is new or changed)? > >> > >> > >> Thanks! > >> _______________________________________________ > >> Digikam-users mailing list > >> [hidden email] > >> https://mail.kde.org/mailman/listinfo/digikam-users > > > > -- > > Christoph Siedentop > > 0176-399-422-45 > > > > _______________________________________________ > > Digikam-users mailing list > > [hidden email] > > https://mail.kde.org/mailman/listinfo/digikam-users > > _______________________________________________ > Digikam-users mailing list > [hidden email] > https://mail.kde.org/mailman/listinfo/digikam-users _______________________________________________ Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
Re: Backup options?? probably off topic
|
|
This one :
http://www.raidon.com.tw/RAIDON2013/enweb/en_product_web/en_safetank/en_GR5630-SB3.html Work perfectly under Linux... Gilles Caulier 2013/8/5 Wolfgang Mader <[hidden email]>: > On Wednesday 17 July 2013 10:12:13 Gilles Caulier wrote: >> At home, backup is done through local network using a NAS (12Tb). It's >> a B3 device with RAID unit. > > By the way, which RAID unit are you using? > >> >> http://www.excitostore.com/content/features >> >> On my host computer, i have the same HDD capacity. I run sync command >> to synchronize NAS with my whole digiKam collection. >> >> Gilles Caulier >> >> 2013/7/17 Christoph Siedentop <[hidden email]>: >> > Hi Fabio, >> > >> > Yes this is the wrong place to discuss this. Backup should be done by an >> > external program or the operating system. >> > >> > However, if you want to backup digikam it would be best to write your >> > metadata to sidecar xmp files. If all your tags, for example, are in the >> > database, you can back that up but it is easier if the data is right next >> > to each file. >> > >> > I personally use rsync for incremental back ups. Other solutions exist, >> > just search for "backup <your OS>". >> > >> > Regards, >> > Christoph >> > >> > On Wednesday, July 17, 2013, Fabio wrote: >> >> Hi All, >> >> >> >> I am not sure this is the proper channel but I could not find any other >> >> digiKam forum >> >> >> >> Digikam strong area is organization and exporting to other places. Now, I >> >> am looking for backup options. The easiest way is just to copy all files >> >> from my local album to 2 external drives. Problem is Once I made the >> >> first >> >> copy, how can I keep updating only photos I have been changing. I am >> >> going >> >> back and editing old photos but no tin a very organized way. >> >> >> >> Does digiKam provide backup options like incremental backup (copy only >> >> what is new or changed)? >> >> >> >> >> >> Thanks! >> >> _______________________________________________ >> >> Digikam-users mailing list >> >> [hidden email] >> >> https://mail.kde.org/mailman/listinfo/digikam-users >> > >> > -- >> > Christoph Siedentop >> > 0176-399-422-45 >> > >> > _______________________________________________ >> > Digikam-users mailing list >> > [hidden email] >> > https://mail.kde.org/mailman/listinfo/digikam-users >> >> _______________________________________________ >> Digikam-users mailing list >> [hidden email] >> https://mail.kde.org/mailman/listinfo/digikam-users > > _______________________________________________ > Digikam-users mailing list > [hidden email] > https://mail.kde.org/mailman/listinfo/digikam-users Digikam-users mailing list [hidden email] https://mail.kde.org/mailman/listinfo/digikam-users |
«
Return to digikam-users
|
1 view|%1 views
| Free forum by Nabble | Edit this page |