Digikam raw files and darktable

classic Classic list List threaded Threaded
79 messages Options
1234
Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

hajo
isn't that more of a DT issue first - some sort of stack branching, a la revision control including a preview per branch? Or export, for that matter ;)

On Sun, 8 Jan 2017 at 09:40, Juan Jose Casafranca <[hidden email]> wrote:
Thats a way of doing things. I usually do different editions and I dont export any of them at least I need to send them somewhere. Thats why I need to see the different views for the different xmps :-)

El 8 ene. 2017 2:35, "HaJo Schatz" <[hidden email]> escribió:
I usually do a "base development" of each RAW. then export this. Then I have some pre-set styles I might apply, e.g. a specific B/W style. That goes on top of my base development. I'd like to have JPEGs exported at both steps and grouped properly, then my world would be fine :)

On Sun, 8 Jan 2017 at 09:30, Juan Jose Casafranca <[hidden email]> wrote:
I don't know about grouping. Each time I have tried to use DK as my management software I quit because I can't update the thumbnails... 

If you develop your edits as JPEG because you have several of them, how do you later continue developing one of them because you want to do something else from that point? If you modify the history to do a completely different edit, you lose the other. If you duplicate in DT your image, you cant see both files in DK. If you duplicate the whole raw file so you can see it in DK, you don't know which one is each because thumbnails are outdated and don't represent what the editor has done with the raw file. 

That's why I want a way to update thumbnails and previews with the current editing history...

2017-01-08 2:20 GMT+01:00 HaJo Schatz <[hidden email]>:
Just saw this now and have been far far away from DK & DT for a long time, so sorry if I speak outdated:

I tried to combine both for my workflow before, with limited success. What I wished for back then was a proper solution in DK for grouping. I wouldn't mind developing my edits into JPEGs (actually want to, since I may have multiple edits as someone said earlier). In the past DK didn't group them well, that's where I had issues. If grouping is working well now I think the preview topic is not really a serious shortcoming, no?


On Sun, 8 Jan 2017 at 01:27, Juan Jose Casafranca <[hidden email]> wrote:
Could you look if there is anyway to ask darktable for an image through DBus? The image should be returned without been saved in disk. 
(As a char* for example). 

Right now I'm trying to understand how digikam asks for the thumbnails and for the preview images so I can ask for them when it's necessary. 

2017-01-07 18:20 GMT+01:00 Andrey Goreev <[hidden email]>:
I agree 100%. I am willing to help if needed 



Sent from my Samsung Galaxy smartphone.

-------- Original message --------
From: Juan Jose Casafranca <[hidden email]>
Date: 2017-01-07 9:30 AM (GMT-07:00)
To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]>
Subject: Re: Digikam raw files and darktable

Yes, I don't want digikam developers to do this. I understand that they have their own roadmap. Opensource strength is the possibility for any user to propose changes and implement them if they know how to do it :-)

I'm already coding a kind of very stupid version of what I want, just to play around with it and see how things can be done. But I must say that it looks pretty simple. This first toy code is just calling darktable-cli, saving an image to disk and loading it as a thubnail. Its just to see how things could be done afterwards :-)

I also think the DBus option is the best one, although it's only Linux available so I will have a look at it

2017-01-07 17:25 GMT+01:00 Andrey Goreev <[hidden email]>:
We definitely don't want digikam developers to do any extra work for that. They have their roadmap and want to stay on it. What we want from them is to tell us how could importing thumbnails from darktable to digikam be done with absolute minimal changes in the digikam code. Am I correct ?

Also, if the Linux only solution (DBus) is the simplest solution I think we should stick to it. I am actually a windows user and there is no darktable version for Windows so I created a designated virtual machine (ubuntu studio) and do all DAM and photo / video processing there. The pictures folder can be accessed from both Windows and Linux so there is nothing that needs to be done twice. Any changes can be seen in any OS.


Sent from my Samsung Galaxy smartphone.

-------- Original message --------
From: Juan Jose Casafranca <[hidden email]>
Date: 2017-01-07 8:59 AM (GMT-07:00)
To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]>
Subject: Re: Digikam raw files and darktable



2017-01-07 16:22 GMT+01:00 Gilles Caulier <[hidden email]>:


2017-01-07 15:41 GMT+01:00 Juan Jose Casafranca <[hidden email]>:
On sábado, 7 de enero de 2017 15:25:43 (CET) Gilles Caulier wrote:


> 2017-01-07 15:22 GMT+01:00 Juan Jose Casafranca <[hidden email]>:


> > On sábado, 7 de enero de 2017 15:14:09 (CET) Gilles Caulier wrote:


> > > 2017-01-07 15:08 GMT+01:00 Juan Jose Casafranca <[hidden email]>:


> > > > On sábado, 7 de enero de 2017 15:03:38 (CET) Gilles Caulier wrote:


> > > > > As i explain before, ALL thumbnails generated by digiKam are stored


> >


> > in a


> >


> > > > > dedicated database (sqlite or Mysql).


> > > > >


> > > > > The thumbnails are stored using wavelets compression format PGF to


> > > >


> > > > optimize


> > > >


> > > > > space. In older DK version (3 for ex), we use FreeDesktop way with


> >


> > PNG


> >


> > > > > which explode storage for huge collection and take a while to store


> > > > > thumbnails files. Also FreeDesktop recommendations is only limited


> > > > > to


> > > > > 256x256, which is not enough for Hdpi screen (digiKam can store


> >


> > 512x512


> >


> > > > and


> > > >


> > > > > perhaps more in the future with 8K screen).


> > > >


> > > > Okay. But there is no need to change anything in DK for storing


> > > > thumbnails.


> > > > The only thing needed is to change the way thumbnails are generated


> > > > and


> > > > updated for raw files.


> > > >


> > > > Simply, when DK finds a new raw file, instead of loading the embedded


> >


> > jpg


> >


> > > > file,


> > > > simply call the raw processor and generate the new file. And when the


> > > > thumbnail


> > > > is dirty (as I explained before), regenerate the thumbnail.


> > >


> > > But this is already the case. We use already a raw decoder named libraw


> >


> > to


> >


> > > process RAW thumbnails. We will not using another one... Stop to puzzle


> >


> > the


> >


> > > code


> > >


> > > Gilles Caulier


> >


> > So you are telling me that if we want to process a raw file and manage a


> > library with DK, we have to stay with the simply DK raw processor instead


> > of


> > using a much more powerful one like darktable? Do you really think that


> > people


> > out there use the DK raw processor to process their images?


>


> But digiKam is not DarkTable.  The way to mix both cannot be done. This is


> 2 different applications, one written in Qt other one in GTK...


>


> The goal currently in DK is to stabilize the code, reduce dependencies,


> improve port to non Linux. We have plenty of jobs to do, DarkTable is not a


> priority for the moment.


>


> Gilles Caulier





I know that they are two different apps. I dont understand why GTK and Qt is


even a question here. I'm not saying to add DT as a depency for DK, just let


the user decide which raw processor uses.

But Raw processor from DT is not the same than DK as i know. Changing Raw processor in digiKam by DT one is as to add DT dependencies to DK.  No way here...

I'm not asking to change the raw processor. Just asking to allow the user which raw processor wants to use. If the user selects to use DT, simply make him enter the DT executable which will be called when the raw file must be processed. No dependency needed.
 





As I said, I can try to develop this by myself, I'm not asking any dedicated


DK developer to do it... What I only need is a little guideline on how the


thumbnails are generated, how they are stored in the database and some other


stuff for letting the user choose which processor wants to choose.

2 possibilities :

1/ use DBus to ping digiKam core about thumbnails changed externally. Only Linux solution. 

2/ use XMP sidecar to store a local path to new thumbnails processed into DT XMP namespace. I don't like this too much by at least it store the minimum to XMP.

3/ store wavelets compressed preview in XMP sidecar to Iptc.Application2.Preview

4/ use a thumbnail sidecar file near RAW file as .thumb. I see this solution already used under Windows, but i don't remember which application exactly. I know that Canon camera do it also. It's a simple JPEG file with metadata This way will duplicata data of course.

Gilles Caulier




















Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Juan Jose Casafranca
Currently, DT allows to duplicate a "raw file". What this does is to duplicate the xmp file where the history is stored. 

So what Im trying to do is to load this xmps, generate two views in DK where each of them have the correct thumbnail and preview.

There is nothing to be done in DT, although some kind of revision history as the one used in git will be marbelous :-)

El 8 ene. 2017 2:49, "HaJo Schatz" <[hidden email]> escribió:
isn't that more of a DT issue first - some sort of stack branching, a la revision control including a preview per branch? Or export, for that matter ;)

On Sun, 8 Jan 2017 at 09:40, Juan Jose Casafranca <[hidden email]> wrote:
Thats a way of doing things. I usually do different editions and I dont export any of them at least I need to send them somewhere. Thats why I need to see the different views for the different xmps :-)

El 8 ene. 2017 2:35, "HaJo Schatz" <[hidden email]> escribió:
I usually do a "base development" of each RAW. then export this. Then I have some pre-set styles I might apply, e.g. a specific B/W style. That goes on top of my base development. I'd like to have JPEGs exported at both steps and grouped properly, then my world would be fine :)

On Sun, 8 Jan 2017 at 09:30, Juan Jose Casafranca <[hidden email]> wrote:
I don't know about grouping. Each time I have tried to use DK as my management software I quit because I can't update the thumbnails... 

If you develop your edits as JPEG because you have several of them, how do you later continue developing one of them because you want to do something else from that point? If you modify the history to do a completely different edit, you lose the other. If you duplicate in DT your image, you cant see both files in DK. If you duplicate the whole raw file so you can see it in DK, you don't know which one is each because thumbnails are outdated and don't represent what the editor has done with the raw file. 

That's why I want a way to update thumbnails and previews with the current editing history...

2017-01-08 2:20 GMT+01:00 HaJo Schatz <[hidden email]>:
Just saw this now and have been far far away from DK & DT for a long time, so sorry if I speak outdated:

I tried to combine both for my workflow before, with limited success. What I wished for back then was a proper solution in DK for grouping. I wouldn't mind developing my edits into JPEGs (actually want to, since I may have multiple edits as someone said earlier). In the past DK didn't group them well, that's where I had issues. If grouping is working well now I think the preview topic is not really a serious shortcoming, no?


On Sun, 8 Jan 2017 at 01:27, Juan Jose Casafranca <[hidden email]> wrote:
Could you look if there is anyway to ask darktable for an image through DBus? The image should be returned without been saved in disk. 
(As a char* for example). 

Right now I'm trying to understand how digikam asks for the thumbnails and for the preview images so I can ask for them when it's necessary. 

2017-01-07 18:20 GMT+01:00 Andrey Goreev <[hidden email]>:
I agree 100%. I am willing to help if needed 



Sent from my Samsung Galaxy smartphone.

-------- Original message --------
From: Juan Jose Casafranca <[hidden email]>
Date: 2017-01-07 9:30 AM (GMT-07:00)
To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]>
Subject: Re: Digikam raw files and darktable

Yes, I don't want digikam developers to do this. I understand that they have their own roadmap. Opensource strength is the possibility for any user to propose changes and implement them if they know how to do it :-)

I'm already coding a kind of very stupid version of what I want, just to play around with it and see how things can be done. But I must say that it looks pretty simple. This first toy code is just calling darktable-cli, saving an image to disk and loading it as a thubnail. Its just to see how things could be done afterwards :-)

I also think the DBus option is the best one, although it's only Linux available so I will have a look at it

2017-01-07 17:25 GMT+01:00 Andrey Goreev <[hidden email]>:
We definitely don't want digikam developers to do any extra work for that. They have their roadmap and want to stay on it. What we want from them is to tell us how could importing thumbnails from darktable to digikam be done with absolute minimal changes in the digikam code. Am I correct ?

Also, if the Linux only solution (DBus) is the simplest solution I think we should stick to it. I am actually a windows user and there is no darktable version for Windows so I created a designated virtual machine (ubuntu studio) and do all DAM and photo / video processing there. The pictures folder can be accessed from both Windows and Linux so there is nothing that needs to be done twice. Any changes can be seen in any OS.


Sent from my Samsung Galaxy smartphone.

-------- Original message --------
From: Juan Jose Casafranca <[hidden email]>
Date: 2017-01-07 8:59 AM (GMT-07:00)
To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]>
Subject: Re: Digikam raw files and darktable



2017-01-07 16:22 GMT+01:00 Gilles Caulier <[hidden email]>:


2017-01-07 15:41 GMT+01:00 Juan Jose Casafranca <[hidden email]>:
On sábado, 7 de enero de 2017 15:25:43 (CET) Gilles Caulier wrote:


> 2017-01-07 15:22 GMT+01:00 Juan Jose Casafranca <[hidden email]>:


> > On sábado, 7 de enero de 2017 15:14:09 (CET) Gilles Caulier wrote:


> > > 2017-01-07 15:08 GMT+01:00 Juan Jose Casafranca <[hidden email]>:


> > > > On sábado, 7 de enero de 2017 15:03:38 (CET) Gilles Caulier wrote:


> > > > > As i explain before, ALL thumbnails generated by digiKam are stored


> >


> > in a


> >


> > > > > dedicated database (sqlite or Mysql).


> > > > >


> > > > > The thumbnails are stored using wavelets compression format PGF to


> > > >


> > > > optimize


> > > >


> > > > > space. In older DK version (3 for ex), we use FreeDesktop way with


> >


> > PNG


> >


> > > > > which explode storage for huge collection and take a while to store


> > > > > thumbnails files. Also FreeDesktop recommendations is only limited


> > > > > to


> > > > > 256x256, which is not enough for Hdpi screen (digiKam can store


> >


> > 512x512


> >


> > > > and


> > > >


> > > > > perhaps more in the future with 8K screen).


> > > >


> > > > Okay. But there is no need to change anything in DK for storing


> > > > thumbnails.


> > > > The only thing needed is to change the way thumbnails are generated


> > > > and


> > > > updated for raw files.


> > > >


> > > > Simply, when DK finds a new raw file, instead of loading the embedded


> >


> > jpg


> >


> > > > file,


> > > > simply call the raw processor and generate the new file. And when the


> > > > thumbnail


> > > > is dirty (as I explained before), regenerate the thumbnail.


> > >


> > > But this is already the case. We use already a raw decoder named libraw


> >


> > to


> >


> > > process RAW thumbnails. We will not using another one... Stop to puzzle


> >


> > the


> >


> > > code


> > >


> > > Gilles Caulier


> >


> > So you are telling me that if we want to process a raw file and manage a


> > library with DK, we have to stay with the simply DK raw processor instead


> > of


> > using a much more powerful one like darktable? Do you really think that


> > people


> > out there use the DK raw processor to process their images?


>


> But digiKam is not DarkTable.  The way to mix both cannot be done. This is


> 2 different applications, one written in Qt other one in GTK...


>


> The goal currently in DK is to stabilize the code, reduce dependencies,


> improve port to non Linux. We have plenty of jobs to do, DarkTable is not a


> priority for the moment.


>


> Gilles Caulier





I know that they are two different apps. I dont understand why GTK and Qt is


even a question here. I'm not saying to add DT as a depency for DK, just let


the user decide which raw processor uses.

But Raw processor from DT is not the same than DK as i know. Changing Raw processor in digiKam by DT one is as to add DT dependencies to DK.  No way here...

I'm not asking to change the raw processor. Just asking to allow the user which raw processor wants to use. If the user selects to use DT, simply make him enter the DT executable which will be called when the raw file must be processed. No dependency needed.
 





As I said, I can try to develop this by myself, I'm not asking any dedicated


DK developer to do it... What I only need is a little guideline on how the


thumbnails are generated, how they are stored in the database and some other


stuff for letting the user choose which processor wants to choose.

2 possibilities :

1/ use DBus to ping digiKam core about thumbnails changed externally. Only Linux solution. 

2/ use XMP sidecar to store a local path to new thumbnails processed into DT XMP namespace. I don't like this too much by at least it store the minimum to XMP.

3/ store wavelets compressed preview in XMP sidecar to Iptc.Application2.Preview

4/ use a thumbnail sidecar file near RAW file as .thumb. I see this solution already used under Windows, but i don't remember which application exactly. I know that Canon camera do it also. It's a simple JPEG file with metadata This way will duplicata data of course.

Gilles Caulier





















Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

J Albrecht
In reply to this post by Juan Jose Casafranca


On 07 Jan 2017, at 08:41, Juan Jose Casafranca <[hidden email]> wrote:

(Anyway, windows and mac users already has another raw 
processing workflow which includes other software, dont they?)

Umm, no…  Like I’m sure that others do, my workflow includes both programs on Mac OS.   Please, don’t suggest leaving us out in the cold!

signature.asc (465 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Juan Jose Casafranca
On miércoles, 11 de enero de 2017 21:15:06 (CET) J Albrecht wrote:
> > On 07 Jan 2017, at 08:41, Juan Jose Casafranca <[hidden email]> wrote:
> >
> > (Anyway, windows and mac users already has another raw
> > processing workflow which includes other software, dont they?)
>
> Umm, no…  Like I’m sure that others do, my workflow includes both programs
> on Mac OS.   Please, don’t suggest leaving us out in the cold!

I will take that into account when I begin doing the code ;-)

Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

J Albrecht
In reply to this post by Juan Jose Casafranca

On 07 Jan 2017, at 09:41, Juan Jose Casafranca <[hidden email]> wrote:

They need a way to organize 
their library, which DK is good at, and a way to process raw files, which DT is 
good at (DK is not a good raw processor and DT is not good for library 
management).

For the Developer’s benefit, I’d like to reiterate the above statement: digiKam is a brilliant program but please, let’s maintain the focus on where it is brilliant rather than trying to craft it into an all-singing-all-dancing piece of bloatware comprising relatively mediocre modules just for the sake of doing so. In the FOSS realm, digikam is an excellent Digital Asset Management program, darktable is, IMHO, the best Raw editor and GIMP is unparalleled for post-processing. It’s folly and perhaps a bit arrogant to assume that Users would willingly be hobbled by using only one program simply because they are “loyal” to that program.

Wouldn’t it be nice if we could just all get along….

signature.asc (465 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Juan Jose Casafranca
Thanks Albrecht, that's exactly my opinion and the reason I want to develop this module :-)

2017-01-12 15:15 GMT+01:00 J Albrecht <[hidden email]>:

On 07 Jan 2017, at 09:41, Juan Jose Casafranca <[hidden email]> wrote:

They need a way to organize 
their library, which DK is good at, and a way to process raw files, which DT is 
good at (DK is not a good raw processor and DT is not good for library 
management).

For the Developer’s benefit, I’d like to reiterate the above statement: digiKam is a brilliant program but please, let’s maintain the focus on where it is brilliant rather than trying to craft it into an all-singing-all-dancing piece of bloatware comprising relatively mediocre modules just for the sake of doing so. In the FOSS realm, digikam is an excellent Digital Asset Management program, darktable is, IMHO, the best Raw editor and GIMP is unparalleled for post-processing. It’s folly and perhaps a bit arrogant to assume that Users would willingly be hobbled by using only one program simply because they are “loyal” to that program.

Wouldn’t it be nice if we could just all get along….

Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

AndriusWild
In reply to this post by Juan Jose Casafranca
I agree 100% but digikam devs have their own point of view on how the program should look like and we need to respect it.

This is how fork projects appear. If it is not too complicated to replace libraw with darktable a fork could be not a bad idea.

Someone will have to maintain it though, new versions of both digikam and darktable come out pretty frequently.


Sent from my Samsung Galaxy smartphone.

-------- Original message --------
From: Juan Jose Casafranca <[hidden email]>
Date: 2017-01-13 8:29 AM (GMT-07:00)
To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]>
Cc: [hidden email], darktable-user <[hidden email]>
Subject: Re: Digikam raw files and darktable

Thanks Albrecht, that's exactly my opinion and the reason I want to develop this module :-)

2017-01-12 15:15 GMT+01:00 J Albrecht <[hidden email]>:

On 07 Jan 2017, at 09:41, Juan Jose Casafranca <[hidden email]> wrote:

They need a way to organize 
their library, which DK is good at, and a way to process raw files, which DT is 
good at (DK is not a good raw processor and DT is not good for library 
management).

For the Developer’s benefit, I’d like to reiterate the above statement: digiKam is a brilliant program but please, let’s maintain the focus on where it is brilliant rather than trying to craft it into an all-singing-all-dancing piece of bloatware comprising relatively mediocre modules just for the sake of doing so. In the FOSS realm, digikam is an excellent Digital Asset Management program, darktable is, IMHO, the best Raw editor and GIMP is unparalleled for post-processing. It’s folly and perhaps a bit arrogant to assume that Users would willingly be hobbled by using only one program simply because they are “loyal” to that program.

Wouldn’t it be nice if we could just all get along….

Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

cerp
Dear all,

Then we would need to have a fork for RawTherapee, one for LightZone  
(which I both prefer to Darktable for RAF file editing) and so on ....  
would it not be better to have a mechanism to use the preferred editor?

Best Regards

Quoting Andrey Goreev <[hidden email]>:

> I agree 100% but digikam devs have their own point of view on how  
> the program should look like and we need to respect it.
> This is how fork projects appear. If it is not too complicated to  
> replace libraw with darktable a fork could be not a bad idea.
> Someone will have to maintain it though, new versions of both  
> digikam and darktable come out pretty frequently.
>
> Sent from my Samsung Galaxy smartphone.
> -------- Original message --------From: Juan Jose Casafranca  
> <[hidden email]> Date: 2017-01-13  8:29 AM  (GMT-07:00) To:  
> digiKam - Home Manage your photographs as a professional with the  
> power of open source <[hidden email]> Cc:  
> [hidden email], darktable-user  
> <[hidden email]> Subject: Re: Digikam raw files  
> and darktable
> Thanks Albrecht, that's exactly my opinion and the reason I want to  
> develop this module :-)
> 2017-01-12 15:15 GMT+01:00 J Albrecht <[hidden email]>:
>
> On 07 Jan 2017, at 09:41, Juan Jose Casafranca <[hidden email]> wrote:
> They need a way to organize 
> their library, which DK is good at, and a way to process raw files,  
> which DT is 
> good at (DK is not a good raw processor and DT is not good for library 
> management).
> For the Developer’s benefit, I’d like to reiterate the above  
> statement: digiKam is a brilliant program but please, let’s maintain  
> the focus on where it is brilliant rather than trying to craft it  
> into an all-singing-all-dancing piece of bloatware comprising  
> relatively mediocre modules just for the sake of doing so. In the  
> FOSS realm, digikam is an excellent Digital Asset Management  
> program, darktable is, IMHO, the best Raw editor and GIMP is  
> unparalleled for post-processing. It’s folly and perhaps a bit  
> arrogant to assume that Users would willingly be hobbled by using  
> only one program simply because they are “loyal” to that program.
> Wouldn’t it be nice if we could just all get along….



Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Juan Jose Casafranca
And that is my intentionm not replacing the raw editoe but calling the external one to receive the edited image

El 13 ene. 2017 5:01 PM, "cerp" <[hidden email]> escribió:
Dear all,

Then we would need to have a fork for RawTherapee, one for LightZone (which I both prefer to Darktable for RAF file editing) and so on .... would it not be better to have a mechanism to use the preferred editor?

Best Regards

Quoting Andrey Goreev <[hidden email]>:

I agree 100% but digikam devs have their own point of view on how the program should look like and we need to respect it.
This is how fork projects appear. If it is not too complicated to replace libraw with darktable a fork could be not a bad idea.
Someone will have to maintain it though, new versions of both digikam and darktable come out pretty frequently.

Sent from my Samsung Galaxy smartphone.
-------- Original message --------From: Juan Jose Casafranca <[hidden email]> Date: 2017-01-13  8:29 AM  (GMT-07:00) To: digiKam - Home Manage your photographs as a professional with the power of open source <[hidden email]> Cc: [hidden email], darktable-user <[hidden email]> Subject: Re: Digikam raw files and darktable
Thanks Albrecht, that's exactly my opinion and the reason I want to develop this module :-)
2017-01-12 15:15 GMT+01:00 J Albrecht <[hidden email]>:

On 07 Jan 2017, at 09:41, Juan Jose Casafranca <[hidden email]> wrote:
They need a way to organize 
their library, which DK is good at, and a way to process raw files, which DT is 
good at (DK is not a good raw processor and DT is not good for library 
management).
For the Developer’s benefit, I’d like to reiterate the above statement: digiKam is a brilliant program but please, let’s maintain the focus on where it is brilliant rather than trying to craft it into an all-singing-all-dancing piece of bloatware comprising relatively mediocre modules just for the sake of doing so. In the FOSS realm, digikam is an excellent Digital Asset Management program, darktable is, IMHO, the best Raw editor and GIMP is unparalleled for post-processing. It’s folly and perhaps a bit arrogant to assume that Users would willingly be hobbled by using only one program simply because they are “loyal” to that program.
Wouldn’t it be nice if we could just all get along….



Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

cerp
Dear Juan Jose,

I think it is an interesting concept particularly if the plugin  
allowed to chose every time from a series of possible RAW editors.

Best,



Quoting Juan Jose Casafranca <[hidden email]>:

> And that is my intentionm not replacing the raw editoe but calling the
> external one to receive the edited image
>
> El 13 ene. 2017 5:01 PM, "cerp" <[hidden email]> escribió:
>
>> Dear all,
>>
>> Then we would need to have a fork for RawTherapee, one for LightZone
>> (which I both prefer to Darktable for RAF file editing) and so on ....
>> would it not be better to have a mechanism to use the preferred editor?
>>
>> Best Regards
>>
>> Quoting Andrey Goreev <[hidden email]>:
>>
>> I agree 100% but digikam devs have their own point of view on how the
>>> program should look like and we need to respect it.
>>> This is how fork projects appear. If it is not too complicated to replace
>>> libraw with darktable a fork could be not a bad idea.
>>> Someone will have to maintain it though, new versions of both digikam and
>>> darktable come out pretty frequently.
>>>
>>> Sent from my Samsung Galaxy smartphone.
>>> -------- Original message --------From: Juan Jose Casafranca <
>>> [hidden email]> Date: 2017-01-13  8:29 AM  (GMT-07:00) To: digiKam -
>>> Home Manage your photographs as a professional with the power of open
>>> source <[hidden email]> Cc: [hidden email],
>>> darktable-user <[hidden email]> Subject: Re: Digikam
>>> raw files and darktable
>>> Thanks Albrecht, that's exactly my opinion and the reason I want to
>>> develop this module :-)
>>> 2017-01-12 15:15 GMT+01:00 J Albrecht <[hidden email]>:
>>>
>>> On 07 Jan 2017, at 09:41, Juan Jose Casafranca <[hidden email]>
>>> wrote:
>>> They need a way to organize
>>> their library, which DK is good at, and a way to process raw files, which
>>> DT is
>>> good at (DK is not a good raw processor and DT is not good for library
>>> management).
>>> For the Developer’s benefit, I’d like to reiterate the above statement:
>>> digiKam is a brilliant program but please, let’s maintain the focus on
>>> where it is brilliant rather than trying to craft it into an
>>> all-singing-all-dancing piece of bloatware comprising relatively mediocre
>>> modules just for the sake of doing so. In the FOSS realm, digikam is an
>>> excellent Digital Asset Management program, darktable is, IMHO, the best
>>> Raw editor and GIMP is unparalleled for post-processing. It’s folly and
>>> perhaps a bit arrogant to assume that Users would willingly be hobbled by
>>> using only one program simply because they are “loyal” to that program.
>>> Wouldn’t it be nice if we could just all get along….
>>>
>>
>>
>>
>>



Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Simon Frei
In linux there is already the option "Open with..." which is what you
are asking for.
Juan wants to go one step further and generate thumbnails of raw fails
according to how they are processed, using external tools.

On 13/01/17 19:46, cerp wrote:

> Dear Juan Jose,
>
> I think it is an interesting concept particularly if the plugin
> allowed to chose every time from a series of possible RAW editors.
>
> Best,
>
>
>
> Quoting Juan Jose Casafranca <[hidden email]>:
>
>> And that is my intentionm not replacing the raw editoe but calling the
>> external one to receive the edited image
>>
>> El 13 ene. 2017 5:01 PM, "cerp" <[hidden email]> escribió:
>>
>>> Dear all,
>>>
>>> Then we would need to have a fork for RawTherapee, one for LightZone
>>> (which I both prefer to Darktable for RAF file editing) and so on ....
>>> would it not be better to have a mechanism to use the preferred editor?
>>>
>>> Best Regards
>>>
>>> Quoting Andrey Goreev <[hidden email]>:
>>>
>>> I agree 100% but digikam devs have their own point of view on how the
>>>> program should look like and we need to respect it.
>>>> This is how fork projects appear. If it is not too complicated to
>>>> replace
>>>> libraw with darktable a fork could be not a bad idea.
>>>> Someone will have to maintain it though, new versions of both
>>>> digikam and
>>>> darktable come out pretty frequently.
>>>>
>>>> Sent from my Samsung Galaxy smartphone.
>>>> -------- Original message --------From: Juan Jose Casafranca <
>>>> [hidden email]> Date: 2017-01-13  8:29 AM  (GMT-07:00) To:
>>>> digiKam -
>>>> Home Manage your photographs as a professional with the power of open
>>>> source <[hidden email]> Cc: [hidden email],
>>>> darktable-user <[hidden email]> Subject: Re:
>>>> Digikam
>>>> raw files and darktable
>>>> Thanks Albrecht, that's exactly my opinion and the reason I want to
>>>> develop this module :-)
>>>> 2017-01-12 15:15 GMT+01:00 J Albrecht <[hidden email]>:
>>>>
>>>> On 07 Jan 2017, at 09:41, Juan Jose Casafranca <[hidden email]>
>>>> wrote:
>>>> They need a way to organize
>>>> their library, which DK is good at, and a way to process raw files,
>>>> which
>>>> DT is
>>>> good at (DK is not a good raw processor and DT is not good for library
>>>> management).
>>>> For the Developer’s benefit, I’d like to reiterate the above
>>>> statement:
>>>> digiKam is a brilliant program but please, let’s maintain the focus on
>>>> where it is brilliant rather than trying to craft it into an
>>>> all-singing-all-dancing piece of bloatware comprising relatively
>>>> mediocre
>>>> modules just for the sake of doing so. In the FOSS realm, digikam
>>>> is an
>>>> excellent Digital Asset Management program, darktable is, IMHO, the
>>>> best
>>>> Raw editor and GIMP is unparalleled for post-processing. It’s folly
>>>> and
>>>> perhaps a bit arrogant to assume that Users would willingly be
>>>> hobbled by
>>>> using only one program simply because they are “loyal” to that
>>>> program.
>>>> Wouldn’t it be nice if we could just all get along….
>>>>
>>>
>>>
>>>
>>>
>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

J Albrecht

On 13 Jan 2017, at 14:26, Simon Frei <[hidden email]> wrote:

wants to go one step further and generate thumbnails of raw fails
according to how they are processed, using external tools.

I think that this also includes the ability to choose a default editor (either Raw or Post). Thus, those who are satisfied with the limited capabilities of the incumbent digikam raw and editing modules can continue to use them while those of us who require more advanced capabilities can do it seamlessly

signature.asc (465 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

J Albrecht
By the way…  darktable uses an optional lua script to allow a user to open a selected file in Gimp. The file is then auto-magically returned to darktable as a new edited instance after Gimp has been closed. Is this something that can be used from the digiKam side to provide the desired functionality?


On 13 Jan 2017, at 15:47, J Albrecht <[hidden email]> wrote:


On 13 Jan 2017, at 14:26, Simon Frei <[hidden email]> wrote:

wants to go one step further and generate thumbnails of raw fails
according to how they are processed, using external tools.

I think that this also includes the ability to choose a default editor (either Raw or Post). Thus, those who are satisfied with the limited capabilities of the incumbent digikam raw and editing modules can continue to use them while those of us who require more advanced capabilities can do it seamlessly


signature.asc (465 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Juan Jose Casafranca
Maybe the lua script is a good approach, at least it saves the file in disk and the open it. I'll check it. 
Simon, you have explained really well what I'm trying to do :-)

2017-01-13 21:57 GMT+01:00 J Albrecht <[hidden email]>:
By the way…  darktable uses an optional lua script to allow a user to open a selected file in Gimp. The file is then auto-magically returned to darktable as a new edited instance after Gimp has been closed. Is this something that can be used from the digiKam side to provide the desired functionality?


On 13 Jan 2017, at 15:47, J Albrecht <[hidden email]> wrote:


On 13 Jan 2017, at 14:26, Simon Frei <[hidden email]> wrote:

wants to go one step further and generate thumbnails of raw fails
according to how they are processed, using external tools.

I think that this also includes the ability to choose a default editor (either Raw or Post). Thus, those who are satisfied with the limited capabilities of the incumbent digikam raw and editing modules can continue to use them while those of us who require more advanced capabilities can do it seamlessly


Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

cerp
In reply to this post by J Albrecht
This is how I interpreted it as well. In other words when you open the  
Image Editor on a RAW files you can choose the internal editor or any  
of the others (Darktable, Lightzone, Rawtherapee or whatever) and  
integrate outcomes seamlessly into the workflow managed with digikam.

Is that correct, Juan?

Best,

Quoting J Albrecht <[hidden email]>:

>> On 13 Jan 2017, at 14:26, Simon Frei <[hidden email]> wrote:
>>
>> wants to go one step further and generate thumbnails of raw fails
>> according to how they are processed, using external tools.
>
> I think that this also includes the ability to choose a default  
> editor (either Raw or Post). Thus, those who are satisfied with the  
> limited capabilities of the incumbent digikam raw and editing  
> modules can continue to use them while those of us who require more  
> advanced capabilities can do it seamlessly.



Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Juan Jose Casafranca
More or less. I prefer to think that the user has defined a default raw processor (normally, users only use one raw processor, dont they?) and all the raw files will be decoded using that raw processor in order to generate the thumbnail and preview image. When the user opens that file, it will be opened in the default raw processor and after the edition is done, thumbnail will be updated accordingly. 

Maybe allowing the user to select a specific raw processor for a specific raw file can be done, but lets do things one step at a time. The original idea is already hard for me, as I've never worked neither with digikam code nor any other raw processor but DT. 
Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

cerp
Dear Juan,

I am not sure people use always the same editor. People may have more  
than one camera using different RAW format, and you tend to use the  
best RAW editor for the specific format. For example, we use a  
combination of editors. Even proprietary software we have used  
CaptureOne, Lightroom and Silkypix, depending on the camera  
(CaptureOne and Lightroom for the Leica, Silkypix for the RAF).

This is even more true in the OS environment.

Best,

Quoting Juan Jose Casafranca <[hidden email]>:

> More or less. I prefer to think that the user has defined a default raw
> processor (normally, users only use one raw processor, dont they?) and all
> the raw files will be decoded using that raw processor in order to generate
> the thumbnail and preview image. When the user opens that file, it will be
> opened in the default raw processor and after the edition is done,
> thumbnail will be updated accordingly.
>
> Maybe allowing the user to select a specific raw processor for a specific
> raw file can be done, but lets do things one step at a time. The original
> idea is already hard for me, as I've never worked neither with digikam code
> nor any other raw processor but DT.



Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Juan Jose Casafranca
I havent thought it that way since Ive always use nikon cameras, but ypu may be right. 

Anyway, as I said, lets try to hace a working concept for a global raw processor and after that, think about other necessities. 

This weekend Ill begin to study DK code to try to find a way of implementing this feature. 

Thanks for the tips :-)

El 13 ene. 2017 11:57 PM, "cerp" <[hidden email]> escribió:
Dear Juan,

I am not sure people use always the same editor. People may have more than one camera using different RAW format, and you tend to use the best RAW editor for the specific format. For example, we use a combination of editors. Even proprietary software we have used CaptureOne, Lightroom and Silkypix, depending on the camera (CaptureOne and Lightroom for the Leica, Silkypix for the RAF).

This is even more true in the OS environment.


Best,

Quoting Juan Jose Casafranca <[hidden email]>:

More or less. I prefer to think that the user has defined a default raw
processor (normally, users only use one raw processor, dont they?) and all
the raw files will be decoded using that raw processor in order to generate
the thumbnail and preview image. When the user opens that file, it will be
opened in the default raw processor and after the edition is done,
thumbnail will be updated accordingly.

Maybe allowing the user to select a specific raw processor for a specific
raw file can be done, but lets do things one step at a time. The original
idea is already hard for me, as I've never worked neither with digikam code
nor any other raw processor but DT.




Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Boudewijn

Hi Juan,

 

Maybe there is one more option. The solution in this case is in darktable instead of in digiKam:

 

* have DT store an export of the current state of processing as PGF in DK's thumbs database, overwriting the current thumbnail for DK

* use an external database for DK, so that it is accessible even when DK is not running

 

The first hurdles I see are:

* storage options of DT do not include 'save in database' as target storage

* storage options of DT do not include 'PGF' as file format option

* I have never had a look in the thumbs-db, and no idea whether the thumbnailname is identical to the file name

 

It seems that there are Lua-options to work with PGF, there are MySQL-Lua-bindings and DT can use Lua scripts, so it may be a viable path.

 

The result would be that DK 'just shows' the thumbnail of latest version of the photo, even without knowing it does. Whenever you're sick of seeing the thumbnail of the latest version of the photo, you open the photo (via any route) in DT, go back to a previous step and save the new thumbnail to the database.

 

Best regards,

 

Boudewijn

 

PS, the thumbnail maintenance may be this code (please correct me if wrong!), I see insert, replace and update being handled by id, where the thumbnails.id = thumbid from filepath.


https://cgit.kde.org/digikam.git/tree/libs/database/thumbsdb/thumbsdb.cpp

 

QHash<QString, int> ThumbsDb::getFilePathsWithThumbnail()

{

DbEngineSqlQuery query = d->db->prepareQuery(QString::fromLatin1("SELECT path, id "

"FROM FilePaths "

" INNER JOIN Thumbnails ON FilePaths.thumbId=Thumbnails.id "

"WHERE type BETWEEN %1 AND %2;")

.arg(DatabaseThumbnail::PGF)

.arg(DatabaseThumbnail::PNG));

 

if (!d->db->exec(query))

{

return QHash<QString, int>();

}

 

QHash <QString, int> filePaths;

 

while (query.next())

{

filePaths[query.value(0).toString()] = query.value(1).toInt();

}

 

return filePaths;

}

 

BdEngineBackend::QueryState ThumbsDb::replaceThumbnail(const ThumbsDbInfo& info)

{

return d->db->execSql(QLatin1String("REPLACE INTO Thumbnails (id, type, modificationDate, orientationHint, data) VALUES(?, ?, ?, ?, ?);"),

QList<QVariant>() << info.id << info.type << info.modificationDate << info.orientationHint << info.data);

}

 

 

On zaterdag 14 januari 2017 01:39:11 CET Juan Jose Casafranca wrote:

> I havent thought it that way since Ive always use nikon cameras, but ypu

> may be right.

>

> Anyway, as I said, lets try to hace a working concept for a global raw

> processor and after that, think about other necessities.

>

> This weekend Ill begin to study DK code to try to find a way of

> implementing this feature.

>

> Thanks for the tips :-)

>

> El 13 ene. 2017 11:57 PM, "cerp" <[hidden email]> escribió:

>

> Dear Juan,

>

> I am not sure people use always the same editor. People may have more than

> one camera using different RAW format, and you tend to use the best RAW

> editor for the specific format. For example, we use a combination of

> editors. Even proprietary software we have used CaptureOne, Lightroom and

> Silkypix, depending on the camera (CaptureOne and Lightroom for the Leica,

> Silkypix for the RAF).

>

> This is even more true in the OS environment.

>

>

> Best,

>

> Quoting Juan Jose Casafranca <[hidden email]>:

>

> More or less. I prefer to think that the user has defined a default raw

>

> > processor (normally, users only use one raw processor, dont they?) and all

> > the raw files will be decoded using that raw processor in order to

> > generate

> > the thumbnail and preview image. When the user opens that file, it will be

> > opened in the default raw processor and after the edition is done,

> > thumbnail will be updated accordingly.

> >

> > Maybe allowing the user to select a specific raw processor for a specific

> > raw file can be done, but lets do things one step at a time. The original

> > idea is already hard for me, as I've never worked neither with digikam

> > code

> > nor any other raw processor but DT.

 

 

Reply | Threaded
Open this post in threaded view
|

Re: Digikam raw files and darktable

Juan Jose Casafranca
Is that a darktable only solution? I dont want a darktable only solution but a global solution, for several raw processors. When I say darktable, its because its the raw processor I use, not because it deserves a special treatment.

I still think that a solution  in which dk calls the raw processor to generate the processed image is the best.

El 14 ene. 2017 22:47, "Boudewijn" <[hidden email]> escribió:

Hi Juan,

 

Maybe there is one more option. The solution in this case is in darktable instead of in digiKam:

 

* have DT store an export of the current state of processing as PGF in DK's thumbs database, overwriting the current thumbnail for DK

* use an external database for DK, so that it is accessible even when DK is not running

 

The first hurdles I see are:

* storage options of DT do not include 'save in database' as target storage

* storage options of DT do not include 'PGF' as file format option

* I have never had a look in the thumbs-db, and no idea whether the thumbnailname is identical to the file name

 

It seems that there are Lua-options to work with PGF, there are MySQL-Lua-bindings and DT can use Lua scripts, so it may be a viable path.

 

The result would be that DK 'just shows' the thumbnail of latest version of the photo, even without knowing it does. Whenever you're sick of seeing the thumbnail of the latest version of the photo, you open the photo (via any route) in DT, go back to a previous step and save the new thumbnail to the database.

 

Best regards,

 

Boudewijn

 

PS, the thumbnail maintenance may be this code (please correct me if wrong!), I see insert, replace and update being handled by id, where the thumbnails.id = thumbid from filepath.


https://cgit.kde.org/digikam.git/tree/libs/database/thumbsdb/thumbsdb.cpp

 

QHash<QString, int> ThumbsDb::getFilePathsWithThumbnail()

{

DbEngineSqlQuery query = d->db->prepareQuery(QString::fromLatin1("SELECT path, id "

"FROM FilePaths "

" INNER JOIN Thumbnails ON FilePaths.thumbId=Thumbnails.id "

"WHERE type BETWEEN %1 AND %2;")

.arg(DatabaseThumbnail::PGF)

.arg(DatabaseThumbnail::PNG));

 

if (!d->db->exec(query))

{

return QHash<QString, int>();

}

 

QHash <QString, int> filePaths;

 

while (query.next())

{

filePaths[query.value(0).toString()] = query.value(1).toInt();

}

 

return filePaths;

}

 

BdEngineBackend::QueryState ThumbsDb::replaceThumbnail(const ThumbsDbInfo& info)

{

return d->db->execSql(QLatin1String("REPLACE INTO Thumbnails (id, type, modificationDate, orientationHint, data) VALUES(?, ?, ?, ?, ?);"),

QList<QVariant>() << info.id << info.type << info.modificationDate << info.orientationHint << info.data);

}

 

 

On zaterdag 14 januari 2017 01:39:11 CET Juan Jose Casafranca wrote:

> I havent thought it that way since Ive always use nikon cameras, but ypu

> may be right.

>

> Anyway, as I said, lets try to hace a working concept for a global raw

> processor and after that, think about other necessities.

>

> This weekend Ill begin to study DK code to try to find a way of

> implementing this feature.

>

> Thanks for the tips :-)

>

> El 13 ene. 2017 11:57 PM, "cerp" <[hidden email]> escribió:

>

> Dear Juan,

>

> I am not sure people use always the same editor. People may have more than

> one camera using different RAW format, and you tend to use the best RAW

> editor for the specific format. For example, we use a combination of

> editors. Even proprietary software we have used CaptureOne, Lightroom and

> Silkypix, depending on the camera (CaptureOne and Lightroom for the Leica,

> Silkypix for the RAF).

>

> This is even more true in the OS environment.

>

>

> Best,

>

> Quoting Juan Jose Casafranca <[hidden email]>:

>

> More or less. I prefer to think that the user has defined a default raw

>

> > processor (normally, users only use one raw processor, dont they?) and all

> > the raw files will be decoded using that raw processor in order to

> > generate

> > the thumbnail and preview image. When the user opens that file, it will be

> > opened in the default raw processor and after the edition is done,

> > thumbnail will be updated accordingly.

> >

> > Maybe allowing the user to select a specific raw processor for a specific

> > raw file can be done, but lets do things one step at a time. The original

> > idea is already hard for me, as I've never worked neither with digikam

> > code

> > nor any other raw processor but DT.

 

 

1234