Batch RAW-Conversion to jpg leads to unusable jpg / tiff when using all kernels
Locked
Batch RAW-Conversion to jpg leads to unusable jpg / tiff when using all kernels
 
|
Hello, I have a problem which exists from digikam 5.20 to digikam 5.70. I really do batch conversion of NEF-rawfiles very often. The cameras are a D300, a D500, a D5300 and a D5500. The problem exists with every camera. My batch processing has the following workflow: - lens correction (according to the lens I used, Nikon 24-120,
Tamron 16-300, Tamron 17-50, Tamron 24-70 and Tamron 70-200) - noise reduction - local contrast - sharpening - BCG - save as jpg (same problem with save as tiff)
First of all I check the files for the used lens, All pics of the
same lens go to one queue. So there is a queue named 17-50 which
holds all pics taken with the Tamron 17-50. Then I use the tabs of the queue defintions (lower left part of
teh screen), select the export directory, set the rename options,
and when I use teh point: use all kernels on the third tab it
leads to jpg /tiff which only consists of colors. It is
independent whether I work with the computer during batch
conversion or let it work without having any open program. What I did to find out why it happens: - step by step i removed the tools from the workflow. For example the first step was to remove BCG, but the error exists. The second test was to remove Sharpening, then local contrast, then noise reduction and then lens correction. But nothing helped. The good jpg file has a size of about 5 MB the unusable file has a size of about 25 MB ?!
My system:
Thanks in advance for any help Best regards Ulf |
Re: Batch RAW-Conversion to jpg leads to unusable jpg / tiff when using all kernels
|
|
Strange. Here i use convert to JPEG with multicore without to break target files. The goal is to export Sony Raw files on the WEB. So you minimal workflow to reproduce is RAW to JPG as well, using multicore. Right ? If the problem is the same to convert RAW to TIFF, so the problem is certainly in libraw with multicore support. To test on your computer : take some NEF and convert to PNG using single core. Use BQM and apply your complete workflow to generate JPEG or TIFF with multicore. If it work, the problem is in libraw. Now in Libraw the problem can be about a specific demosaicing settings. So i recommend to investigate step by step with RAW settings to see when the problem is reproducible. Gilles Caulier 2017-08-28 11:07 GMT+02:00 fotografie <[hidden email]>:
|
Re: Batch RAW-Conversion to jpg leads to unusable jpg / tiff when using all kernels
|
|
Gilles,
The problem with NEF and multicore is known to me. We have an option in the CMake file to enable the multicore support for libraw. Then the problem was fixed. RAW files from Sony are not affected. Maik Am Montag, 28. August 2017, 11:34:21 CEST schrieb Gilles Caulier: > Strange. > > Here i use convert to JPEG with multicore without to break target files. > The goal is to export Sony Raw files on the WEB. > > So you minimal workflow to reproduce is RAW to JPG as well, using > multicore. Right ? > > If the problem is the same to convert RAW to TIFF, so the problem is > certainly in libraw with multicore support. > > To test on your computer : take some NEF and convert to PNG using single > core. > Use BQM and apply your complete workflow to generate JPEG or TIFF with > multicore. If it work, the problem is in libraw. > > Now in Libraw the problem can be about a specific demosaicing settings. So > i recommend to investigate step by step with RAW settings to see when the > problem is reproducible. > > Gilles Caulier > > 2017-08-28 11:07 GMT+02:00 fotografie <[hidden email]>: > > Hello, > > > > I have a problem which exists from digikam 5.20 to digikam 5.70. > > > > I really do batch conversion of NEF-rawfiles very often. The cameras are a > > D300, a D500, a D5300 and a D5500. The problem exists with every camera. > > > > My batch processing has the following workflow: > > > > - lens correction (according to the lens I used, Nikon 24-120, Tamron > > 16-300, Tamron 17-50, Tamron 24-70 and Tamron 70-200) > > > > - noise reduction > > > > - local contrast > > > > - sharpening > > > > - BCG > > > > - save as jpg (same problem with save as tiff) > > > > > > First of all I check the files for the used lens, All pics of the same > > lens go to one queue. So there is a queue named 17-50 which holds all pics > > taken with the Tamron 17-50. > > > > Then I use the tabs of the queue defintions (lower left part of teh > > screen), select the export directory, set the rename options, and when I > > use teh point: use all kernels on the third tab it leads to jpg /tiff > > which > > only consists of colors. It is independent whether I work with the > > computer > > during batch conversion or let it work without having any open program. > > > > What I did to find out why it happens: > > > > - step by step i removed the tools from the workflow. For example the > > first step was to remove BCG, but the error exists. The second test was to > > remove Sharpening, then local contrast, then noise reduction and then lens > > correction. But nothing helped. > > > > The good jpg file has a size of about 5 MB the unusable file has a size of > > about 25 MB ?! > > > > > > My system: > > > > > > System: Host: ulf-mint-18 Kernel: 4.4.0-21-generic x86_64 (64 bit gcc: > > 5.3.1) > > Desktop: Cinnamon 3.2.7 (Gtk 3.18.9-1ubuntu3.3) dm: mdm Distro: Linux Mint > > 18.1 Serena > > Machine: Mobo: Gigabyte model: GA-MA770-UD3 v: x.x Bios: Award v: F9g > > date: 07/08/2010 > > CPU: Quad core AMD Phenom II X4 955 (-MCP-) cache: 2048 KB > > flags: (lm nx sse sse2 sse3 sse4a svm) bmips: 25781 > > clock speeds: min/max: 800/3200 MHz 1: 800 MHz 2: 3200 MHz 3: 2100 MHz 4: > > 800 MHz > > Graphics: Card: NVIDIA G96 [GeForce 9400 GT] bus-ID: 01:00.0 chip-ID: > > 10de:0641 > > Display Server: X.Org 1.18.4 drivers: nvidia (unloaded: > > fbdev,vesa,nouveau) > > Resolution: 2560x1440@59.95hz > > GLX Renderer: GeForce 9400 GT/PCIe/SSE2 > > GLX Version: 3.3.0 NVIDIA 340.102 Direct Rendering: Yes > > Audio: Card-1 Advanced Micro Devices [AMD/ATI] SBx00 Azalia (Intel HDA) > > driver: snd_hda_intel bus-ID: 00:14.2 chip-ID: 1002:4383 > > Card-2 Creative Live! Cam Chat HD [VF0700] > > driver: USB Audio usb-ID: 002-002 chip-ID: 041e:4088 > > Sound: Advanced Linux Sound Architecture v: k4.4.0-21-generic > > Network: Card: Realtek RTL8111/8168/8411 PCI Express Gigabit Ethernet > > Controller > > driver: r8169 v: 2.3LK-NAPI port: de00 bus-ID: 04:00.0 chip-ID: 10ec:8168 > > IF: enp4s0 state: up speed: 1000 Mbps duplex: full mac: <filter> > > Drives: HDD Total Size: 10014.0GB (61.3% used) > > ID-1: /dev/sda model: SAMSUNG_HD204UI size: 2000.4GB serial: > > S2H7J1BZB12304 > > ID-2: /dev/sdb model: ST2000DL003 size: 2000.4GB serial: 6YD0MAC9 > > ID-3: /dev/sdc model: SAMSUNG_HD154UI size: 1500.3GB serial: > > S1XWJ1KS924182 > > ID-4: /dev/sdd model: TS512GSSD320 size: 512.1GB serial: B360701044 > > ID-5: /dev/sde model: WDC_WD40EZRX size: 4000.8GB serial: WD-WCC4E1364197 > > > > > > Thanks in advance for any help > > > > Best regards > > > > Ulf -- Gruß Maik |
Re: Batch RAW-Conversion to jpg leads to unusable jpg / tiff when using all kernels
|
|
In reply to this post by fotografie
The problem will now be fixed in digiKam-5.8.0. We have enough time for testing
to see if the thread support in libraw has other negative effects. Maik Am Montag, 28. August 2017, 11:07:24 CEST schrieb fotografie: > Hello, > > I have a problem which exists from digikam 5.20 to digikam 5.70. > > I really do batch conversion of NEF-rawfiles very often. The cameras are > a D300, a D500, a D5300 and a D5500. The problem exists with every camera. > > My batch processing has the following workflow: > > - lens correction (according to the lens I used, Nikon 24-120, Tamron > 16-300, Tamron 17-50, Tamron 24-70 and Tamron 70-200) > > - noise reduction > > - local contrast > > - sharpening > > - BCG > > - save as jpg (same problem with save as tiff) > > > First of all I check the files for the used lens, All pics of the same > lens go to one queue. So there is a queue named 17-50 which holds all > pics taken with the Tamron 17-50. > > Then I use the tabs of the queue defintions (lower left part of teh > screen), select the export directory, set the rename options, and when I > use teh point: use all kernels on the third tab it leads to jpg /tiff > which only consists of colors. It is independent whether I work with the > computer during batch conversion or let it work without having any open > program. > > What I did to find out why it happens: > > - step by step i removed the tools from the workflow. For example the > first step was to remove BCG, but the error exists. The second test was > to remove Sharpening, then local contrast, then noise reduction and then > lens correction. But nothing helped. > > The good jpg file has a size of about 5 MB the unusable file has a size > of about 25 MB ?! > > > My system: > > > System: Host: ulf-mint-18 Kernel: 4.4.0-21-generic x86_64 (64 bit gcc: > 5.3.1) > > Desktop: Cinnamon 3.2.7 (Gtk 3.18.9-1ubuntu3.3) dm: mdm Distro: Linux > Mint 18.1 Serena > > Machine: Mobo: Gigabyte model: GA-MA770-UD3 v: x.x Bios: Award v: F9g > date: 07/08/2010 > > CPU: Quad core AMD Phenom II X4 955 (-MCP-) cache: 2048 KB > > flags: (lm nx sse sse2 sse3 sse4a svm) bmips: 25781 > > clock speeds: min/max: 800/3200 MHz 1: 800 MHz 2: 3200 MHz 3: 2100 MHz > 4: 800 MHz > > Graphics: Card: NVIDIA G96 [GeForce 9400 GT] bus-ID: 01:00.0 chip-ID: > 10de:0641 > > Display Server: X.Org 1.18.4 drivers: nvidia (unloaded: fbdev,vesa,nouveau) > > Resolution: 2560x1440@59.95hz > > GLX Renderer: GeForce 9400 GT/PCIe/SSE2 > > GLX Version: 3.3.0 NVIDIA 340.102 Direct Rendering: Yes > > Audio: Card-1 Advanced Micro Devices [AMD/ATI] SBx00 Azalia (Intel HDA) > > driver: snd_hda_intel bus-ID: 00:14.2 chip-ID: 1002:4383 > > Card-2 Creative Live! Cam Chat HD [VF0700] > > driver: USB Audio usb-ID: 002-002 chip-ID: 041e:4088 > > Sound: Advanced Linux Sound Architecture v: k4.4.0-21-generic > > Network: Card: Realtek RTL8111/8168/8411 PCI Express Gigabit Ethernet > Controller > > driver: r8169 v: 2.3LK-NAPI port: de00 bus-ID: 04:00.0 chip-ID: 10ec:8168 > > IF: enp4s0 state: up speed: 1000 Mbps duplex: full mac: <filter> > > Drives: HDD Total Size: 10014.0GB (61.3% used) > > ID-1: /dev/sda model: SAMSUNG_HD204UI size: 2000.4GB serial: S2H7J1BZB12304 > > ID-2: /dev/sdb model: ST2000DL003 size: 2000.4GB serial: 6YD0MAC9 > > ID-3: /dev/sdc model: SAMSUNG_HD154UI size: 1500.3GB serial: S1XWJ1KS924182 > > ID-4: /dev/sdd model: TS512GSSD320 size: 512.1GB serial: B360701044 > > ID-5: /dev/sde model: WDC_WD40EZRX size: 4000.8GB serial: WD-WCC4E1364197 > > > Thanks in advance for any help > > Best regards > > Ulf |
| Free forum by Nabble | Edit this page |