[digikam] [Bug 370631] New: Converting ARW to DNG fails

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=370631

            Bug ID: 370631
           Summary: Converting ARW to DNG fails
           Product: digikam
           Version: 5.2.0
          Platform: Archlinux Packages
                OS: Linux
            Status: UNCONFIRMED
          Severity: major
          Priority: NOR
         Component: Raw-Workflow
          Assignee: [hidden email]
          Reporter: [hidden email]

Converting ARW files to DNG fails.
History of the batch queue says "Failed to process item ..." but still creates
an unreadable file.

In additional Information you can see the terminal output during the
convertion.


Reproducible: Always

Steps to Reproduce:
1. add RW file to batch queue
2. assign tool "Convert RAW to DNG" (default settings)
3. run batch process

Actual Results:  
process fails but creates an unreadable DNG file

Expected Results:  
functioning DNG file

digikam.general: Using  1  CPU core to run threads
digikam.general: Action Thread run  1  new jobs
digikam.general: Tool : index=  1  :: name=  "Convert2DNG"  :: group=  7  ::
wurl=  QUrl("file:///home/christian/Bilder/Island 2016/")
digikam.general: path:  "/home/christian/Bilder/Island
2016/BatchTool-TJ1930.digikamtempfile.dng"
digikam.general: Tool:        "Convert RAW To DNG"
digikam.general: Input url:   QUrl("file:///home/christian/Bilder/Island
2016/DSC01774.ARW")
digikam.general: Output url:  QUrl("file:///home/christian/Bilder/Island
2016/BatchTool-TJ1930.digikamtempfile.dng")
digikam.general: DNGWriter: Loading RAW data from  "DSC01774.ARW"
...Sony black: 512 cblack: 0 0 0 0
 Sony matrix:
1,261719 -0,175781 -0,085938
-0,042969 1,308594 -0,265625
-0,023438 -0,105469 1,128906
...Sony black: 512 cblack: 0 0 0 0
 Sony matrix:
1,261719 -0,175781 -0,085938
-0,042969 1,308594 -0,265625
-0,023438 -0,105469 1,128906
digikam.rawengine: LibRaw progress:  Reading metadata  pass  1  of  2
digikam.rawengine: LibRaw progress:  Reading RAW data  pass  0  of  2
digikam.general: Detected change, triggering rescan of
"/home/christian/Bilder/Island 2016/"
digikam.rawengine: LibRaw progress:  Reading RAW data  pass  1  of  2
digikam.database: Starting scan!
digikam.general: DNGWriter: Raw data loaded:
digikam.general: --- Data Size:      40011264  bytes
digikam.general: --- Date:           "2016-09-01T04:07:47"
digikam.general: --- Make:           "Sony"
digikam.general: --- Model:          "SLT-A58"
digikam.general: --- ImageSize:      5472 x 3656
digikam.general: --- FullSize:       5504 x 3656
digikam.general: --- OutputSize:     5472 x 3656
digikam.general: --- Orientation:    0
digikam.general: --- Top margin:     0
digikam.general: --- Left margin:    0
digikam.general: --- Filter:         "RGGBRGGBRGGBRGGB"
digikam.general: --- Colors:         3
digikam.general: --- Black:          512
digikam.general: --- White:          17220
digikam.general: --- CAM->XYZ:
digikam.general:                     "0.5991  -0.1456  -0.0455"
digikam.general:                     "-0.4764  1.2135  0.2980"
digikam.general:                     "-0.0707  0.1425  0.6701"
digikam.general:                     "0.0000  0.0000  0.0000"
digikam.general: DNGWriter: DNG memory allocation and initialization
digikam.general: DNGWriter: DNG Negative structure creation
digikam.general: DNGWriter: Updating metadata to DNG Negative
digikam.metaengine: DateTime => Exif.Photo.DateTimeOriginal =>
QDateTime(2016-09-01 04:07:47.000 CEST Qt::TimeSpec(LocalTime))
digikam.metaengine: DateTime (Exif digitalized):  Do. Sep. 1 04:07:47 2016
digikam.general: DNGWriter: Backup Makernote ( 35675  bytes)
digikam.general: DNGWriter: Build DNG Negative
digikam.general: DNGWriter: DNG preview image creation
digikam.general: DNGWriter: Cannot load TIFF preview data in memory. Aborted...
digikam.metaengine: Cannot load metadata from file   (Error # 11 :
/home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an
unknown image type
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file
identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file
identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island
2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.database: Adding new item "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.database: Scanning took 1 ms
digikam.general: Detected change, triggering rescan of
"/home/christian/Bilder/Island 2016/"
digikam.general: Detected change, triggering rescan of
"/home/christian/Bilder//"
digikam.database: Finishing took 156 ms
digikam.database: Copying properties from 5035 to 5479
digikam.general: Using  1  CPU core to run threads
digikam.metaengine: Cannot load metadata from file   (Error # 11 :
/home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an
unknown image type
digikam.general: Action Thread run  1  new jobs
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.metaengine: Cannot load metadata from file   (Error # 11 :
/home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an
unknown image type
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file
identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file
identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island
2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.general: Trying to load Embedded preview with libraw
digikam.database: Scanning took 3 ms
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.rawengine: Failed to load embedded RAW preview
digikam.general: Trying to load half preview with libraw
digikam.rawengine: Try to use reduced RAW picture extraction
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.general: Trying to load Embedded preview with Exiv2
digikam.metaengine: Cannot load metadata using Exiv2   (Error # 11 :
/home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an
unknown image type
digikam.database: Starting scan!
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file
identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file
identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island
2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.general: mimetype =  ""  ext =  "DNG"
digikam.general: Cannot create thumbnail for  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: Thumbnail is null for  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: Request to get thumbnail for  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.database: Finishing took 128 ms
digikam.general: Mime type is not video from  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: Failed to extract video thumbnail for
"/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: One job is done
digikam.general: Cancel Main Thread
digikam.general: One job is done
digikam.metaengine: Cannot load metadata from file   (Error # 11 :
/home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an
unknown image type
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.general: Trying to load Embedded preview with libraw
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.rawengine: Failed to load embedded RAW preview
digikam.general: Trying to load half preview with libraw
digikam.rawengine: Try to use reduced RAW picture extraction
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.general: Trying to load Embedded preview with Exiv2
digikam.metaengine: Cannot load metadata using Exiv2   (Error # 11 :
/home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an
unknown image type
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file
identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file
identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island
2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.general: mimetype =  ""  ext =  "DNG"
digikam.general: Cannot create thumbnail for  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: Thumbnail is null for  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: List of Pending Jobs is empty
digikam.general: Event is dispatched to desktop notifier through DBUS
digikam.general: Request to get thumbnail for  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: Mime type is not video from  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: Failed to extract video thumbnail for
"/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.metaengine: Cannot load metadata from file   (Error # 11 :
/home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an
unknown image type
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.general: Trying to load Embedded preview with libraw
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.rawengine: Failed to load embedded RAW preview
digikam.general: Trying to load half preview with libraw
digikam.rawengine: Try to use reduced RAW picture extraction
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.general: Trying to load Embedded preview with Exiv2
digikam.metaengine: Cannot load metadata using Exiv2   (Error # 11 :
/home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an
unknown image type
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file
identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or
not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file
identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island
2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.general: mimetype =  ""  ext =  "DNG"
digikam.general: Cannot create thumbnail for  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: Thumbnail is null for  "/home/christian/Bilder/Island
2016/DSC01774.dng"
digikam.general: Using  1  CPU core to run threads
digikam.general: Action Thread run  1  new jobs
digikam.general: One job is done

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=370631

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]
          Component|Raw-Workflow                |BatchQueueManager-Tool-DngC
                   |                            |onverter

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=370631

--- Comment #1 from [hidden email] ---
digikam.general: DNGWriter: Cannot load TIFF preview data in memory. Aborted...

The DNG preview image cannot be created from ARW file. The image format is not
recognized after extraction.

Strange. Please share the ARW file into the cloud to investiguate.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=370631

--- Comment #2 from [hidden email] ---
I tried a few different ones and they all failed.
Here is one of them:
https://dl.dropboxusercontent.com/u/70882424/DSC01774.ARW

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=370631

Maik Qualmann <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #3 from Maik Qualmann <[hidden email]> ---
Problem is not reproducible here. The ARW file is converted without errors to a
DNG. No TIFF memory error.

Maik

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=370631

--- Comment #4 from [hidden email] ---
Probably, it miss a tiff codec for Qt in your install, as one provided by
KImageIO component from KDE.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=370631

--- Comment #5 from [hidden email] ---
Okay that helped to solve the problem.
Forgot to mention that I'm using Manjaro Linux.

I manually installed the package qt5-imageformats and now it works.
The digikam package dependencies shows qt5-imageformats only as additional
dependecny. (iike hugin formwhich it's okay since Digkam checks if it's
installed when you try to to panaoramas.)
Tryed to find if you can report that somewhere, but didn't find anything. So if
you know I can report it to the package maintainer.

Thanks
Christian

--
You are receiving this mail because:
You are the assignee for the bug.

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=370631

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
   Version Fixed In|                            |5.3.0
         Resolution|---                         |DOWNSTREAM

--- Comment #6 from [hidden email] ---
Yes, please report this problem as DOWSTREAM, to your Linux distro team.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.

[TRUK]

Hei.

Had the same problem. Ubuntu 19.10, DigiKam Version 5.9.0.

Happens with Sony's ARW and Nikon's NEF Files when trying to convert from
ARW or NEF to DNG.

Log:
....
digikam.general: DNGWriter: Build DNG Negative
digikam.general: DNGWriter: DNG preview image creation
digikam.general: DNGWriter: Cannot load TIFF preview data in memory.
Aborted...
...

Solution:
sudo apt-get install -y qt5-image-formats-plugins




--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-devel-f1695701.html

[Gilles Caulier-4]

Right.

I remember to use QImage tiff loader to handle DNG preview :

https://invent.kde.org/kde/digikam/-/blob/master/core/libs/dngwriter/dngwriter_convert.cpp#L1130

So if TIFF Qt loader is not installed, Qimage will return an error as
expected...

Gilles Caulier

Le mar. 7 avr. 2020 à 09:07, TRUK <[hidden email]> a écrit :

>
> Hei.
>
> Had the same problem. Ubuntu 19.10, DigiKam Version 5.9.0.
>
> Happens with Sony's ARW and Nikon's NEF Files when trying to convert from
> ARW or NEF to DNG.
>
> Log:
> ....
> digikam.general: DNGWriter: Build DNG Negative
> digikam.general: DNGWriter: DNG preview image creation
> digikam.general: DNGWriter: Cannot load TIFF preview data in memory.
> Aborted...
> ...
>
> Solution:
> sudo apt-get install -y qt5-image-formats-plugins
>
>
>
>
> --
> Sent from: http://digikam.1695700.n4.nabble.com/digikam-devel-f1695701.html