Introducing neural restore module – raw denoise, denoise, and upscale

I have DT running onnxruntime-gpu on my linux computer. It works well, but I’m finding that the neural restore RGB denoise leaves artifacts, as you can see in the attached image. I also get the same results if I use the bundled onnxruntime. The dynamic range in this photo is large. I shot for the sky and prayed for the shadows :slight_smile:

Do you have any ideas about this?

As I look at the posted shot, the problem is probably unclear. Here’s a better example. On the engine, just ahead of the cab, are three artifacts. Each one of these is centered around a hole into the firebox; the orange that you see is really hot as in termperature. With gimp, I read some of the RGB values are way beyond 255. In percent, gimp says for red, that the value is 400+. I’m wondering if the brightness is screwing up the denoising. There are also a few artifacts around the smoke stack (chimney).

John.

I am not familiar with this specific model that darktable uses, but most denoise models I have seen are trained on sRGB, I think you hit a limitation of the model, those spots are so over exposed that this introduces artifacts. What was the original ISO of the image?

I would like to have a small feature to “neutral restore”:

in “output parameters” I would like the possibility to choose myself the suffix of the processed file. Now the default suffix is “_raw-denoise” and I would like something different and sometimes none. Thanks.

1 Like

A couple of questions to understand the situation better:

  • What was the position of checkbox “preserve wide-gamut colors” in output parameters?
  • Is artifacts situation changes if you switch this checkbox to an opposite position?
  • Can you share source file, so I can test and potentially debug you case?

Thank you in advance!

@anry … lightning fast with the latest update , great work !!
No issues with artifacts for me … running on M1 Tahoe .
Just a thought … not sure of that is possible , just feel the color noise could be addressed a bit better . But this might be just me .
When the new window pops up … the magnification is different on two machines ?
My Mac Studio does show 172% and the MBP shows at 200 % .
Can i set the magnification myself ?

Regards Andreas

1 Like

Yes, you can. Config in darktablerc:

plugins/lighttable/neural_restore/preview_tooltip_zoom=2,000000
2 Likes

THX for the tip

I tried both positions. Preserve wide-gamut colors did the best. If I unchecked it, things were much worse, with the sky being blown out.

By source file, I think you mean the original *.nef file. Sure I’ll share it with you. Please tell me how to do it.

I’m sure this will get cleared up by and by. I absolutely love this feature, as it’s a good rescue for low light images. Thanks for your work on this :slight_smile: .

I shot at ISO 3200 with my D600 as I wanted to preserve that sunset much more than I wanted to see a whole lot of detail on the locomotive.

You can attache it here in the reply. Or send me in a private message on the portal if that would be more comfortable for you.

Here it is & thanks for the help.

dsc_6366.nef (28.9 MB)

And probably sidecar XMP file also needed to get exactly your edit

And one question - did you update models to the latest as I recommended?

OK, this should do. Tell me if you want more stuff.Processing: dsc_6366.nef.xmp…
Processing: dsc_6366_raw-denoise.dng…
Processing: dsc_6366_raw-denoise.dng.xmp…

Oh yes! Better do what the developer says.

Those are not proper atachements

OK, it looks like my first post hung. Here are two *xmp files.

dsc_6366.nef.xmp (7.3 KB)
dsc_6366_raw-denoise.dng.xmp (16.3 KB)

@anry … i do not have such line in the file ?

Same issue, Mac M1 Pro, latest build just downloaded.
And using the denoise function the colours are washed out in the tiff file compared to the processed raw.

Am I missing something?
IMG_3040_05.CR3.xmp (14.9 KB)
IMG_3040_denoise.tif (138.7 MB)
IMG_3040_denoise.tif.xmp (3.8 KB)
IMG_3040.CR3 (30.8 MB)