Critique My Grade - Testing Deep Learning Color Transfer with Darktable

For the past 4–5 days, I was playing with a Deep Learning-based Color Transfer algorithm. Then I discovered Darktable, and oh boy, I was quite surprised by how powerful this tool can be. The first image is the RAW image without any corrections and grading

and the second image follows this workflow:

  1. Applied the Color Transfer Algorithm directly (without any color corrections/adjustments)
  2. Tweaked the Color Transfer RGB module
  3. Enabled the Sigmoid module (default)

And here are the results after that:

Note: I am a total newbie with really basic knowledge of color correction and grading, so you will see a lot of errors in the image. Feel free to criticize, as it will help me understand what can be done to improve my skills

Image Source: https://www.signatureedits.com/free-raw-photos/

4 Likes

Welcome to the forum!
Please read this before posting images: [Friendly reminder] Limit JPEGs to full HD resolution 1920x1080 pixels!

1 Like

Welcome to the forum. I am probably…no definitely confused by what you mean by Color Transfer Algorithm and then the Color Transfer RGB module. I would be interested in understanding about these. Thanks

Hey, thank you for your war greeting, you are totally right, and it’s my bad for causing the confusion. What I meant by “Color Transfer Algorithm” was that I was working with a Deep Learning-based color matching algorithm. It generates a LUT from a reference image. Instead of calling it Color Match Algorithm, I mistakenly wrote Color Transfer, which caused the mix-up. Hope that clarifies things!

2 Likes

I may have missed it, but what was the reference in this particular case?

1 Like

Hi @anasalzuvix

Welcome to the forum!

FYI your unprocessed image has a bit of default processing already. Plotting raw sensor data does not give pleasing results. :slightly_smiling_face:

Clearly you have some understanding of color processing, but for darktable you might want to start with this beginner’s guide from @Donatzsky: How to Get Started with darktable, 2026 Edition — Nis' Notebook

Also, @martinus has collected a number of themes, styles, LUTs, etc. here: https://darktable.z6.web.core.windows.net/

2 Likes

Here is the reference photo I used as the color source for the deep learning model to extract the color

1 Like

Thank you @Doug-Phoenix for pointing out that detail about default processing. I honestly thought it was completely unprocessed because I just converted the .CR2 file directly to JPEG, so that step must have happened during the conversion process.

And, Thanks a lot for sharing the guide and the resource links as well. I’ll definitely dive into those to get a better handle on how Darktable handles things

I see, interesting experiment! I can see that the trees in the background have clearly this blue-ish/green tint from the reference, but how should the model know what do with the orange? Interestingly, it looks like the saturation was just bumped to max, but that is I think not what the reference image looks like (although, the dark colors could be quite saturated)

@reox The deep learning model I trained actually takes 3 inputs:

  1. Source image
  2. Reference image
  3. A Color palette

The model knew what to do with the orange because of the color palette input. I fed the model the following color palette

and it worked out well in this case, it gave the overall image a greenish look while properly handling the primary colors of the source image!

Okay… I have to admit I don’t understand the process then :sweat_smile: for what do you need the reference image then? Especially in this case, why are reference and input image so different in their appearance? Maybe could you explain the whole workflow a bit better, i.e. what the intent of the reference is and how the images are fed into the DNN?

Soon I will write a detailed post about the entire workflow, as well as the DNN architecture, and i will post here, and will mention you as well you for the read-up