Comparing filmic color science v5/v6

Darktable UCS is used by default for the saturation control in color balance rgb since darktable 4.0. It yields much more uniform control than the previous iteration.

But my experiments are about using the same color space for hue preservation in filmic instead of the current Yrg linear color space.

4 Likes

Thanks …depending on the settings you use for that module (rgb CB)…that setting can have a big difference. I have not really tested it that much…

Just to be clear, I am not against this kind of explanation (this line of reasoning). At the same time, it’s at least odd that a very different DRT-approach (CAM16 in rt) does not exhibit this behaviour.

maybe the source of this salmon shift is not entirely rooted in filmic then? It got significantly better with dtUCS within filmic/v7, for sure!!
But that it is not completely gone is odd. That it seems gone with the segmentation based highlights reconstruction is doubly odd.

If that problem is not primarily (but comparing v5/v6/v7 it may be partially) rooted in filmic, tracking this down becomes a hassle.

Wow, you see, I never used any auto options. I’ve just assumed it won’t give me what I wanted. I just tested it and it’s perfect :smiley:

1 Like

Here, a Filmic (as well as other modules) edit. But this time, I used auto exposure, auto filmic, and some other few things:

DSC09445_01.ARW.xmp (15.2 KB)

I’ll go and test in Lightroom, I really wonder how Lr will handle this image. Stay tuned.

5 Likes

Extending on it a bit; what we see as red / salmon is the shadow of the small green leaves (I don’t know what they’re called) just in the back of the petals. They may well be attenuating some of the wavelengths that would otherwise make the petals seem more yellow. That part of the flower seems to be mainly lit by the backlight coming from outside (compared to the other parts which show no issues), so this would make sense to me.

Indeed. I just built RawTherapee from latest git revision to play with it and get a feel of how it behaves. :slight_smile:

1 Like

Lightroom edit:
Capture111
Lens correction, noise reduction, and a gradient from bottom to top that raises exposure in the lover shadows.

Starting point:

Auto:

My edit (what I said in the beginning of the comment):

This was really so quick and easy. Just moved a few sliders and did one gradient. Darktable definitely requires more tinkering.

3 Likes

This was 3 clicks in DT… 2 Tone eq presets and dehaze…using auto exposure as the starting point …it still needs more work but comparing to the LR workflow at least in this case and ease to get to your starting point as shown above it was just as easy in this case in DT… I think really much of the fiddling around happens in conjunction with the decision to use filmic and then perhaps handling any side effects of that …There is only one small blown area really in this image so there is not absolute need to use filmic… but if it gets used then the user just needs to know its moves :slight_smile: The interactions it can have with norms and WB can at times be tricky

1 Like

Does that salmon tint go away if you lower the exposure? If it does, it’s not the light that hits it from the back.

that slightly underexposed starting point is looking very similar to the CAM16 results I posted up above (in the backlit petals!) without the salmon shift.

I tend to agree with that.

(Sorry If I keep coming up with this seemingly again and again. Since we have no good ground truth rendering to compare against, or synthetic test images, it’s the occasional rendering oddity that might show priciple flaws in a DRT approach. I’m not even claiming that CAM16 in rt is perfect, it isn’t, but maybe it serves as a quick sanity check with a markedly different approach to how per-channel plus hue-restore or rgb-ratio works. In that way we iterate towards a “ground truth” but, and thats the unfortunate part, there may never be a “ground truth”. Yet that salmon tint has shown up so many times, that I’m leaning towards “something iffy going on that is not supposed to happen”. Sorry if I come off as nitpicky in the wake of this.)

2 Likes

Yes but at that point you’re over exposed and/or out of gamut.

I threw the image into ART and used Adobe’s DCP just to have something sort of standard. There is definitely a fair bit of orange in this case in the inner circle of petal. It gets modified a bit by turning on the look component of the DCP but interestingly the most orange view might have been noticed when cycling through the tone curve options in ART. The curve version/option called film created this orange chiffon sort of look. Neutral removed it … Standard was a more saturated yellow etc …like DT you can get a very wide range of results when cycling these options as you do with the norms presented in DT under filmic.

I don’t think so. The highlights code tries to do exactly what it’s supposed to do, add some intensity to a clipped channel based on data in the other channels. (I guess we have a clipped green here) Thus filmic gets better data to work on…

Also note, if the regions discussed are very sml like just a few photosites, demosaic code would also be improved with restored data at borders

1 Like

What I was trying to get at was:

  • If the hue shift is (post-capture-) exposure invariant, it is in “the scene” or at least in the sensor data, thus “real” in the sense that any expected orange hue would be a hopeless expectation as the “real” data says “salmon-tint”.

  • If the hue shift is (post-capture-) exposure variant, it’s at least in the pipeline but potentially within the filmic module as it is responsible for mapping to display.

Okay, so my conclusion that CAM16 in rt doesn’t show this might be rooted in hightlight reconstruction and not the DRT itself. That would explain a lot, I’ll check my rt edit for this!

EDIT: highlights-reconstruction was checked in rt, but affects a region which is not the salmon-shift region I encircled in post 192, it’s right next to it in the petals which have sun backlight.
EDIT2: with highlight reconstruction turned off:

I was curious and looked through the whole edit and again here is the danger to assume its one thing or another in a series of sequentially processed modules. But likely the main thing has nothing to do with the HLR as you can turn it off with little effect… Bill did have it turned on at a crazy low clipping value of 0.28 or something but still disable the module and nothing in it really. He does have a CLUT module in there and also better yet he is using v5 filmic and not v6 and I think many would think that he is… if you take his edit and don’t change a single thing …just move the color science to v6…here is what happens to the flower… (NOTE HE IS USING no in preserve chroma)

From this where he uses v5 and no preservation of color

make his edit with not changes just v6 and maxrgb ie the defaults…

Will give this…

So its the combo or v5 and no for color pres that makes the color in his flower edit

EDIT I see I forgot to add in the HLR… as you can see not much is clipped

And it does not impact the flower if you turn it on

You can get a little bit of salmon with RT’s CAM16 but you need to push luminance a lot and decrease saturation/chrominance (left), with normal saturation you don’t get it (increasing saturation seems to make the color converge).

Yes, I am trying not to jump to conclusions. After some playing in rt I do not see any blown channels, even without highlight-reconstruction.

I’ve been looking at channels in RT and the blue channel is almost zero in the critical region in the petals. I’ve tried to play with the blackpoints of all channels before debayer to force something to break, but I also get only very mild hints of salmon after a lot of trying things.

Question: is RT preventing negative values before debayer somehow and DT isn’t? From compositing I remember that carrying around negative channel values can cause headaches if not clamped to zero. Is DT carrying around negative blue channel values here which then could cause the salmon-shift or out-of-gamut-excursions?

Work through this edit. Turn various modules off and on. Set filmic to not use custom middle-gray. I don’t see the salmon coloring appear. IOW dt is handling the color w/o any problems, as I see it.

In your edit a big factor was that you used v5 of filmic and set CP to no… the difference between v5 and v6 set at this norm is quite substantial… I think the “salmon” issues are more prevalent in v6 also using latitude vs no latitude can alter the perception as well. I believe its 50% in DT right now… I think AP has proposed new defaults in his fork…using 0.7 EV hard shoulders and latitude set to zero so still more variation might appear in a “default” look if one was to adopt that… Actually using your edit I found the most pleasing combination to actually be changing your edit to v3 and no :slight_smile: go figure…

It looks like Yrg start to desaturating highlights before other color spaces

RGB tonemapping and hue restored with Yrg

RGB tonemapping and hue restored with OK-Lab

RGB tonemapping and hue restored with xyY

I think that gamut mapping (chroma desaturation) looks good when dealing with really out of gamut colors aka the rgb pixel has at least one channel with negative values.

Desaturating in-gamut highlights (pixel with a channel >1 and no negative values ) could create a harsh look, in this case hue is correct but the saturation is not smooth

1 Like

Would this not impact all versions of filmic unless there is a code change and there clearly is, so I think the answer lies the the filmic math in v6…

Edit here is switching that edit just to v3 and no… I really like also the way the color is on the vase… so if the data were messed up it should impact other edits as well one would think. I think the math in v6 is attempting to set things perfectly and constraining things to achieve accuracy but I think it can be undone by a camera setting or a WB in an image that is just not favorable with the math…

1 Like