The Myth of the Exposure Triangle

Try it and see. For my camera (Nikon D800 DSLR, full-frame, getting a bit old now) there is a difference. “Gain via post-processing” gives more colorful noise, ie there is a wider variation in chroma, than by varying ISO. To my eyes, the post-proc gain looks far noisier.

I also suspect (though haven’t formally tested this) that gain via post-processing loses more shadow detail (ie more banding) than gain via ISO.

Just saw a thread by one Pentax K-1 owner who tried the same with a different result:

But I think that the demosaicing method does have its impact, on my camera I see more noise with PPG than with AMaZE.

Maybe the ‘better’ noise performance depends on the camera (sensor) model or the demosaicing method, maybe on the user’s taste

@snibgo
Here is the test with my SonyF828, albeit a rather old camera. On the left ISO 64 on the right ISO 800, aperture and exposure time being kept the same:


I see practically no difference.
As I said, there is no such thing as a physical amplification in CCDs (in contrast to image tubes). Thus all one can do is to map the signal range to the numerical range, which is what the ISO setting does according to my understanding. The noise is set by the number of photons detected and nothing else (except readout noise, which I assume to be small). Here ISO cannot make any difference.

Hermann-Josef

And I doubt there is a practical one. The right ISO 800 image seems to be a bit more saturated.
Assuming you increased the exposure of the left ISO 64 image in a program, how does its algorithm work? If it only increases a luma channel then it would explain the difference.
Would it be the same result if you use another program or another method (brightness, exposure, gamma or whatsoever)?
If you’re precise, both images are not comparable.

But in reality you would just move a ‘saturation’ slider some more pixels in the left picture and won’t have a remarkable difference.

@pphoto

I just set black and white point in the histogram, which was perhaps not completely identical for both images. Thus the appearance of a slight difference in saturation. That was all for both images. So I did not change the pixel values – in contrast to the procedures you mention (brightness, exposure, gamma …)!

Concerning the issue with ISO I want to quote from the book by Tooms (2016): “Colour reproduction in electronic imaging systems”: On page 407 he writes: “The image sensor will have an opto-electro-conversion factor (OECF), which is normally linear and will output its signal to variable gain amplifiers which are adjusted for minimum gain, consistent with providing a standard level signal after the desired adjustments to the iris and shutter speed exposure settings. The gain adjustment is usually calibrated in terms of the ISO rating, which in turn is related to the ASA film sensitivity or speed rating familiar to traditional photographers.”
This confirms that the signal is just multiplied by a gain factor, which in turn does not change the SNR.

I also found a webpage, confirming what I just wrote. Scroll down to the part about “Common ISO Myths and Misconceptions” and read the paragraph “Is ISO “Sensor Sensitivity”?” The fundamental difference to the ISO/ASA of a photographic film is, that a film with high ISO does indeed have a higher sensitivity. If you raise the ISO setting of your camera, it does not increase the sensitivity of the detector.

However, one never knows what the firmware in the camera does in detail, if one raises the ISO setting. Thus it may well be, that due to some clever algorithm the image with high ISO setting does look somewhat better than what you get with a lower ISO setting and some image processing with the software of your choice.

Hermann-Josef

I suspect the SNR comparison depends on the camera model (which includes the physical sensor, any analogue gain, the ADC, any digital gain, and whatever post-processing is done. Especially any noise-reduction, obviously.

I don’t know exactly how my camera works. When I twiddle the ISO dial, what changes? Is there a change in analogue gain, or what?

This is somewhat frustrating, but I never fully understood how film worked, even just B&W, let alone colour. I think my D800 uses analogue gain for different ISO, up to the “extra” ISO called H1, H2 etc which are digital. But I could be wrong.

Personally, I’m not much bothered about what the theory says should happen. Instead, I look at what actually does happen. For example, an out-of-focus gray card, under office lighting (LED), constant exposure 1/800s f/2.8, at ISO 6400 and ISO 100:

set AREA=3500 2500 300 300
set CROP=-crop 300x300+3500+2500

%DCRAW% -v -A %AREA% -6 -o 1 -T -O 4398.tiff AGA_4398.NEF
%DCRAW% -v -A %AREA% -6 -o 1 -T -O 4402.tiff AGA_4402.NEF

%IMG7%magick 4398.tiff -strip %CROP% -auto-gamma +write isonse_4398.png -colorspace HCL -format "%%[fx:mean.g]\n%%[fx:standard_deviation.g]\n" info:
%IMG7%magick 4402.tiff -strip %CROP% -auto-gamma +write isonse_4402.png -colorspace HCL -format "%%[fx:mean.g]\n%%[fx:standard_deviation.g]\n" info:

The numbers are:

ISO 6400:
0.156747
0.0983761

ISO 100 (given post-proc gain):
0.170328
0.132537

The numbers show that post-proc gain has higher saturation (mean chroma), and a wider variation (standard deviation of chroma).

In real photography, I use dcraw’s noise reduction for high ISO, which improves those images.

So, if post-proc gain is noisier, do I avoid it? No. On the contrary, I generally set the camera to auto-expose with exposure compensation up to -2 stops. I deliberately underexpose to avoid clipping highlights, then correct with post-proc gain. For me, some extra noise is a price worth paying to avoid clipping.

2 Likes

@snibgo

This is what is happening, according to what I understand and read. However, this does not change the SNR, which is the main issue.

What do you mean by that?

I think one should be careful in the discussion to separate theory and praxis. My emphasize was on theory in order to understand what is going on. The practical part are the personal preferences.

If the variance in the higher ISO image is lower, then this could well mean, that the firmware is applying some algorithm to reduce noise (e.g. wavelet filtering). I doubt that the manufacturers will tell us exactly what they do.

Hermann-Josef

@Jossie: by “post-proc gain” I mean afre’s “gain via post-processing”, ie setting a low ISO such as 100, then multiplying the image in the computer, after the work in the camera.

The other case is “gain via ISO”, where we set a higher ISO eg 6400 in the camera, so the camera does the multiplying by some secret process that may include some smoothing or other noise-reduction.

Yes theory is useful. And so is testing.

Adding additional analogue gain will add noise (and possibly non-linearity) to the signal. Digital gain will increase quantisation noise in the signal. A certain amount of noise on the input to the ADC is a good thing as it will dither away the effects of quantisation.

Which one is best will depend on the details of the signal processing hardware…

I believe most cameras end up doing a combination of both.

Assuming you keep same exposure for two photos of same scene , one taken at ISO 6400 and one taken at ISO 100.
Knowing that the analog amplification is done as far upstream as possible, the ISO 6400 image is theoretically less noisy than the digital amplified ISO 100 image.
In case the noise introduced by amplifier and downstream electronics (mainly ADC) is sufficiently small, it could be negligible versus the upstream noise. Then , the two images above (ISO6400 and ISO100X64) will present the same noise level.
I think In-camera digital gain (extended ISO) is of no value if you process raw file.

Is there any domain, where the digitization noise is comparable or larger than the shot noise?

@gaaned92

See comparison above.

If the camera is well designed, the shot noise should always be the limiting factor.

Hermann-Josef

But the sensitivity of the system. It might be true that

But it is always wise to amplify early to not amplify later noise sources. If there are no highlights clipped, it is wise to amplify the sensor’s signal to best utilize the AD converter’s dynamic range, that means, ETTR. And reasonable ISO settings would do that.

If it is true that some cameras do not change this first amplification’s gain based on ISO setting, there may be a possibility to implemet ISO invariance in the sense that there would be no difference if I set ISO in-camera or boost exposure later. However, there are still some noise sources along the way, analog and digital ones, in camera and in the raw procesor, until the signal gets to the exposure setting in the latter. However it is implemented in-camera, I clearly see advantage in setting the ISO correct. The only way I see how this could be changed is some auto-gain in the camera. Maybe that’s how these ISO invariant cameras are implemented? One could easily check this with an underexposed raw file.

I was explaining @snibgo observation.

I suppose that for professionnal astronomy sensors, to fight thermal electronic noise, you can cool sensor and the electronic devices with some coolant (liquid helium for instance) and use special electonic , ADC and sensors designs…
In this case, it is possible that the only noise you have to take into account is the photon shot noise.
Your system is thus iso-less

It’s not at all the case for commercial camera (see also Emil Martinec paper). And in certain situations, camera electronics can be very hot thus generating a lot of thermal noise.

Thats surely mandatory for astronomy systems, but not for commercial cameras where the upstream (front end ) noise includes other noise sources.(see Emil martinec paper)

In this case your camera is ISO-less. That’s not always the case for commercial cameras at low ISO but becomes rather true beyond some ISO depending on the camera.

About ISO invariance see

and
http://www.photonstophotos.net

2 Likes

This is actually funny. It is clearly visible that the image boosted from ISO 400 has much worse magenta-type noise as expected. Examine carefully the shadow below the painting at 7:03.

Yes, astronomical CCD cameras are cooled by liquid nitrogen (He is not necessary) to about 150K and the electronic parts are in most cases selected for minimum noise. However, the photon flux levels are orders of magnitude less than in photography. Exposure times (relevant for dark current and associated noise) are also on the order of up to an hour, instead of 1/100 of a second. If you look at Fig. 13 in Martinec’s work you see that at average illumination the shot noise in digital SLRs is, as I had written, the dominant part.

The discussion is going now in a somewhat different direction from the original topic. But still the bottom line here is that ISO does not change the sensitivity of the sensor but only the gain, i.e. the amplification factor of the voltage, delivered by the sensor.

Hermann-Josef

3 Likes

Unfortunately, my electronics knowledge has atrophied somewhat since I left university 30+ years ago and started writing software, so I’m really out of date on the specifics.

Others correct me if wrong, “digitization noise” is probably more specifically termed “quantization error”, where a specific analog value has to be shunted to the nearest digital quantity. N’est ce pas?

If so, then the domain of interest would be where the destination bit depth becomes “comparable” to the error magnitude characteristic of the shot noise… ??

Thinking out loud…

I think this is correct, it is a “rounding error”. So this may only be relevant for 8bit/pixel data and for those in the darker parts, I would conclude.

Hermann-Josef

1 Like

That’s my surmise also, but I’m not sure how I’d quantify it.

Quantization error, aka rounding error, is discussed at http://theory.uchicago.edu/~ejm/pix/20d/tests/noise/index.html#quanterror :

It is also relevant when deliberately underexposing, then multiplying in the computer (“post-proc gain”). In my post above, the ISO 100 photo is underexposed by 6 stops. The camera records 14 bits/channel/pixel, so the top 6 bits are zero, so the camera is using only the bottom 8 bits. The raw files are effectively 8-bit. Of course, they are linear.

This causes some noise. Worse, we can expect severe banding in the shadows. Is this banding worse in post-proc gain, or in ISO gain? I haven’t tested this.