Call for white balance finetuning samples

johnny-bit · March 25, 2020, 10:59pm

Hi!

I’m researching stuff because I’d like to enhance extract_wb script in darktable and thus have better wb presets available.

Here’s what I need you to do
//edit: NEW STEPS!!!

To owners of Canon/Nikon cameras - your cameras are now fully supported!
To owners of Fuji - I think we have problem with fuji needs samples!
To owners of other cameras: things seem to go well, need more samples

Set you white balance to any pre-defined preset. Make sure the preset is NOT Auto/Custom/Manual. It needs to be something predictible, like Daylight, Shade, Incandescent
We’re gonna be doing whitebalance finetuning and shooting RAW. For this expriment I’ll need 3 shots from you, but for full finetuning in the future, darktable will need A LOT MORE (but don’t worry about it). Please make sure that you use same exposure & iso settings for all 3 shots, and prefferably shots need to be done in same timeframe
Set your white balance preset finetuning to maximum amber on amber-blue scale/range/axis. Make sure that your ‘magenta-green’ scale/range/axis is set to 0 (centered). Take 1 shot
move back 1 click away from amber and towards blue (still 0 on magenta-green axis). and take 1 shot
center your finetuning (both axis on 0) so no finetuning is applied (this is just to validate data) and take 1 shot.
do not delete the files
for every image run the command below and post results (I also have convenience script)

exiftool -Make -Model "-WBType*" "-WB_*" "-ColorTemp*" \
     -WhiteBalance -WhiteBalance2 -WhitePoint -ColorCompensationFilter \
     -WBShiftAB -WBShiftAB_GM -WBShiftAB_GM_Precise -WBShiftGM -WBScale \
     -WhiteBalanceFineTune -WhiteBalanceComp -WhiteBalanceSetting \
     -WhiteBalanceBracket -WhiteBalanceBias -WBMode -WhiteBalanceMode \
     -WhiteBalanceTemperature -WhiteBalanceDetected -ColorTemperature \
     -WBShiftIntelligentAuto -WBShiftCreativeControl -WhiteBalanceSetup \
     -WBRedLevel -WBBlueLevel -WBGreenLevel -RedBalance -BlueBalance \
     "IMAGE.RAW"

Post results here

Convinience script:
extract_wb_from_images.sh

you can call it like this:
extract_wb_from_images.sh IMAGE1.RAW IMAGE2.RAW IMAGE3.RAW
(or if you’re in directory with only those 3 images):
extract_wb_from_images.sh *
and it’ll produce nice little package You can post just the package then

To Fuji owners:

It seems like there’s no meaningfull data for Fuji fine adjustments in exif.
First - check your exiftool version (should be 11.91 or newer for fuji stuff):
exiftool -ver
then extract ALL data from exif of 2 neighbouring files (eg -9 and -8 finetuning):

exiftool -u -a -e -g1 FILE1.RAF > F1;
exiftool -u -a -e -g1 FILE2.RAF > F2

next try to find differences between files:
diff F1 F2

Now look at the diff and see if there’s any difference .
Ignore any date/time, preview image, image count, thumbnail and offsets stuff. See what’s left.
If what’s left is only White Balance Fine Tune and possibly WB GRB Levels Auto then it means Fuji doesn’t include tuned data in their exif

Current Status

Canon - Works flawlessly
Nikon - Works flawlessly
Sony - Works flawlessly
Pentax - Works flawlessly
Panasonic - Works flawlessly
Olympus - Works flawlessly
Samsung - NEEDS MORE SAMPLES
others - needs samples
Fuji - complex, see more

Previous instructions for posterity

Set your whitebalence preset to any pre-defined preset. I believe that “Daylight” is the most universal one
Set your whitebalance preset finetuning in amber-blue range maximally towards amber (you might need to dig in the manual to know where it is, but I assure you the finetuning is there)
take one shot making sure to use RAW (you can even leave the cap on on the lens :P)
take the raw file and execute following command: exiftool "-WB_*" -WhiteBalance -WhiteBalance2 -WhitePoint -Make -Model -WBShiftAB -WBShiftAB_GM -WhiteBalanceFineTune -WBShiftIntelligentAuto -WBShiftCreativeControl "FILENAME.RAW"
post the results here.

Example:

$ exiftool "-WB_*" -WhiteBalance -WhiteBalance2 -WhitePoint -Make -Model -WBShiftAB -WBShiftAB_GM -WhiteBalanceFineTune -WBShiftIntelligentAuto -WBShiftCreativeControl "IMG_0074.CR2"
WB RGGB Levels As Shot          : 1594 1024 1024 1971
WB RGGB Levels Auto             : 1628 1024 1024 1876
WB RGGB Levels Measured         : 1628 1024 1024 1876
WB RGGB Levels Daylight         : 1817 1024 1024 1711
WB RGGB Levels Shade            : 2101 1024 1024 1487
WB RGGB Levels Cloudy           : 1949 1024 1024 1596
WB RGGB Levels Tungsten         : 1279 1024 1024 2439
WB RGGB Levels Fluorescent      : 1513 1024 1024 2289
WB RGGB Levels Kelvin           : 1817 1024 1024 1711
WB RGGB Levels Flash            : 2005 1024 1024 1574
WB RGGB Levels                  : 1594 1024 1024 1971
White Balance                   : Daylight
Make                            : Canon
Camera Model Name               : Canon EOS 77D
WB Shift AB                     : -9

Edit: if you can do max amber and one step before max amber it would be great! If your camera is doing “half steps” then one half-step before max amber please

and needs to be different than canon

Jade_NL · March 26, 2020, 8:09am

Here’s my LX100M2:

WB RGB Levels 1                 : 578 256 535
WB RGB Levels 2                 : 615 256 498
WB RGB Levels 3                 : 645 256 467
WB RGB Levels 4                 : 423 256 795
WB RGB Levels 5                 : 601 256 483
WB RGB Levels 6                 : 534 256 557
WB RGB Levels 7                 : 423 256 795
WB CFA0 Level Daylight          : 2138
WB CFA1 Level Daylight          : 1024
WB CFA2 Level Daylight          : 1024
WB CFA3 Level Daylight          : 2231
WB Red Level Auto               : 2313
WB Blue Level Auto              : 2143
White Balance                   : Daylight
Make                            : Panasonic
Camera Model Name               : DC-LX100M2
WB Shift AB                     : -9
WB Shift Intelligent Auto       : 0
WB Shift Creative Control       : 0

Not sure why the output is so different from the previous one but this is my D750 (doesn’t have a daylight setting, so I used the sunny preset):

WB RB Levels                    : 2.11328125 1.203125 1 1
White Balance                   : Sunny
Make                            : NIKON CORPORATION
Camera Model Name               : NIKON D750
White Balance Fine Tune         : -6 0

Coding_Dave · March 26, 2020, 8:30am

This is my D750 using the cloudy icon (6000K):

WB RB Levels                    : 2.2890625 1.1328125 1 1
White Balance                   : Cloudy
Make                            : NIKON CORPORATION
Camera Model Name               : NIKON D750
White Balance Fine Tune         : -6 0

The camera goes in half steps increment from B(lue)-6 to A(mber)+6, 12 to each side resulting in 25 steps (including the 0 position).

Claes · March 26, 2020, 8:47am

WB GRB Levels Standard          : 302 387 690 17 302 665 408 21
WB GRB Levels Auto              : 302 574 491
WB GRB Levels                   : 302 580 470
White Balance                   : Daylight
Make                            : FUJIFILM
Camera Model Name               : X-T1
White Balance Fine Tune         : Red +0, Blue -180

Jade_NL · March 26, 2020, 10:36am

@johnny-bit: You specifically asked for these, so I provide…

This is -8:

WB RGB Levels 1                 : 578 256 535
WB RGB Levels 2                 : 615 256 498
WB RGB Levels 3                 : 645 256 467
WB RGB Levels 4                 : 423 256 795
WB RGB Levels 5                 : 601 256 483
WB RGB Levels 6                 : 534 256 557
WB RGB Levels 7                 : 423 256 795
WB CFA0 Level Daylight          : 2138
WB CFA1 Level Daylight          : 1024
WB CFA2 Level Daylight          : 1024
WB CFA3 Level Daylight          : 2231
WB Red Level Auto               : 2313
WB Blue Level Auto              : 2143
White Balance                   : Daylight
Make                            : Panasonic
Camera Model Name               : DC-LX100M2
WB Shift AB                     : -8
WB Shift Intelligent Auto       : 0
WB Shift Creative Control       : 0

And just in case: -7

WB RGB Levels 1                 : 578 256 535
WB RGB Levels 2                 : 615 256 498
WB RGB Levels 3                 : 645 256 467
WB RGB Levels 4                 : 423 256 795
WB RGB Levels 5                 : 601 256 483
WB RGB Levels 6                 : 534 256 557
WB RGB Levels 7                 : 423 256 795
WB CFA0 Level Daylight          : 2138
WB CFA1 Level Daylight          : 1024
WB CFA2 Level Daylight          : 1024
WB CFA3 Level Daylight          : 2231
WB Red Level Auto               : 2313
WB Blue Level Auto              : 2143
White Balance                   : Daylight
Make                            : Panasonic
Camera Model Name               : DC-LX100M2
WB Shift AB                     : -7
WB Shift Intelligent Auto       : 0
WB Shift Creative Control       : 0

There are no steps in between -9, -8 and -7.

johnny-bit · March 26, 2020, 10:55am

Thanks! Can you or @Coding_Dave do nikon? I think it’ll go -6 then -5.5

@Claes - can you do one step before max amber? I wonder whether it’ll go -170 or -175 or -160 or something completelly different

mrwsl · March 26, 2020, 10:58am

Here is my output from the Sony Alpha 6000:

WB RGB Levels                   : 703 256 441
WB RGGB Levels Auto             : 2816 1024 1024 1768
WB RGGB Levels                  : 3456 1024 1024 1388
WB RGB Levels Daylight          : 2816 1024 1768
WB RGB Levels Cloudy            : 3024 1024 1624
WB RGB Levels Tungsten          : 1784 1024 3176
WB RGB Levels Flash             : 3196 1024 1624
WB RGB Levels 4500K             : 2556 1024 1992
WB RGB Levels Shade             : 3308 1024 1460
WB RGB Levels Fluorescent       : 2564 1024 2604
WB RGB Levels Fluorescent P1    : 2716 1024 1872
WB RGB Levels Fluorescent P2    : 3032 1024 1696
WB RGB Levels Fluorescent M1    : 2052 1024 3136
WB RGB Levels 8500K             : 3468 1024 1384
WB RGB Levels 6000K             : 3000 1024 1636
WB RGB Levels 3200K             : 1984 1024 2756
WB RGB Levels 2500K             : 1560 1024 3824
White Balance                   : Daylight
White Point                     : 0.313 0.329
Make                            : SONY
Camera Model Name               : ILCE-6000
WB Shift AB GM                  : 7 0
White Balance Fine Tune         : 0

Edit:

WB RGB Levels                   : 703 255 441
WB RGGB Levels Auto             : 2816 1024 1024 1768
WB RGGB Levels                  : 3356 1024 1024 1436
WB RGB Levels Daylight          : 2816 1024 1768
WB RGB Levels Cloudy            : 3024 1024 1624
WB RGB Levels Tungsten          : 1784 1024 3176
WB RGB Levels Flash             : 3196 1024 1624
WB RGB Levels 4500K             : 2556 1024 1992
WB RGB Levels Shade             : 3308 1024 1460
WB RGB Levels Fluorescent       : 2564 1024 2604
WB RGB Levels Fluorescent P1    : 2716 1024 1872
WB RGB Levels Fluorescent P2    : 3032 1024 1696
WB RGB Levels Fluorescent M1    : 2052 1024 3136
WB RGB Levels 8500K             : 3468 1024 1384
WB RGB Levels 6000K             : 3000 1024 1636
WB RGB Levels 3200K             : 1984 1024 2756
WB RGB Levels 2500K             : 1560 1024 3824
White Balance                   : Daylight
White Point                     : 0.313 0.329
Make                            : SONY
Camera Model Name               : ILCE-6000
WB Shift AB GM                  : 6 0
White Balance Fine Tune         : 0

Jade_NL · March 26, 2020, 10:58am

You want a particular preset? I did notice that mine (sunny) and Coding_Dave (cloudy) do differ. Or do you want both (and more?)?

johnny-bit · March 26, 2020, 11:10am

hi @mrwsl! that’s perfect! thanks!
btw: welcome to pixls.us!

Nope! can be any named preset

Jade_NL · March 26, 2020, 11:16am

The output might suggest this isn’t -5.5 but it is. I double checked and redid the images twice:

Preset sunny and -5.5

WB RB Levels                    : 2.09765625 1.2109375 1 1
White Balance                   : Sunny
Make                            : NIKON CORPORATION
Camera Model Name               : NIKON D750
White Balance Fine Tune         : -6 0   <---  is -5.5 double checked

Preset sunny and -5.0

WB RB Levels                    : 2.08203125 1.22265625 1 1
White Balance                   : Sunny
Make                            : NIKON CORPORATION
Camera Model Name               : NIKON D750
White Balance Fine Tune         : -5 0

In camera (info screen, not the amber-blue change screen) I can see that the offset is A 5.5, might be a rounding thingy in exiftool?

johnny-bit · March 26, 2020, 11:29am

This MIGHT be a problem in exiftool if the info is in exif… according to Nikon Tags it’s int16[n] so it’s integer… damn… this complicates nikon stuff a bit

Claes · March 26, 2020, 12:05pm

Of course.

WB GRB Levels Standard          : 302 387 690 17 302 665 408 21
WB GRB Levels Auto              : 302 564 514
WB GRB Levels                   : 302 580 470
White Balance                   : Daylight
Make                            : FUJIFILM
Camera Model Name               : X-T1
White Balance Fine Tune         : Red +0, Blue -160

Jade_NL · March 26, 2020, 12:22pm

This is probably a Nikon thing:

$ exiv2 -pa D75_0715.NEF | egrep -i "white|wb"
Exif.Image.ReferenceBlackWhite               Rational    6  0/1 255/1 0/1 255/1 0/1 255/1
Exif.Nikon3.WhiteBalance                     Ascii      13  SUNNY       
Exif.Nikon3.WhiteBalanceBias                 SShort      2  -6 0     <----- -6 instead of -5.5
Exif.Nikon3.WB_RBLevels                      Rational    4  537/256 310/256 256/256 256/256
Exif.NikonCb2b.WB_RGGBLevels                 Short       4  1236 64700 60476 44188
Exif.Photo.WhiteBalance                      Short       1  Manual

Thomas_Gulmark · March 26, 2020, 6:17pm

Here’s the output from my Pentax K-1:

White Balance : Daylight
White Point : 19392 8192 8192 12256
Make : RICOH IMAGING COMPANY, LTD.
Camera Model Name : PENTAX K-1
WB Shift AB : -7

White Balance : Daylight
White Point : 19104 8192 8192 12448
Make : RICOH IMAGING COMPANY, LTD.
Camera Model Name : PENTAX K-1
WB Shift AB : -6

Claes · March 26, 2020, 6:21pm

@Thomas_Gulmark
Hallojsa!

Welcome!

Mvh
Claes fra Lund, Sverige

johnny-bit · March 26, 2020, 6:26pm

Hey @Thomas_Gulmark! welcome to the community and thanks for this! Pentax now added to list of sane exif data for wb finetuning

guille2306 · March 26, 2020, 6:32pm

Ha! I’ve just read that when coming to post my results

Anyway, just in case the model makes a difference, 5D mk II:

WB RGGB Levels As Shot          : 2433 1024 1024 1438
WB RGGB Levels Auto             : 2144 1024 1024 1708
WB RGGB Levels Measured         : 2144 1024 1024 1708
WB RGGB Levels Daylight         : 2144 1024 1024 1708
WB RGGB Levels Shade            : 2467 1024 1024 1411
WB RGGB Levels Cloudy           : 2310 1024 1024 1540
WB RGGB Levels Tungsten         : 1637 1103 1103 2897
WB RGGB Levels Fluorescent      : 1890 1048 1048 2548
WB RGGB Levels Kelvin           : 1712 1067 1067 2508
WB RGGB Levels Flash            : 2325 1024 1024 1522
WB RGGB Levels                  : 2433 1024 1024 1438
White Balance                   : Daylight
Make                            : Canon
Camera Model Name               : Canon EOS 5D Mark II
WB Shift AB                     : 9

750D:

WB RGGB Levels As Shot          : 2551 1024 1024 1509
WB RGGB Levels Auto             : 2236 1024 1024 1736
WB RGGB Levels Measured         : 2236 1024 1024 1736
WB RGGB Levels Daylight         : 2236 1024 1024 1736
WB RGGB Levels Shade            : 2589 1024 1024 1485
WB RGGB Levels Cloudy           : 2411 1024 1024 1601
WB RGGB Levels Tungsten         : 1563 1024 1024 2539
WB RGGB Levels Fluorescent      : 1896 1024 1024 2367
WB RGGB Levels Kelvin           : 2236 1024 1024 1736
WB RGGB Levels Flash            : 2485 1024 1024 1579
WB RGGB Levels                  : 2551 1024 1024 1509
White Balance                   : Daylight
Make                            : Canon
Camera Model Name               : Canon EOS 750D
WB Shift AB                     : 9

rawfiner · March 26, 2020, 7:09pm

Hi!
This is for Lumix FZ1000:
WB RGB Levels 1 : 603 256 470
WB RGB Levels 2 : 649 256 427
WB RGB Levels 3 : 684 256 404
WB RGB Levels 4 : 432 256 686
WB RGB Levels 5 : 641 256 448
WB RGB Levels 6 : 605 256 480
WB RGB Levels 7 : 432 256 686
WB CFA0 Level Daylight : 1024
WB CFA1 Level Daylight : 2420
WB CFA2 Level Daylight : 1923
WB CFA3 Level Daylight : 1024
WB Red Level Auto : 2425
WB Blue Level Auto : 1895
White Balance : Daylight
Make : Panasonic
Camera Model Name : DMC-FZ1000
WB Shift AB : -9
WB Shift Intelligent Auto : 0
WB Shift Creative Control : 0

And Fuji xt20:
WB GRB Levels Standard : 302 373 875 17 302 627 486 21
WB GRB Levels Auto : 302 362 942
WB GRB Levels : 302 555 562
White Balance : Daylight
Make : FUJIFILM
Camera Model Name : X-T20
White Balance Fine Tune : Red +180, Blue -180

johnny-bit · March 26, 2020, 8:31pm

And this verified my observation that I’m not good at following my own directions and my sample instead towards amber was towards blue I hope everyone here actually adjusted towards amber

Thanks! this is 2nd fuji sample but it differs from @Claes’s one… It seemed to only affect Blue part… Can you do one step before amber (and make sure you’re only on amber/blue dimmension and not on magenta/green one?)

rawfiner · March 26, 2020, 8:42pm

This is the setting I used, is that what you need? :