Culling grouped RAW + JPEG based on JPEG as group leader?

twil69 · March 28, 2023, 10:45am

I went through the search results for culling but could not quite find a fully matching existing answer to my question, so I am opening a new topic.

I am shooting in RAW and JPEG and import both in Darktable (4.2.1 at the moment).
Both file types will be grouped during import, with RAW as the group leader.
Then I start culling: Initially all images are unrated. I set a filter to unrated only and then apply 1 star or reject the image, so I am working on a shrinking list of to-be-decided images. I understand that that rating applies to the entire group, so when I set the filter to rejected afterwards, I can delete all the RAW+JPEG pairs I decided to dump. So far so good.
The thing is, that I prefer the full screen view (using the w shortcut) for culling. And since the RAW is the group leader, the larger preview/thumnail needs to be computed first, which results in a delay. Even worse, the resulting preview is dark and dull, just as of you open the RAW in darkroom and have the basic default processing applied.
If the JPEG was the group leader, it would be selected w/o any further delay or processing and the quality is for culling good enough. There is an option to switch the group leader to JPEG, but unfortunately this can only be applied to an individual pair, not to the whole selection (or even better, as a preference).
Question: how can I use culling on entire groups, based on the full screen JPEG preview?
BTW: I also noticed, the embedded JPEG from the RAW would be good enough, too. It is briefly visible, before it is replaced with the dull and dark basic processing version. Unfortunately I could not find a preference setting to keep it and suppress thumbnail re-creation.

priort · March 28, 2023, 5:20pm

You could try Bill’s script.

github.com

darktable-org/lua-scripts/blob/master/contrib/change_group_leader.lua

--[[
  change group leader

  copyright (c) 2020, 2022 Bill Ferguson <wpferguson@gmail.com>
  copyright (c) 2021 Angel Angelov

  darktable is free software: you can redistribute it and/or modify
  it under the terms of the GNU General Public License as published by
  the Free Software Foundation, either version 3 of the License, or
  (at your option) any later version.

  darktable is distributed in the hope that it will be useful,
  but WITHOUT ANY WARRANTY; without even the implied warranty of
  MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
  GNU General Public License for more details.

  You should have received a copy of the GNU General Public License
  along with darktable.  If not, see <http://www.gnu.org/licenses/>.
]]

This file has been truncated. show original

You may just have to enable it by running it in the lua scripts manager… found in LT view…

g-man · March 28, 2023, 5:34pm

https://docs.darktable.org/usermanual/4.2/en/preferences-settings/lighttable/#thumbnails

use raw file instead of embedded JPEG from size

Try setting this to never.

AlicVB · March 28, 2023, 6:52pm

note that depending of your camera and screen size, this may not work (some camera have a “small” embedded jpeg… The reason why the embedded jpeg is used in culling but not in full preview, is certainly a matter of size…

note too that changing the group leader will means that double-click on the thumb will open the jpeg in darkroom, not the raw file… which may be not what you want…

difrkaguilar · March 28, 2023, 8:47pm

I used this lua script, and I think it’s great, the image selection process is faster when jpg is leading. And noticed an issue, not with the script, but in the stars rating with shortcuts when images are grouped (this is in the master branch, don’t know if this happens with version 4.2.1), I reported about it on GitHub anyway.

github.com/darktable-org/darktable

"applying rating 1 of 2 images" message NOT appears using shortcuts keys.

opened 02:14AM - 18 Mar 23 UTC

difrkaguilar

**Describe the bug/issue** In the full preview layout view, if images are colle…cted as a group (any leader, JPG+RAW or RAW+JPG) and users select with the mouse a star from 1 to 5 on the top overlay box to rating the images, the info about the rating appears. "applying rating 1 of 2 images". But instead use the mouse, if users select the shortcuts key from 1 to 5, the message "applying rating 1 of 2 images" NOT appears and there isn't any visual feedback of the selection. **To Reproduce** **This issue is with images collected as a group** 1. Go to full preview layout using the "f" shortcut 2. Click on any star at the top left overlay box (the text: "applying rating 1 of 2 images" appears). 3. With the same images or other pair of images, use the shortcuts keys from 1 to 5 to rating. 4. The text: "applying rating 1 of 2 images" NOT appears. **Expected behavior** The visual feedback must appear using the mouse over the stars of using the shortcuts keys. **Platform** darktable version : 4.3.0~git1262.6e600f8a-9476.1 OS: Fedora release 37 (Thirty Seven) x86_64 Host: Z390 AORUS MASTER Kernel: 6.1.18-603.inttf.fc37.x86_64 Uptime: 12 hours, 15 mins Packages: 2009 (rpm) Shell: zsh 5.9 Resolution: 3840x2160 DE: GNOME 43.3 WM: Mutter WM Theme: Adwaita Theme: WhiteSur-Dark [GTK2/3] Icons: WhiteSur [GTK2/3] Terminal: alacritty CPU: Intel i7-9700K (8) @ 4.900GHz GPU: NVIDIA GeForce GTX 1070 GPU: NVIDIA GeForce GTX 1080 Ti Memory: 6506MiB / 32016MiB Graphics driver: OpenCL installed: Yes OpenCL activated: Yes Xorg: Yes

julibito · December 22, 2023, 4:03pm

Hey there,
I have the same problem as twil69 had. After searching I found this topic and was pleased zu get a solution.
The script works fine with my Fuji’s *.jpg an *.raf files. In both directions.

But since about 2 months I have an new camera which delivers *.jpg and *.dng files.
The DNGs work fine with dt. No problems until now.
Running the script above does also what to it has to do when changing the group header from DNG to JPG. But reverse there’s no change. The header remains to JPG, no matter I have selceted as group header, also at ‘non-raw’. I don’t know, what I’m doing wrong. Is there anybody who solved this problem?
The files are right out of camera and just imported. I can see the files, can develop them and all other things. So I think the files are allright. And DNG is not a new file format. Is it possible that DNGs are not identified as raw format?

I hope there is somone who can help me. This will improve my worklow hardly.
Thanks
Thomas

julibito · December 22, 2023, 5:23pm

Sorry, I have to withdraw my question. Just in the last minutes i’ve update to dt 4.6.0. Now it works fine, also with DNGs.
I don’t know why. Perhaps I have restarted dt. Sorry.

julibito · December 26, 2023, 12:52pm

Sorry, it happens again
Yesterday I import DNGs and JPGs. With the lua-script I changed the group headers to the JPGs. It worked quite nice. Afterwards I marked the phots I want to edit with stars.

Today I want change the group headers to the DNGs and it doesn’t work. I#ve tried it several times in all possible directions (RAW, JPG, non of them). Nothing happens. I restarted dt, but also the same.
The same as descriped to posts above.

Can somone help me? What I do wrong?

Thanks
Thomas

quovadit · January 22, 2024, 5:45am

I have the same problem as @twil69 had last year, but the solution by @g-man does not work (anymore?)

I always had “use raw file…” set to “never”, but I only see the embedded jpg while the raw gets automatically generated when using full preview layout (shortcut f).

My current “solution” is to shoot raw+jpg and change the lead to jpg (as described above).

But it’s quite weird to always have twice as many images as necessary.

Is there a way to use the embedded jpg in full preview layout (until the image was edited in darkroom)

(still using 4.4.2 running debian… )