Testing AI Object Masks in darktable nightly builds

Software darktable
123

With the nightly appimage:

    12.8825 [darktable_ai] dt_ai_env_init start.
    12.8828 [darktable_ai] discovered: mask segnext vitb-sax2 hq (mask-object-segnext-b2hq, backend=onnx)
    12.8829 [darktable_ai] discovered: mask sam2.1 hiera small (mask-object-sam21-small, backend=onnx)
    12.8830 [darktable_ai] discovered: mask sam2.1 hiera base plus (mask-object-sam21-base-plus, backend=onnx)
    12.8836 [darktable_ai] failed to load ORT library '/home/runner/work/darktable/darktable/src/build/_deps/onnxruntime/lib/libonnxruntime.so': /home/runner/work/darktable/darktable/src/build/_deps/onnxruntime/lib/libonnxruntime.so: cannot open shared object file: No such file or directory
    12.8836 [segmentation] failed to load encoder for mask-object-sam21-small

However the library libonnxruntime.so seems to be present in the appimage.

124

Thank you. Fix is on the way.

125

I posted about it here. But this is old stuff now, so I doubt that the experience is still valid.

A week is a long tine in darktable :smiley:

And, as mentioned, I moved on to building from git.

126

Building is definitely an option. AppImage will be ready for AI features soon too.

2 Likes
127

Thank you

128

Being patiently impatient

1 Like
129

I have just started using the new AI masking. I don’t see an option for adjusting brush size as I only have crosshairs showing. Am I missing something in my understanding or use of the AI masking? Thanks for your work on this.

130

Hi Terry … a change took place in the concept of the tool .
Now it is just only done by clicking ( crosshair ) within the desired subject , as far as i understood correctly it was not that much precise with the brush option .

131

FYI you can now download and install the base plus model for better selection …

1 Like
132

Brush had to be removed as it produced inconsistent results.
I can not change initial post, but there was and update in the middle of the thread.

133

How and where do I download this model? Thanks

134

here you go …

1 Like
135

Updates in AI

AI features work in AppImage

  • ONNX Runtime is correctly bundled in AppImage, so all AI features work out-of-the-box

Configurable Custom ONNX Runtimes

1 Like
136

Works like a charm now on my Fedora 43 KDE. Thanks!

I was wondering… It doesn’t seem to be available in the retouch module. Maybe it would be nice to be able to use it there. Would that be possible or are there technical challenges?

1 Like
137

Slightly confusing, because it looks the same in use, but what I have learnt (here :slight_smile: ) is that the the retouch module uses selection not masking.

138

Thanks for sorting out the Bezier handles @anry, that’s much better :+1:

1 Like
139

But isn’t AI making a selection which is being used for a mask?

140

Best would be retouch module with ai masking and ai inpainting to remove unwanted objects … just dreaming :wink:

1 Like
141

Get PS …. Instead of dreaming :rofl::rofl::rofl:

142

Well dreams are free. PS isn’t

1 Like