AI Feature Requests

To the devs working on AI, my thanks and congratulations on really important contributions to darktable. The AI masking feature is already so fast and helpful it is my default masking solution for every module and makes editing so much more convenient and quick. The AI Denoise work is progressing really well and I am often using it instead of DXO PureRaw, which is a testament to the calibre of the work.

Feature Request: Tagging photos in darktable has been made easier by the Quick Tag module, but it could be much easier with AI image recognition. RapidRaw, another open source photo editing tool, has this feature and it works progressively better as you use it, which I think indicates that it enhances its own LLM with your data to add image tags based on your classifications. This feature would be fantastic in darktable.

AI Culling. I often bring home thousands of photos and even with AI subject recognition in my camera, there are often quite a few out of focus shots. It could be great if a module could be developed to perform this task.

I am sure someone will object to these ideas. Fine. Some will also tell me to do what I ask for. Also fine. If I could I would.

Just ideas.

5 Likes

How does the auto tagging in digikam compare with your request?

I’d suggest not stirring the AI pot after how the latest discussions went on here.

I understand your requests from a functional point of view but feel like now is not the right time.

1 Like

Now is always the right time to ask questions.

2 Likes

RapidRaw does it automatically when you add a folder. Quite nice really.

Yes, they went badly, I agree. One of the recent discussions even “went” to personal attack on me. But I want to say that the culprit is not some mythical “AI” (I hate this term, it’s just a hyped marketing name, in fact in our case it’s neural networks). And the problem is also not in the discussions that somehow go in a bad direction by themselves. The culprit is always a specific person who puts their opinions above civilized human communication.

And if the thread just turns into fruitless and off-topic comments about how each of us feels about AI as a phenomenon… I don’t see anything bad with that for us as a community, except that it’s just a waste of time.

I understand that this is what you feel. I even understand perfectly well why you have such concerns. But what does this mean from a practical point of view? Should we shut up and not discuss the implementation of certain features in darktable? How long do we have to wait until the right time comes?

3 Likes

I only saw this recently but Gimp has a no AI policy. I don’t when they arrived at this or if there was the level of discussion we had here.

I believe RapidRaw uses OpenAI’s CLIP model converted from PyTorch to ONNX.

I would suggest focusing now on testing and troubleshooting the already added neural network tools.

@bminney Can you provide a link to this? Or at least outline the main points?

Here you go. Let me know if I’ve misunderstood this.

I quote a tweet from the official GIMP Twitter account:

“We have a no-AI policy: we need people who’ll understand the code they write - it needs to be maintained”

In darktable, in essence, we have exactly the same “no-AI policy” (although not yet formally published): we have to see that contributors understand the code they propose to add. This does not mean that it is forbidden to use AI coding assistants. Such a requirement would be as stupid as, say, the requirement not to use fragments from StackOverflow…

But I don’t know how you understood it… Maybe you read it as GIMP banning tools and algorithms that use neural networks - no, I don’t see any confirmation.

2 Likes

Lucky we have you to help us sort out these discussions.

So are you saying that I did misunderstood the policy of no AI for GIMP?
It looked quite clear to me from that post.
I’ll keep quiet in future

@Steven_Adler1 thank you for sharing your thoughts. These features are actually what I already started working on.

First, and the most important model for these features - OpenCLIP is already in darktable-ai master. Some tagging prototypes are also in my branches.

My plan is to work on this during 5.7 development cycle, optimistically to have it in 5.8 release.

5 Likes

Thank you for your efforts to build these additions to darktable. Great work!

2 Likes