current OSX Build

MStraeten · January 26, 2021, 8:10pm

I haven’t tested this. I‘m pretty sure, tweaking the opencl settings is an easier way to improve performance. Building yourself is useful if you want to get rid of some annoying issues in the distributed 3.4 package.

MStraeten · January 30, 2021, 4:14pm

new build current master + OSX scrolling improvement + vectorscope + experimental diffusion module: darktable-3.5.0+918~gc35effa12.dmg
built with sdk 10.15
be aware there’s stuff that won’t be in 3.4.1 so don’t forget a backup first - there’s no way back…

lsdphoto · January 30, 2021, 4:16pm

Thanks for the update. What is the ‘OSX scrolling improvement’?

Lee

MStraeten · January 30, 2021, 4:36pm

https://github.com/darktable-org/darktable/pull/7904

Rajkhand · February 7, 2021, 2:54pm

Many of the preferences have vanish e.g the import module is only showing

while importing there is no option for adding the file types to import or tagging

eyedear · February 7, 2021, 3:20pm

I think that settings has been move to the lighttable page on your import module as shown below

Rajkhand · February 7, 2021, 4:20pm

Thanks

MStraeten · February 7, 2021, 5:12pm

new build current master + vectorscope + experimental diffusion module: darktable-3.5.0+1006~gd25827e56.dmg
built with sdk 10.15
be aware there’s stuff that’s not in 3.4.1 so don’t forget a backup first - there’s no way back…

zurdo · February 8, 2021, 11:41am

Thank you for the new build, I am playing with the diffuse or sharpen module, it is very interesting and I was trying to find info about it but no luck (not even in the commits listing), any hint where to look for ?

MStraeten · February 8, 2021, 12:03pm

github.com/darktable-org/darktable

add a diffusion module

darktable-org:master ← aurelienpierre:diffuse

opened 01:00AM - 04 Jan 21 UTC

aurelienpierre

+1854 -0

This implements an heat transfer partial derivative equations solver, adapted fr…om https://www.researchgate.net/publication/220663968 and originally meant for image inpainting and reconstruction. However, I have found that it doesn't really reconstruct anything unless you apply a large amount of iterations, which is not compatible with dt's "realtime"-ish purpose. The algorithm is adapted for a wavelets framework, which makes it super slow (OpenCL incoming ASAP) but allows to include spatiality in the parameters. It's very close in logic to the filmic highlights reconstruction. Basically, it allows to make pixels spill (or un-spill) on their neighbours. ![Screenshot_20210104_014715](https://user-images.githubusercontent.com/2779157/103493025-3dab5480-4e2f-11eb-9f59-2e91b79d471c.png) The module comes with 4 presets to showcase what it can do, since it's quite close to physics and can be used in a variety of situations: 1. blind deconvolution by gradient descent, following the steepest gradient direction, 2. anisotropic diffusion, or directional blur if you prefer, propagating colors in the perpendicular direction of edges, (so, either 4. joint sharpening and denoising, 5. highlights inpainting (although I'm not convinced by the results). ## Use case 1 The motivation for this module was to spill image colors outside of its borders, as a special effect for prints: ![Demi-marathon Hadrien-0044-_DSC0487_04](https://user-images.githubusercontent.com/2779157/103493020-37b57380-4e2f-11eb-9308-e9bd3fa2b628.jpg) This is achieved by underlaying a framing module, for which I had to remove the iop_order fences in rawoverexposed.c and finalscale.c. This seems to make dt crash sometimes, even though it's hard to know what is responsible for the crashes these days. ## Use case 2 Deblur. For this, the module is put right after exposure. Before/After 1/After 2/After 3 (images at 1:1): ![Demi-marathon Hadrien-0044-_DSC0487_06](https://user-images.githubusercontent.com/2779157/103493215-3cc6f280-4e30-11eb-99ac-41ce838206b2.jpg) ![Demi-marathon Hadrien-0044-_DSC0487_05](https://user-images.githubusercontent.com/2779157/103493216-3df81f80-4e30-11eb-875f-dd112cc50bd8.jpg) ![Demi-marathon Hadrien-0044-_DSC0487_07](https://user-images.githubusercontent.com/2779157/103706668-7c671900-4fad-11eb-9486-bbbcc626dfda.jpg) ![Demi-marathon Hadrien-0044-_DSC0487_08](https://user-images.githubusercontent.com/2779157/103707554-1a0f1800-4faf-11eb-845e-b5880c7669b1.jpg) Notice that it respects the depth of field fairly well and does not display halos. The filter is applied on linear RGB so it's really suited to remove non-uniform lens blur. ## Caveats The module is slow… Not much I can do besides providing an OpenCL kernel. 1 to 2 iterations are ok, up to 4 iterations is meh, more than 4 iterations is something you can do before taking a walk. ## How to use Read the tooltips and use the presets. Details below. ### General Every order of derivatives comes with 3 sliders: * strength: * positive values make that derivative smoother (diffusion), * negative values make that derivative more oscillatory (sharpening), * edges directivity: * high values make the 2D derivatives more directional (anisotropic), following a direction perpendicular to the steepest gradient * low values makes the 2D derivatives more uniform (isotropic), in a radial direction, more like usual blurs, * edges regularization: * high values apply an higher penalty to derivatives of high magnitude, to avoid overshoot and gradient reversals around edges, * low values apply a lower (or even close to none) penalty to derivatives of high magnitude, allowing stronger effects but also overshoots. * low magnitude derivatives (zero and close) are never affected by the regularization parameter. The value of the regularization drives the speed of the transition between the low and high magnitude. Overshoots cause artifacts, such asnoise, gradient reversals (halos, fringes), etc. If they happen, you need to dampen your derivatives (strength and/or regularization). The speed of diffusion is a general factor applied to all strengths settings at once. As the number of iterations increases, it's a good idea to decrease the speed to avoid issues. ### First order First order derivatives are linked to simple diffusion, such as hazing and light leaks. Used in sharpening mode, it's very prone to gradients reversals, so don't force on the strength. ### Second order The second order is isotropic because it is simply the detail layer of the wavelets separation, that uses a B-spline blur. This setting is exactly similar to the luma curve in contrast equalizer, but the wavelets decomposition is applied in linear RGB instead of Lab. Second order derivatives are linked to sharp edges and acutance (local filter), but also to noise. ### Third order The third order is linked to the smoothness of the second, so it can be used to alleviate noise when the second order is used in sharpening mode. ### Non-local fourth order The non-local fourth order will increase or decrease the curvature of the second order by sampling points further away. This can be used to inpaint the texture in damaged areas, or smoothen or increase oscillations. Used with large radii (> 128 px), and small strength, it behaves in the same spirit as the local laplacian for local contrast enhancement. ### Spirit Start with setting the first and second orders roughly, as they yield the more dramatic results, zoomed-out. When you are sort-of pleased with the result, zoom-in and fine-tune with the third order by watching out for noise. Finish with fourth order for non-local effects like increasing the volume of features. Then finish with the diffusion speed, to boost or temper the correction. For large deblurrings, inpaintings or joint sharpening + denoising, more iterations will be needed with smaller diffusion speed to avoid overshoots. In the literature, such applications need more than 50 iterations. By combining the weights of each order, you are virtually able to add or remove any kind of diffusion (atmospheric hazing, frosten glass, lens blur, coma, etc.) or even perform edge-aware surface blurs. While the same method could be used to denoise, it doesn't take advantage of the inter-channels correlations, so it's no better than the usual denoising modules (but could be modified in Y0U0V0 for that purpose).

zurdo · February 8, 2021, 12:05pm

Thank you !

MStraeten · February 13, 2021, 8:10am

new build current master + vectorscope + experimental diffusion + vibrancergb module: darktable-3.5.0+1100~g804b54a77.dmg
built with sdk 10.15
be aware there’s stuff that’s not in 3.4.x so don’t forget a backup first - there’s no way back…

MStraeten · February 21, 2021, 1:25pm

new build current master + vectorscope + experimental diffusion
darktable-3.5.0+1184~ge4542ade9.dmg
built with sdk 10.15

MStraeten · February 28, 2021, 7:52am

new build current master + vectorscope + experimental diffusion
darktable-3.5.0+1288~g9eced30b36.dmg
built with sdk 10.15

MStraeten · March 14, 2021, 8:36pm

new build current master + vectorscope + experimental diffusion + sigmoid
darktable-3.5.0+1491~g6b996cd9f.dmg
built with sdk 10.15

olivier · March 18, 2021, 4:27pm

HI!

Thanks @MStraeten for this work !

I’m trying to compile myself darktable. I’m using homebrew on Big Sur intel. Almost all packages are installed in /usr/local/ (even the /usr/local/opt). I update the path accordingly in cmake commandline.

For now, I achieve compiling with -DCMAKE_OSX_DEPLOYMENT_TARGET=11.0 without problem (3.5.0+1441) ! I only miss the tango-icon-theme pakage, but it seems there is no visible issue not having it installed. Or is it ?

My problem is packaging. Are missing the curl-ca-bundle cert (/usr/local/share/curl/curl-ca-bundle.crt) and mime (/usr/local/share/mime). None of them are available in homebrew.

What are the modifications I should do to be able to package ? any ideas ?

Thanks !

MStraeten · March 18, 2021, 5:02pm

i build it using the macports descriptions in darktable/BUILD.txt at master · darktable-org/darktable · GitHub

i’m not using homebrew, so i can’t help here. Maybe the ci section can help - this ist based on homebrew:

github.com

darktable-org/darktable/blob/master/.ci/Brewfile

#    This file is part of darktable.
#    copyright (c) 2016 Roman Lebedev.
#
#    darktable is free software: you can redistribute it and/or modify
#    it under the terms of the GNU General Public License as published by
#    the Free Software Foundation, either version 3 of the License, or
#    (at your option) any later version.
#
#    darktable is distributed in the hope that it will be useful,
#    but WITHOUT ANY WARRANTY; without even the implied warranty of
#    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
#    GNU General Public License for more details.
#
#    You should have received a copy of the GNU General Public License
#    along with darktable.  If not, see <http://www.gnu.org/licenses/>.

brew 'cmake'
brew 'desktop-file-utils'
brew 'exiv2'
brew 'gettext'

This file has been truncated. show original

rgo · March 18, 2021, 5:14pm

I created a formula that compiled darktable but it crashed a lot (I didn’t patch the libraries as it’s indicated in the macports build).

If you want to use it as reference: GitHub - rgo/homebrew-darktable: Darktable formula to have a manual/procedure to build it for power-users-who-are-still-not-devs.

Someday, I’ll should spend sometime polishing it.

olivier · March 18, 2021, 5:21pm

Thanks I’ll try these. I have almost all of them installed. curl for example doesn’t contain the cert, though.

olivier · March 18, 2021, 5:23pm

OK,I’ll have a look too ! I see your formulae compiles but doesn’t packages yet, right ? for now I can compile and run. Not yet package.