darktable speed (in general, and when using two monitors)

Darktable isn’t the fastest for me either. I’m running darktable on an i7-7700HQ DELL laptop with 16GB RAM and Nvidia GTX1060 6GB videocard on a Windows 10 OS. The images are pulled from either the HDD or the SSD (sometimes it depends).

I wish darktable was a little bit punchier and quicker. It’s great with jpg when it comes to speed, but with RAW images it lags a bit. Especially the heavier modules like exposure/curves etc.

When I open up OBS 64 bit, it slows down my laptop as well. If I use it to record darktable, the time between input and output is even longer. It sometimes takes 5-10 seconds before the changes are noticeable. It’s very annoying and the only thing I dislike about darktable.

I wish someone had the knowledge to fix that.

@Rico When you have the time, perform the two tests described here:

MvG
Claes in Lund, Zweden

I’ll have to read into that. I have no knowledge about stuff like CSS and coding.

Er… IF that was a reply to my post, above:
the test has nothing to do with stuff like CSS or coding.

@Rico
what @Claes would like you to participate in, is actually in this same thread above. Here is the link to that post

:blush:

Yeah I’ll see if I can try and get that to work!

Avonds, Rico!

Have you had time to check?

Mvg,
Claes in Lund, Zweden

Evening Claes, unfortunately not! I’m not feeling well atm and I’ll be out most of the day tomorrow. I’ll check and see if I can do it tomorrow.

Oh, I was just reacting to your statement (above):

I have a hunch about what might be your problem :slight_smile:

Mvg,
Claes in Lund, Zweden

What do you think is the problem?

My specs are:
DELL 7577
I7-7700HQ
16 GB RAM
Nvidia GTX1060 6GB
4K IPS screen
512GB SSD
1TB HDD
OS: Windows 10

I will not tell you until you have performed the two tests :slight_smile:
[after all, I could be wrong! :frowning: ]

Haha ok, I’ll get back to you on this.

Windows is your problem :smile:
JOKING

But seriously, do you compile your dt by your self? That might do a huge difference, see earlier in this thread.

I’m also curious of your results. It is a matter of 5minutes.

Wish you a quick recovery and being healthy again!

I wanted to give a brief update on my situation. I started this thread (and several others, all related to “darktable’s speed”, in terms of actual processing and how fast it feels when browsing, culling etc) because I felt DT wasn’t as fast as I was expecting back then when I switched from Mac + Lightroom to Linux + Darktable (most importantly: from an old macbook pro with a 2014 core i5 and 8Gb of ram to a recent Dell XPS with a 2017 i7 processor, additional GPU and 16Gb of ram, which I thought it would be an drastic step-up in performance).

After my latest tests with the development version of DT, 2.7.* I went back to the stable version 2.6.2 and I had to re-create all the database because of the (documented) lack of backward-compatibility. So I started from scratch and imported all the folders with xmp files of all my +40k images; it took a while, ok, and I had to reprocess a few images with settings that were incompatible between 2.7.* and 2.6.2 (the ones with profiled denoise modules activated).

But in the end I found what I was expecting from the beginning of my history with DT: a fast, reliable and consistent approach to editing and processing. When editing, I don’t have any more issues with preview creation; even if I don’t generate cache images separately with dartkable-generate-cache I get large previews almost instantly; star ratings and tags are quite fast to be applied and removed from photos; during processing, exposure and tone curves are fast (even though not as fast as in Lightroom) and the lag between applying any setting and watching the results on screen is minimal and not disruptive. My concern about perhaps having a too large database has faded away; I can easily navigate my 40 thousand images.

So in the end I wanted to write about my experience to say this; if any of you are having similar issues to those I was having, just try to start from scratch, build a new database reimporting all the raws + xmp files, and perhaps use the stable DT version. In my case, this has made a huge difference.

Thanks to the developers once more for an awesome product and for the support I have had in my Dartable experience.

PS: the processing speed in these tests hasn;t changed though; still 12secs to process the raw file with GPU support. I guess this shows that this particular test does not reflect the actual real-life performance of Darktable.

4 Likes

the & makes it difficult ;-).

But here we go. The mainboard has 4 slots A1, A2, B1 & B2

darktable 2.7.0+1087~g7fe35d67d

CPU @4.8 GHz

Don’t take the numbers to serious.

Sticks DIMM slots used CPU only (s) opencl (s)
1 A2 23.4 4.4
2 A1 A2* 23.7 4.4
3 A1 A2 B2 23.9 4.4
4 A1 A2 B1 B2** 13.8 4.0

*not recommended warning → single channel mode
**dual channel mode

Conclusio? But the RAM sticks into the correct slots as written in the manual. Don’t care about the CPU if you can get a nice GPU. The Intel Core i9-9900K doesn’t pay off here.

no - just at stock 2666 MHz

System: Host: mond2019 Kernel: 4.19.0-4-amd64 x86_64 bits: 64 compiler: gcc v: 8.3.0 
       Desktop: KDE Plasma 5.14.5 Distro: Debian GNU/Linux buster/sid 

Machine: Type: Desktop Mobo: Micro-Star model: MAG Z390 TOMAHAWK (MS-7B18) v: 1.0 serial: xxx 
       UEFI: American Megatrends v: 1.50 date: 03/26/2019 

CPU:   Topology: 8-Core model: Intel Core i9-9900K bits: 64 type: MT MCP arch: Kaby Lake rev: C 
       L2 cache: 16.0 MiB 
       flags: lm nx pae sse sse2 sse3 sse4_1 sse4_2 ssse3 vmx bogomips: 115200 
       Speed: 1259 MHz min/max: 800/5000 MHz Core speeds (MHz): 1: 1259 2: 1224 3: 1341 4: 1246 5: 1340 
       6: 1220 7: 1453 8: 1055 9: 1086 10: 1178 11: 963 12: 1090 13: 1244 14: 1196 15: 1244 16: 1727 

Graphics:  Device-1: NVIDIA GP106 [GeForce GTX 1060 6GB] vendor: Micro-Star MSI driver: nvidia v: 410.104 
       bus ID: 01:00.0 
       Display: x11 server: X.Org 1.20.3 driver: nvidia unloaded: fbdev,modesetting,nouveau,vesa 
       resolution: 1920x1080~60Hz 
       
Memory: RAM: total: 62.85 GiB used: 1.42 GiB (2.3%) 
       Array-1: capacity: 64 GiB slots: 4 EC: None 
       Device-1: ChannelA-DIMM0 size: 16 GiB speed: 2667 MT/s 
       Device-2: ChannelA-DIMM1 size: 16 GiB speed: 2667 MT/s 
       Device-3: ChannelB-DIMM0 size: 16 GiB speed: 2667 MT/s 
       Device-4: ChannelB-DIMM1 size: 16 GiB speed: 2667 MT/s
1 Like

Abends, @pk5dark!

Danke vielmals.

Don’t take the numbers to serious.

??? Of course I do!!! :wink:

Are you sure it’s not a typo in 4 Sticks/CPU only?
If that value is correct, how on earth can the execution
time become almost twice as fast?

MvG,
Claes in Lund, Schweden

Yes, I’m sure. Just run it again now.
Dual channel only works if you use the correct slots, which would have been A2 and B2 with 2 sticks. And I didn’t tested A2 & B2. I was a bit surprised that 3 sticks didn’t use some mixture of single/dual channel.

Thank you.
Hm. So you mean that perhaps A2 + B2 in your case could
be good as well?

Yes, of course A2 and B2 would have been the correct ones. On startup there also is a warning message from the UEFI that you should check your setup.

So I tried performing the tests but it didn’t work.
I have 0 knowledge about these things.

Tried downloading the Phoronix Test Suite, I went to the file folder, I hit install and some windows cmd screen came up, with all kinds of lines and then closed down.

I have no idea or way how to open the program now. What did it do? What got installed on my computer? How do I open it? I wanted to run the benchmark with the samsung RAW files, but I can’t until I know how to open it.

Edit: I think it’s installing now. I ran the batch file and I had to install phoronix, cygwin etc… I hope this won’t mess up with my system :’)

Edit 2: Everything got installed I guess, but I still can’t access the program. Someone please enlighten me how all of this works or let me know how I can uninstall everything that I just did from my computer without having to do a system repair.

Edit 3: I really hate this lol. I’ve got Cygwin open right now, cause I found it. However, if I add the command lines, it won’t do anything and just say: “bash: darktable-cli: prompt not found”
So I can’t do the test… Can someone give me an explanation and as simple as possible on how to get this to work? This is really annoying for me because I have 0 developer skills/knowledge. I have 0 affinity with coding and the whole: “it’s done in 5 minutes” has already taken me 1,5 hours already. I don’t have that much time on my hands.