RawTherapee 5.3 Released

After 15 years with MAC OS at home and as much as work, If i could have avoid all the time spent watching my computer “doing things”, I would have save years of my life ! Especially windows that is “sandglass oriented”. I still use windows at work, no choice. But at home I got read of my mac for a linux Mint : Rawtherapee 5.3 requests 7sec to launch (core i7) and combined with ArgyLL CMS and Xnview, I don’t feel like my pictures are worse than the winadobe fellows…

Many thanks for this major release that brings lens baby among improvments. I can now now definitely get read of Darktable, another excellent product by the way…

I have the same behaviour- after clicking on the Rawtherapee icon, it takes about a minute for the GUI to turn up… I use Win 10 64 bit. I did not report it because I hardly process more than couple of photos at a time and I can wait.:wink:

Probably joking, right?
I can’t reboot my system just every time I want to use RT. Nevertheless, it’s still taking much too long to start, because 7-8 seconds just to launch a program is far too long imho.
And BTW, clicking on ‘preferences’ and then still waiting for a few seconds is not normal when using your system. Especially when for all other tasks my system is very fast.

I thought RT 5.3 is getting mature and a serious piece software; so just trying to get it to work seriously should be the goal. Or am I expecting too much?

In the mean time, I have fired up Process Monitor from Sysinternals to see what RT is doing, when started. Although I filtered on just “rawtherapee” to exclude other stuff, it’s an enormous load of logging data. Where I can start searching/looking?

Certainly not. You are not a victim, period. You received something for free and you are having an issue. You have the agency to diagnose the problem and provide the information that leads to a fix.

You can probably see what is making the application hang using gdb, as detailed on this page: How to write useful bug reports - RawPedia

Certainly try this, as detailed on RawPedia, gdb rawtherapee-debug.exe and r and so on, to, hopefully, see, what is going on in the background.

Consider also disabling the smartscreen evil thingy. (Hidden deeper after every Win update.)

On the Search bar, type Windows Defender Security Center.
Open Windows Defender Security Center settings and go to App & browser control.
From there, you will see the options available for Windows Defender SmartScreen.
1 Like

On my system I have these options set to ‘Warn’. But even if I switch them to “Off”; it doesn’t effect RT startup time. :disappointed:

I’ve also tried disabling AV s/w, disabling F/W; but all to no avail.
And why should only RT behave so ‘specific’ (and slow), while all other software performs just smooth and quick. E.g. when I stitch a panorama file with PTGui Pro, stitching 20 x 60Mb TIFF files, creating several thousand temp files, sucking up 20GB of RAM, all in a few seconds. So I have no issues with the performance of my specific machine.

I’ve also read the story about debug reports for RT. But that all refers to crashes of RT. And in this case, RT doesn’t crash, it’s just slow to start…

I’m really eager to use RT as a substitute for my current RAW converter (ViewNX-i), but I’m not a programmer, just an experienced Windows photographic post processing user.
I’m not happy with the RAW conversions from the Adobe products with my NEF RAW files, because ViewNX-i does a better job. But I’m looking for more control, more finetuning, etc. and was hoping to find this with RT.

When googling the web about the slow startup issues with RT; it is clear to me, I’m not the only one. But didn’t find the holy grail (yet) as to solve this issue, before really diving deep into a new RAW converter. So I was hoping to get some assistance over here.
Are the developers/programmers reading along? (I have no idea if they do)

At least in the past, SmartScreen did “warn” me for some dev versions of RT installers, and after clicking “Allow”, the installation was still broken. PTGui is a commercial program, and even with 2.0k of clicks on the link for development build of RT for Windows, this is almost nothing, RawTherapee is an exotic outsider, suspicious, when checked against MS database. This might become worse in the future.

Even if nothing crashes, running dbg with the debug version (perhaps also setting verbose to true in options, I’m not sure about this) may show something.

The program start seems to be still slower than gtk2 version was, but on your computer, it should take about 5 seconds, at most.

The debugger will tell you a lot of stuff, not just stuff relates to a crash.

Yes, @agriggio and @floessie are both developers and have responded, and @gaaned92 makes builds for windows.

1 Like

@PanoMeister Can you please post your options file? That may help us to identify the culprit of slow starting rt.
Have a look here to find it.

Here you go:

[General]
TabbedEditor=true
StoreLastProfile=true
StartupDirectory=last
StartupPath=D:\\NEF_Files
DateFormat=%y-%m-%d
AdjusterMinDelay=100
AdjusterMaxDelay=200
MultiUser=true
Language=English (UK)
LanguageAutoDetect=false
Theme=RawTherapee-GTK3-20_
Version=5.3
DarkFramesPath=C:\\Program Files\\RawTherapee\\5.3
FlatFieldsPath=C:\\Program Files\\RawTherapee\\5.3
Verbose=false
BotLeft=0
TopLeft=10
TopRight=40
BotRight=75
EDdetec=3
EDdetecStr=1.3
EDLow=15
EDLipinfl=0.80000000000000004
EDLipampl=1.1000000000000001

[External Editor]
EditorKind=2
GimpDir=C:\\Users\\Admin
PhotoshopDir=C:\\Program Files\\Adobe\\Adobe Photoshop CC 2017
CustomEditor=

[File Browser]
BrowseOnlyRaw=false
BrowserShowsDate=true
BrowserShowsExif=true
BrowserShowsExpComp=true
BrowserShowsHidden=false
ThumbnailSize=160
ThumbnailSizeTab=160
ThumbnailSizeQueue=160
SameThumbSize=0
MaxPreviewHeight=250
MaxCacheEntries=20000
ParseExtensions=3fr;arw;cr2;crf;crw;dcr;dng;fff;iiq;jpg;jpeg;kdc;mef;mos;mrw;nef;nrw;orf;pef;png;raf;raw;rw2;rwl;rwz;sr2;srf;srw;tif;tiff;x3f;
ParseExtensionsEnabled=1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;0;1;1;1;1;1;1;1;1;1;1;1;
ThumbnailArrangement=2
ThumbnailInterpolation=1
FavoriteDirs=
RenameTemplates=
RenameUseTemplates=false
ThumbnailZoomRatios=0.20000000000000001;0.29999999999999999;0.45000000000000001;0.59999999999999998;0.80000000000000004;1;
OverlayedFileNames=false
FilmStripOverlayedFileNames=false
ShowFileNames=true
FilmStripShowFileNames=false
InternalThumbIfUntouched=true
menuGroupRank=true
menuGroupLabel=true
menuGroupFileOperations=true
menuGroupProfileOperations=true
menuGroupExtProg=true
MaxRecentFolders=15
RecentFolders=D:\\NEF_Files;D:\\test;

[Clipping Indication]
HighlightThreshold=253
ShadowThreshold=8
BlinkClipped=false

[Performance]
RgbDenoiseThreadLimit=0
NRauto=10
NRautomax=40
NRhigh=0.45000000000000001
NRWavlevel=2
LevNR=3
LevNRTI=0
LevNRAUT=0
LevNRLISS=2
SIMPLNRAUT=1
ClutCacheSize=12
MaxInspectorBuffers=4
PreviewDemosaicFromSidecar=0
Daubechies=false
SerializeTiffRead=true

[Output]
Format=jpg
JpegQuality=92
JpegSubSamp=2
PngCompression=6
PngBps=8
TiffBps=16
TiffUncompressed=true
SaveProcParams=true
FormatBatch=tif
JpegQualityBatch=92
JpegSubSampBatch=2
PngCompressionBatch=6
PngBpsBatch=8
TiffBpsBatch=8
TiffUncompressedBatch=true
SaveProcParamsBatch=true
PathTemplate=%p1/converted/%f
PathFolder=
AutoSuffix=true
ForceFormatOpts=true
SaveMethodNum=0
UsePathTemplate=true
LastSaveAsPath=
OverwriteOutputFile=false
TunnelMetaData=true

[Profiles]
Directory=profiles
UseBundledProfiles=true
LoadSaveProfilePath=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
RawDefault=Neutral
ImgDefault=Neutral
FilledProfile=false
SaveParamsWithFile=true
SaveParamsToCache=false
LoadParamsFromLocation=1
CustomProfileBuilderPath=
CustomProfileBuilderKeys=0

[GUI]
WindowWidth=2508
WindowHeight=1326
WindowX=26
WindowY=23
WindowMonitor=0
MeowMonitor=1
MeowFullScreen=false
MeowMaximized=true
MeowWidth=2560
MeowHeight=1378
MeowX=2560
MeowY=0
WindowMaximized=true
DetailWindowWidth=-1
DetailWindowHeight=-1
DirBrowserWidth=250
DirBrowserHeight=350
SortType=0
PreferencesWidth=1193
PreferencesHeight=891
SaveAsDialogWidth=920
SaveAsDialogHeight=680
ToolPanelWidth=398
BrowserToolPanelWidth=360
BrowserToolPanelHeight=600
BrowserToolPanelOpened=true
EditorFilmStripOpened=true
BrowserDirPanelOpened=true
HistoryPanelWidth=330
FontFamily=default
FontSize=10
CPFontFamily=default
CPFontSize=8
LastPreviewScale=5
PanAccelFactor=5
RememberZoomAndPan=true
LastCropSize=1
ShowHistory=true
ShowFilePanelState=0
ShowInfo=true
MainNBVertical=false
ShowClippedHighlights=false
ShowClippedShadows=false
FrameColor=1
ProcessingQueueEnbled=false
ToolPanelsExpanded=1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;1;
ToolPanelsExpandedAutoSave=true
MultiDisplayMode=1
CutOverlayBrush=0;0;0;0.66698710612649725;
NavGuideBrush=1;0;0;1;
HistogramPosition=1
HistogramBar=true
HistogramFullMode=false
NavigatorRGBUnit=0
NavigatorHSVUnit=0
ShowFilmStripToolBar=true
FileBrowserToolbarSingleRow=true
HideTPVScrollbar=false
UseIconNoText=true
HistogramWorking=false
CurveBBoxPosition=3

[Crop Settings]
PPI=600

[Color Management]
PrinterProfile=
PrinterIntent=1
PrinterBPC=true
ICCDirectory=C:\\WINDOWS\\System32\\spool\\drivers\\color
MonitorProfile=
AutoMonitorProfile=true
Autocielab=true
RGBcurvesLumamode_Gamut=true
Intent=3
MonitorBPC=true
AdobeRGB=RT_Medium_gsRGB
ProPhoto=RT_Large_gBT709
ProPhoto10=RT_Large_g10
WideGamut=WideGamutRGB
sRGB=RT_sRGB
sRGB10=RT_sRGB_g10
Beta=BetaRGB
Best=BestRGB
Rec2020=Rec2020
Bruce=Bruce
WhiteBalanceSpotSize=8
GamutICC=true
Ciecamfloat=true
GamutLch=true
ProtectRed=60
Amountchroma=40
ProtectRedH=0.29999999999999999
CRI=0
DenoiseLabgamma=2
CBDLArtif=4
CBDLlevel0=0
CBDLlevel123=30
ClutsDirectory=C:\\Program Files\\RawTherapee\\5.3\\cluts

[Batch Processing]
AdjusterBehavior=0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;

[Sounds]
Enable=false
BatchQueueDone=
LngEditProcDone=
LngEditProcDoneSecs=3

[Fast Export]
fastexport_bypass_sharpening=true
fastexport_bypass_sharpenEdge=true
fastexport_bypass_sharpenMicro=true
fastexport_bypass_defringe=true
fastexport_bypass_dirpyrDenoise=true
fastexport_bypass_sh_hq=true
fastexport_bypass_dirpyrequalizer=true
fastexport_bypass_wavelet=true
fastexport_raw_bayer_method=fast
fastexport_bypass_raw_bayer_dcb_iterations=true
fastexport_bypass_raw_bayer_dcb_enhance=true
fastexport_bypass_raw_bayer_lmmse_iterations=true
fastexport_bypass_raw_bayer_linenoise=true
fastexport_bypass_raw_bayer_greenthresh=true
fastexport_raw_xtrans_method=fast
fastexport_bypass_raw_ccSteps=true
fastexport_bypass_raw_ca=true
fastexport_bypass_raw_df=true
fastexport_bypass_raw_ff=true
fastexport_icm_input=(camera)
fastexport_icm_working=ProPhoto
fastexport_icm_output=RT_sRGB
fastexport_icm_output_intent=1
fastexport_icm_output_bpc=true
fastexport_icm_gamma=default
fastexport_resize_enabled=true
fastexport_resize_scale=1
fastexport_resize_appliesTo=Cropped area
fastexport_resize_method=Lanczos
fastexport_resize_dataspec=3
fastexport_resize_width=900
fastexport_resize_height=900
fastexport_use_fast_pipeline=1

[Dialogs]
LastIccDir=C:\\WINDOWS\\System32\\spool\\drivers\\color
LastDarkframeDir=
LastFlatfieldDir=
LastRgbCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastLabCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastRetinexDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastDenoiseCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastWaveletCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastPFCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastHsvCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastBWCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastToneCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastVibranceCurvesDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastProfilingReferenceDir=C:\\Users\\Admin\\AppData\\Local\\RawTherapee\\profiles
LastLensProfileDir=C:\\ProgramData\\Adobe\\CameraRaw\\LensProfiles\\1.0
GimpPluginShowInfoDialog=true

[Lensfun]
DBDirectory=./share/lensfun

Can you try to point these to an empty folder (create an emtpy folder somewhere in your file system and set the paths for flatfield and darkframe in preferences to this folder)? For reference
I don’t know whether it will be substantially faster. It’s just about excluding a possible culprit

changed C:\Program Files\RawTherapee\5.3 to D:\testing for both instances.
Where D:\testing is an empty, freshly created directory.

No changes. Same startup time. :disappointed:

But did you read this (previously posted)?

Changing those two dirs doesn’t change anything in RT’s startup time.
I can use RT several times with a reasonable (but still slow for a small program on a fast machine) startup time of about 8 seconds, and then suddenly it falls back to 50 seconds startup time…

Yes, I read this. I’m mainly on Win7 and the startup time of RT is between 3 and 7 seconds. 3 seconds when using METM (less gui at startup) and 7 seconds when using SETM (gui creating empty editor at startup). I agree that this could be faster!

I’m on Win10 with an old i3 Dual core 2.9GHz, 8GB Ram and the startup time is approximate 12 sec.

I keep on digging into my system, to figure out why/with what RT is so busy. :wink:

Another thing I noticed, when RT is finally started, when browsing to a directory with a number of large (500MB or bigger) TIFF files, it takes a very long time before all the TIFFs are being processed/displayed, even after the ‘loading thumbnails’ message has disappeared and not all the TIFFs are already displayed.
RT is very busy with ‘Hard Faults/s’ aka paging memory. Numbers vary between 70-120 Hard Faults/sec, while at the same time Disk I/O is very low, CPU Usage is only 1-2% and committed memory usage of RT is even <2GB of RAM.
I have the option “serialize read of TIFF files” checked; but it doesn’t seem to make much difference (?)

Is there maybe a memory option for RT to use the available memory in my system (24GB RAM) instead of paging so (too?) much?

Normally I only get this kind of paging (large amounts of Hard Faults/s values) activity when I load >2GB of graphic files into PS CC 2017 with lots of layers and all the internal memory has already been used by PS CC 2017 and there is no ‘Free memory’ left anymore.
But in this case; where RT is keeping the paging memory counter busy, there is more then 20GB of RAM free!

Just an additional question: why does rawtherapee open that many handles to an empty directory?
image

I thought of starting the Task Manager before starting RawTherapee and checking the CPU usage and or processes. I noticed that during the time it takes to show GUI, the RawTherapee process does not show up in the Task Manager and the CPU usage does not cahnge. Does that mean that, as far as Windows is concerned, this task has not even started for the first 50 seconds or so ?

Correction: I was wrong, it does show up on the Task Manager immediately after starting it.

Same here.
It does immediately show up @ taskmanager, but it (=RT) doesn’t do much for a long time…

Like this comment:

I’ve noticed the same. When I run ProcessMonitor (Sysinternals) there is a huge number of entries of RT opening/scanning files, opening handles… but in the mean time, very little happens…

I’ll test RT on our Win10 PC tomorrow.

@PanoMeister Do you have another Gtk3 powered software to test in similar conditions ?