Latest stable doesn’t run because
That’s strange… I will have a look tomorrow.
@afre The problem with the missing dll should be fixed now, could you please check?
@paulmiller @gadolf I have also fixed the “assign profile” bug in the new-caching branch, and prepared new packages. There is still something wrong with the Spot WB that I am trying to fix…
It opens properly now. I noticed an unrelated problem. I may have reported this before. When I open the app, there is an open dialog. If I close it without opening a file, I am left with an empty window without any GUI. I cannot do anything besides close the app. Same as when I open a PFI of which the original file no longer exists. The app just continues to load without error and without a way to reenter the open dialog.
Yes, I am aware of this… however, one of the next steps in the UI development will be to replace most of the buttons with menu items. At that point, the problems you describe will be solved, and we will gain a bit more of space for the preview and the layers list.
I will start working on this as soon as the recent improvements in the processing pipeline will be merges into the stable branch.
Great! If one closes the open window or opens a malformed PFI or one that goes nowhere, the user has no choice but to quit the app. Not a good experience for a first time user or a non-techie.
@gadolf @paulmiller @afre
New update:
- I fixed the image updating when clicking on the preview area in spot/area WB mode
- I added a configuration option for setting the size (in MegaBytes) of the global tile cache. The default is 1000 MB, which gives a reasonable speed without eating too much RAM. A larger size does not necessarily provide a huge speedup, it depends on the image size and the set of tools being used.
Packages are available for download in the usual place.
1 Like
- Assign Profile: working
- Spot/Area WB mode: working
When I check the settings, the tile cache size is set to 10,000 not 1,000.
I just fixed this as well. Thanks for checking!
Next step is to re-introduce the histogram visualization, after which I think the code might be good to be committed into the stable branch.
1 Like
(To avoid the same mistake as before, I’m running new-caching-24343 from 2019/10/08)
Crash when trying to open the country sunset play raw:
Some notes:
- I have already a .pfi file in the folder from a previous edit, but I chose to open the .CR2 file;
- A couple of days ago I clean up my / partition because it was getting full. I did a couple of packages uninstalls, although I don’t remember having uninstalled some of the build required packages. But I always feel uneasy to do sudo apt autoremove (i had problems with this once in the past)
Follows gdb output last lines and log.
RawImage::RawImage() finished
… layer “RAW loader” finished
Building layer “RAW developer”…
RawPreprocessorPar::init_wb_coefficients() called
… layer “RAW developer” finished
PF::Image::do_update(): pipeline #0 updated.
PF::Image::do_update(): preparing pipeline #1
PF::Image::do_update(): updating pipeline #1
PF::new_operation: creating operation of type “raw_loader”
PF::new_operation: creating operation of type “blender”
PF::new_operation: creating operation of type “uniform”
PF::new_operation: creating operation of type “raw_developer_v2”
PF::new_operation: creating operation of type “blender”
PF::new_operation: creating operation of type “uniform”
Building layer “RAW loader”…
… layer “RAW loader” finished
Building layer “RAW developer”…
RawPreprocessorPar::init_wb_coefficients() called
OpParBase::build_many_internal(): adding tilecache for output image #0, padding=0
phf_tile_pool_init(): called
OpParBase::build_many_internal(): added tilecache for output image #0, padding=0
… layer “RAW developer” finished
[New Thread 0x7fffda7fc700 (LWP 13340)]
PF::Image::do_update(): pipeline #1 updated.
PF::Image::do_update(): preparing pipeline #2
Pipeline: force_rebuild set to true
PF::Image::do_update(): updating pipeline #2
PF::new_operation: creating operation of type “raw_loader”
PF::new_operation: creating operation of type “blender”
PF::new_operation: creating operation of type “uniform”
PF::new_operation: creating operation of type “raw_developer_v2”
PF::new_operation: creating operation of type “blender”
PF::new_operation: creating operation of type “uniform”
Building layer “RAW loader”…
… layer “RAW loader” finished
Building layer “RAW developer”…
RawPreprocessorPar::init_wb_coefficients() called
… layer “RAW developer” finished
PF::Image::do_update(): pipeline #2 updated.
IMAGE_REBUILD finished
Pipeline: force_rebuild set to true
IMAGE_REBUILD started
PF::Image::do_update(): preparing pipeline #0
PF::Image::do_update(): updating pipeline #0
PF::Image::do_update(): pipeline #0 updated.
PF::Image::do_update(): preparing pipeline #1
PF::Image::do_update(): updating pipeline #1
Building layer “RAW loader”…
… layer “RAW loader” finished
Building layer “RAW developer”…
RawPreprocessorPar::init_wb_coefficients() called
OpParBase::build_many_internal(): adding tilecache for output image #0, padding=0
phf_tile_pool_init(): called
OpParBase::build_many_internal(): added tilecache for output image #0, padding=0
… layer “RAW developer” finished
PF::Image::do_update(): pipeline #1 updated.
PF::Image::do_update(): preparing pipeline #2
PF::Image::do_update(): updating pipeline #2
PF::Image::do_update(): pipeline #2 updated.
IMAGE_REBUILD finished
IMAGE_REDRAW_START started
IMAGE_REDRAW_START finished
IMAGE_REDRAW started
[New Thread 0x7fffdb7fe700 (LWP 13341)]
[New Thread 0x7fffdbfff700 (LWP 13342)]
[Thread 0x7fffdb7fe700 (LWP 13341) exited]
[Thread 0x7fffdbfff700 (LWP 13342) exited]
[New Thread 0x7fffd9ffb700 (LWP 13343)]
[Thread 0x7fffd9ffb700 (LWP 13343) exited]
[New Thread 0x7fffbffff700 (LWP 13344)]
[Thread 0x7fffbffff700 (LWP 13344) exited]
[New Thread 0x7fffbffff700 (LWP 13345)]
[New Thread 0x7fffd9ffb700 (LWP 13346)]
[New Thread 0x7fffdbfff700 (LWP 13347)]
[New Thread 0x7fffdb7fe700 (LWP 13348)]
Thread 29 “worker” received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fffbffff700 (LWP 13345)]
0x00007ffff697f645 in g_mutex_lock ()
from /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0
(gdb) set pagination off
(gdb) set logging file log.txt
(gdb) set logging on
Copying output to log.txt.
(gdb) info threads
log.txt (46.9 KB)
There is a problem with the tile allocation. In the log I only see
phf_tile_pool_init(): called
without any further message afterwards. What is the tile cache size in your settings?
This means I need to better handle the errors in the tile cache initialization…
Meanwhile I have added some more messages to better understand the source of the problem.
I’ve built it and this time I didn’t have any issues and could complete an edit until the end.
It was 1 GB and I changed it to 2 GB before starting this edit.
It’ll be great to get this and the simplified-pipeline changes into stable because together they make Photoflow much nicer to use (more responsive and less likely to have crashes because I forget to set the input of a layer correctly).
If you are looking at the histogram code, maybe it is worth looking at the scaling on the histogram display at the same time? Currently, if you have a lot of clipped area in the design (so the histogram has a large peak), the rest of the histogram gets vertically compressed to invisibility (e.g. as you increase exposure, the histogram collapses to a flat line). I would prefer to be able to see the detail in the rest of the histogram rather than the full height of the relatively uninteresting clipped data peak.
I got one more crash.
This time, after doing many, many edits, inserting and deleting heavy layers (edge sharpening and noise reduction presets). Until this point, everything was just fine.
The edit was almost done and I was just trying to fine tune NR, by adding a working channel mixer layer just to spot which channel was introducing more noise, and then tweak the NR tool against that channel.
More specifically, the crash happened when I pulled the red channel value down to zero. I intended to get the blue channel at 100%, but then the crash happened.
IMAGE_REBUILD finished
IMAGE_REDRAW_START started
IMAGE_REDRAW_START finished
IMAGE_REDRAW started
[New Thread 0x7fffd8d20700 (LWP 22384)]
[New Thread 0x7fffd9990700 (LWP 22385)]
[New Thread 0x7fffbd7fe700 (LWP 22386)]
[New Thread 0x7fffdbfff700 (LWP 22387)]
[Thread 0x7fffd9990700 (LWP 22385) exited]
[Thread 0x7fffbd7fe700 (LWP 22386) exited]
[Thread 0x7fffd8d20700 (LWP 22384) exited]
[Thread 0x7fffdbfff700 (LWP 22387) exited]
[New Thread 0x7fffdbfff700 (LWP 22388)]
[New Thread 0x7fffbd7fe700 (LWP 22389)]
[Thread 0x7fffdbfff700 (LWP 22388) exited]
[Thread 0x7fffbd7fe700 (LWP 22389) exited]
[New Thread 0x7fffd9990700 (LWP 22390)]
[Thread 0x7fffd9990700 (LWP 22390) exited]
[New Thread 0x7fffd8d20700 (LWP 22391)]
[Thread 0x7fffd8d20700 (LWP 22391) exited]
IMAGE_REDRAW finished
IMAGE_REDRAW_END started
IMAGE_REDRAW_END finished
OperationsTreeDialog::on_button_clicked: id=1
OperationsTreeDialog::add_layer(): page=1
OperationsTreeDialog::add_layer(): w=0x555559086678 tw=0x555559086678
OperationsTreeDialog::add_layer(): op_tree=0x555559086720
OperationsTreeDialog::add_layer(): image=0x555558c22230
OperationsTreeDialog::add_layer(): layer=0x555560c48f00
Adding layer of type "Channel Mixer" (channel_mixer)
PF::new_operation_with_gui: creating operation of type "channel_mixer"
PF::new_operation: creating operation of type "channel_mixer"
PF::new_operation: creating operation of type "uniform"
IMAGE_REBUILD started
PF::Image::do_update(): preparing pipeline #0
PF::Image::do_update(): updating pipeline #0
PF::new_operation: creating operation of type "channel_mixer"
PF::new_operation: creating operation of type "blender"
PF::new_operation: creating operation of type "uniform"
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #0 updated.
PF::Image::do_update(): preparing pipeline #1
PF::Image::do_update(): updating pipeline #1
PF::new_operation: creating operation of type "channel_mixer"
PF::new_operation: creating operation of type "blender"
PF::new_operation: creating operation of type "uniform"
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #1 updated.
PF::Image::do_update(): preparing pipeline #2
PF::Image::do_update(): updating pipeline #2
PF::new_operation: creating operation of type "channel_mixer"
PF::new_operation: creating operation of type "blender"
PF::new_operation: creating operation of type "uniform"
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #2 updated.
IMAGE_REBUILD finished
(photoflow:4368): Gdk-WARNING **: 08:50:14.991: gdk_window_set_icon_list: icons too large
IMAGE_REBUILD started
PF::Image::do_update(): preparing pipeline #0
PF::Image::do_update(): updating pipeline #0
PF::Image::do_update(): pipeline #0 updated.
PF::Image::do_update(): preparing pipeline #1
PF::Image::do_update(): updating pipeline #1
PF::Image::do_update(): pipeline #1 updated.
PF::Image::do_update(): preparing pipeline #2
PF::Image::do_update(): updating pipeline #2
PF::Image::do_update(): pipeline #2 updated.
IMAGE_REBUILD finished
IMAGE_REDRAW_START started
IMAGE_REDRAW_START finished
IMAGE_REDRAW started
[New Thread 0x7fffd8d20700 (LWP 22401)]
[New Thread 0x7fffd9990700 (LWP 22402)]
[New Thread 0x7fffbd7fe700 (LWP 22403)]
[New Thread 0x7fffdbfff700 (LWP 22404)]
[Thread 0x7fffd9990700 (LWP 22402) exited]
[Thread 0x7fffdbfff700 (LWP 22404) exited]
[Thread 0x7fffbd7fe700 (LWP 22403) exited]
[Thread 0x7fffd8d20700 (LWP 22401) exited]
[New Thread 0x7fffdbfff700 (LWP 22405)]
[New Thread 0x7fffbd7fe700 (LWP 22406)]
[New Thread 0x7fffd9990700 (LWP 22407)]
[New Thread 0x7fffd8d20700 (LWP 22408)]
[Thread 0x7fffbd7fe700 (LWP 22406) exited]
[Thread 0x7fffdbfff700 (LWP 22405) exited]
[Thread 0x7fffd9990700 (LWP 22407) exited]
[Thread 0x7fffd8d20700 (LWP 22408) exited]
IMAGE_REDRAW finished
IMAGE_REDRAW_END started
IMAGE_REDRAW_END finished
IMAGE_REBUILD started
PF::Image::do_update(): preparing pipeline #0
PF::Image::do_update(): updating pipeline #0
Building layer "relight"...
... layer "relight" finished
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #0 updated.
PF::Image::do_update(): preparing pipeline #1
PF::Image::do_update(): updating pipeline #1
Building layer "relight"...
OpParBase::build_many_internal(): adding tilecache for output image #0, padding=0
OpParBase::build_many_internal(): added tilecache for output image #0, padding=0
... layer "relight" finished
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #1 updated.
PF::Image::do_update(): preparing pipeline #2
PF::Image::do_update(): updating pipeline #2
Building layer "relight"...
... layer "relight" finished
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #2 updated.
IMAGE_REBUILD finished
OperationConfigGUI::disable_editing(): setting editing flag to false
IMAGE_REBUILD started
PF::Image::do_update(): preparing pipeline #0
PF::Image::do_update(): updating pipeline #0
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #0 updated.
PF::Image::do_update(): preparing pipeline #1
PF::Image::do_update(): updating pipeline #1
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #1 updated.
PF::Image::do_update(): preparing pipeline #2
PF::Image::do_update(): updating pipeline #2
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #2 updated.
IMAGE_REBUILD finished
IMAGE_REDRAW_START started
IMAGE_REDRAW_START finished
IMAGE_REDRAW started
[New Thread 0x7fffd8d20700 (LWP 22411)]
[New Thread 0x7fffd9990700 (LWP 22412)]
[New Thread 0x7fffbd7fe700 (LWP 22413)]
[New Thread 0x7fffdbfff700 (LWP 22414)]
[Thread 0x7fffd8d20700 (LWP 22411) exited]
[Thread 0x7fffbd7fe700 (LWP 22413) exited]
[Thread 0x7fffdbfff700 (LWP 22414) exited]
[Thread 0x7fffd9990700 (LWP 22412) exited]
[New Thread 0x7fffdbfff700 (LWP 22415)]
[New Thread 0x7fffbd7fe700 (LWP 22416)]
[New Thread 0x7fffd9990700 (LWP 22417)]
[New Thread 0x7fffd8d20700 (LWP 22418)]
[Thread 0x7fffbd7fe700 (LWP 22416) exited]
[Thread 0x7fffd8d20700 (LWP 22418) exited]
[Thread 0x7fffdbfff700 (LWP 22415) exited]
[Thread 0x7fffd9990700 (LWP 22417) exited]
IMAGE_REDRAW finished
IMAGE_REDRAW_END started
IMAGE_REDRAW_END finished
IMAGE_REBUILD started
PF::Image::do_update(): preparing pipeline #0
PF::Image::do_update(): updating pipeline #0
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #0 updated.
PF::Image::do_update(): preparing pipeline #1
PF::Image::do_update(): updating pipeline #1
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #1 updated.
PF::Image::do_update(): preparing pipeline #2
PF::Image::do_update(): updating pipeline #2
Building layer "channel mixer"...
... layer "channel mixer" finished
PF::Image::do_update(): pipeline #2 updated.
IMAGE_REBUILD finished
IMAGE_REDRAW_START started
IMAGE_REDRAW_START finished
IMAGE_REDRAW started
[New Thread 0x7fffd8d20700 (LWP 22427)]
[New Thread 0x7fffd9990700 (LWP 22428)]
[New Thread 0x7fffbd7fe700 (LWP 22429)]
[New Thread 0x7fffdbfff700 (LWP 22430)]
[Thread 0x7fffd9990700 (LWP 22428) exited]
[Thread 0x7fffd8d20700 (LWP 22427) exited]
[Thread 0x7fffdbfff700 (LWP 22430) exited]
[Thread 0x7fffbd7fe700 (LWP 22429) exited]
[New Thread 0x7fffdbfff700 (LWP 22431)]
[New Thread 0x7fffbd7fe700 (LWP 22432)]
[New Thread 0x7fffd9990700 (LWP 22433)]
Thread 16548 "worker" received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fffdbfff700 (LWP 22431)]
0x0000555555d93ec9 in LUT<float>::operator[]<float, void> (
index=-nan(0x400000), this=0x555559117000)
at /home/gustavo/PhotoFlow/src/base/../rt/rtengine/LUT.h:449
449 int idx = (int)index; // don't use floor! The difference in negative space is no problems here
(gdb) set pagination off
(gdb) set logging file log.txt
(gdb) set logging on
Copying output to log.txt.
(gdb) info threads
Id Target Id Frame
1 Thread 0x7ffff7fada00 (LWP 4368) "photoflow" 0x00007ffff2f199e2 in malloc
log.txt (40.2 KB)
EDIT: Forgot to mention that soon after adding the channel mixer layer, I activated a relight layer that was already there in the pipe, to help me “see” better the noise. Maybe it didn’t liked getting a pure black image (when I set the red channel down to zero), but this is just a thought.
EDIT2: Please disregard my previous comment. I opened the last pfi I had, deactivated all layers, added a channel mixer layer then set reds as zero and it crashed. It seems this has nothing to do with the new caching mechanism, right?
EDIT 3: +1 on @paulmiller’s suggestion to scale the histogram
I am trying to reproduce it, not luck so far. However, from your gdb backtrace I see there was some NAN used as index for a LUT in one ICC conversion. I am trying to figure out how this could happen.
Concerning the visualization of specific RGB channels, another, more convenient way to do that is to add a “clone” layer, select the layer for which you want to inspect the channels, and set the “source channel” accordingly:
@paulmiller I totally agree concerning the histogram, will do that as soon as the basic functionality is back into operation in the new-caching branch.
To put things simpler, please, try this:
- open a raw file
- add channel mixer
- change reds to 0 (all channels should be zero at this point)
I repeated this procedure with a raw file I’ve never edited before with phf and it crashed again.
Thanks for the tip!
Exactly what I did, but the program could handle the black image just fine… I’ll investigate further later today.
1 Like
@gadolf @paulmiller I have just finished implementing some further optimizations of the pipeline, which now allow to also update the histogram efficiently.
New packages should be available in a short time.
Concerning the histogram, how would you suggest to represent the portion >1?
One possibility coud be to have three histogram display modes:
- linear, showing values between 0 and 1
- perceptual, again showing values between 0 and 1
- log2, in which case I would opt for a 10-stops window that can slide on the left and on the right, so that one can focus either on shadows or highlights. The default would be to show a range from 2^-10 to 1.
What do you think?
Still on the new caching branch?
I liked that, with three different display modes.
Even allowing to scroll the histogram to the left or right, I would add some indicator to the histogram frame informing that there’s more data to the left or right. I can only recall CHDK histogram with its upper dots (red/orange), indicating under or over exposure:
Yes, I will merge the changes into stable once I will get some more feedback regarding stability. I have introduced once more some non-trivial changes in the pipeline, so better to be cautious…