Hi,
In your 5.4 profile you have “histogram matching” enabled. That means that either:
HTH
Being less destructive in your criticism would also help. Examples:
If you apply your pp3 file from RT 5.3, which cost you lot of time and effort to make, the right way (as full profile), you should get the same result in 5.4. If not, it’s a bug, which should be reported, or it’s caused by fixing a bug.
We take every issue serious. Of course, RT 5.3 can’t use tools, which are introduced in RT 5.4.
But going backwards is kind of low in our list of priorities.
I used the provided 5.3 version pp3. I did following experiment
1- open a CR2 file with this pp3 in RT5.3, save jpg, close 5.3
2- open the same file with same pp3 in RT4, save jpg, close 5.4
Now the pp3 is a 5.4 version
3- open the same file with pp3 in RT5.3, save jpg, close 5.3
display the 3 jpg: look the same. I did’nt made further comparison in GIMP.
My apologies! I’m really not trying to slam (put down) RT. The reason I’m spending my time doing this is that RT looks like a good & powerful tool to me. I’m still very much in learn mode and quite receptive to being shown where any of my findings or just plan interpretations are wrong. I’m new enough to raw image processing that I’m still trying to develop a workflow that might pass as good to a knowledgeable and experienced user. I think this matter of “Processing Profile” compatibility is an important consideration.
I also have a great deal of appreciation for open source software and recognize the enormous complexity associated with developing something like RT in such a manner. As such I am most grateful to all of the people doing this work.
My initial question was aimed at determining whether or not it is intended that processing profiles created by prior versions of RT can (and maybe it would be better to say “should”) be used with newer versions. Based on discussion herein it sounds like the answer is that such is intended. However, this discussion has also caused me to do some experimenting and based on that I remain a bit skeptical about the idea that such should be done. I’m thinking it might be possible that when it is desired to further refine the development of an image that was previously developed with an older version of RT that using an image file (i.e., in a standard format) such as an exported tif might be better. When it comes to workflow the idea being that once a desirable image has been developed it needs to be exported to a standard format.
I’m pretty sure that when it comes to forward compatibility it’s one thing to migrate from one version to the next but as the number of intermediate versions of RT increase the prospects for this to work well diminish. In that, for now I shouldn’t be discarding my 5.0 version of RT.
It hasn’t come up but I am using Windows and have followed these instructions for running RT in portable mode. This means I can easily invoke any of the 3 versions I’ve now used.
See “Compatibility”
http://rawpedia.rawtherapee.com/Sidecar_Files_-_Processing_Profiles#Compatibility
In your 5.4 profile you have “histogram matching” enabled. That means that either:
I had no knowledge of Histogram Matching. The answer must be “unintended”.
Something I did notice is that when opened in 5.4 there was a “tone curve” but while I had experimented with this tool in 5.3 I ended up not making any such change. When reopened in 5.3 the tone curve was still there.
Overall my edits were not very complicated. The reason I spent a lot of time on it is that I’m a novice and there was a lot of “do over” involved. I made some changes using both Highlight and Shadow compression to limit clipping that occurred in both the highlights and shadows. What seemed to really improve the image was done with the Saturation slider.
No need to apologize 
Yes, they can be used. In case the output of an old profile (e.g. from 5.3) is different when applied using a new version (e.g. 5.4) that can be caused by a bug, but also by a bugfix. In rare cases it can also be intentionally, but we try to get newer versions compatible with older pp3 files.
We don’t do this the other way around: Applying a profile from RT 5.4 likely will not give the same result in RT 5.3
As @Morgan_Hardwood pointed out here, there is already an issue to improve the case that you apply a profile which is not comatible (fails). But imho the first RT version which will solve this, will be > 5.6, because we can’t solve it for 5.4 by nature (as 5.4 is already released) and solving it in 5.5 would mean it would be solved for 5.6.
OK, I also did this using the raw file that is the subject of my experiments. Here is a link to an album with the 3 resulting images.
Hi,
if you are sure about this, then please tell us more about the steps to reproduce. I.e., start from the 5.3 pp3, open it in 5.4, and check whether the “auto matched tone curve” button is checked or not. If yes, please upload the raw and the (5.3) pp3 here so that we can have a look. Thanks!
OK! Not sure what I can tell you but the raw file and what I think is the good processing profile when opened with RT 5.3 are here →
EOS Rebel T60079.CR2.pp3 (10.8 KB)
EOS Rebel T60079.CR2 (23.2 MB)
To be sure, I’m a novice when it comes to digital image editing so I only used a few of the basic tools. Nothing elaborate or exotic. Likely only a few of the ones on the exposure tab. As I said I diddled with the Tone Curves but concluded that they didn’t help and ended up with what I’d say is either nothing or the standard linear curve.
EOS Rebel T60079.CR2.pp3 (11.1 KB)
I just switched tone mapping on and off —> auto match tone curve was not automatically enabled
With each change of any variable, curve, boolean or whatever else exists inside the GUI the pp3 is saved immediately.
I try to explain your problem with my words: if you clicked that huge button labeled “Auto-matched Tone Curve” and did not go back one step in the history window but simply applied further changes, well then you have data in your pp3 which you might not like.
I think this answers my basic question. This looks like it may be new material in RawPedia because I thought I was pretty well read on processing profiles. The first sentence says, “Processing profiles evolve from one version of RawTherapee to the next. We strive to ensure backward compatibility (e.g. a profile created in 5.3 and opened in 5.4 should look the same), but this is not always possible.”. I take this to mean “go ahead and try it but you can’t count on it to produce the same result.”. With respect to workflow, my interpretation is that if you want to preserve the state of the editing that has been done in a manner that either editing could be resumed from that point or additional exports made of the same result then you had better retain both the relevant processing profile and the version of RT used to create it. Based on this experiment & discussion I’m also inclined to think that one should be sure to make (i.e., save) any processing profile that is to be preserved in a way that RT will not confuse it for the ones that are automatically opened & rewritten without requesting user permission.
That leads to the question, “might it be better to export the resulting image to a file using a standard format that could then be reopened in either RT or any other image processing software?”. I think this would eliminate future ability to perform certain raw processing operations such as demosaicing. I’m not experienced enough to have an opinion about this but would be grateful to learn form those who are.
Of course the answer could also be to take both of the above actions.
If you tick this checkbox, your pp3 will be saved in addition besides your output file
In the last two or so years I noticed significant attention being devoted to preserving PP3 compatibility, but, as RawPedia says, that’s not always possible, for various reasons. One reason I could be responsible for is a DCP profile being added or changed, for instance.
That is exactly what you do when you save the final image to TIFF, PNG or JPG. I think this question is missing something to make sense.
I compress my PP3s if I feel they deserve to be safely preserved:
tar -cJf pp3.tar.xz *.pp3
Looks like this points out that when an image is saved (what I meant when I previously said “exported”) in a standard format, my comment about doing “both” is what you get. What I think we’ve learned here is that in addition it is also necessary/wise to also keep the version of RT used to do it. That works pretty good for me right now but as the number of RT versions mount and the underlying OS (in my case Windows) migrates forward to the point of not being able to run older versions this could get a bit tricky.
It would seem to me that preserving the ability to go back and resume work on a previously developed raw file would be desirable but I’d welcome the opinion of more accomplished photographers about the worth of doing so and especially for how long (i.e., how far into the future this might be of value).
Is it possible that once some skill at developing raw files is obtained that simply starting over with the raw file is good enough?
Twice a year or so, I go back through all of my raw files and look for things I’ve missed in my editing rounds. I usually find one or two images that I’m either unsatisfied with the processing I did at the time or a completely unprocessed raw file that I’ll then develop. If I wanted the output from that moment from RT, I’d just find the tiff I output at the time (I generally keep a print and web version).
So I either want what I had, which means I grab the tiff, jpg, or xcf (depending on the processing), or I want to start over. In either case, backward compatibility doens’t come into play often.
Skill acquired since the last time a photo was processed is one of the motivations I listed in RawPedia (in the “Compatibility” section I linked you to earlier) for reprocessing a photo in a different way should you ever happen to revisit it. Regardless, backward compatibility has been generally well taken into account these last few releases/years.
That’s exactly what I do. And it doesn’t take a bunch of skill, just familiarity with the most-used tools. I also don’t worry about exactly re-creating a curve, or really any other tool.
Now, my workflow for informal photography starts with a raw->small jpeg batch rendition, then I review the jpegs and re-process selected ones from raw to do things like further adjust contrast or crop. But I always start from the raw. I can re-open a raw with the same processing that produced the jpeg using the processing chain stored in the metadata, but that relies to an extent on consistency between the batch processor and the interactive program. Even then there may be differences, and I just accommodate them manually.
Regarding the thread topic, it’s important to realize that most of these image manipulation tools are not engineered for consistency. In different softwares, a sharpen slider that goes from 0-10 may mean different scales, because there’s no measurement standard for ‘sharpness’. Even in successive versions of the same software consistency cannot always be maintained, depending the nature of the improvements. A ‘better’ spline algorithm for a curve tool will yield a different curve, for example.
It has been thus since early days. If you regard some of the “print plan” photographs from such as Ansel Adams, they mark the regions of the image with the appropriate manipulation instructions, e.g., “dodge 3sec” or “burn 5sec” to convey application of differences in printing light from the baseline exposure. Not said is that such instructions rely on the specific illuminator, and would have to be translated for another enlarger, or print size on the same enlarger.
If you’ve created a specific ‘look’ for a photograph and intend in the future to produce particular renditions of size, crop, etc, you probably want to create a full-resolution reference image as the starting point. If that were important to me, that’s what I’d do. It’s not so important to me, I actually like starting from scratch.
Thanks! The perspectives of more experienced photographers is appreciated.