Well, if it would be implemented that way: what would you open when the raw files is there but was never opened before. In that case there is no PP3 to load. And in that moment using “create” would make thinks much more complicated.
And if you set the flag “save pp3 with the image” (sorry, can’t look the right naming of that checkbox as I’m not on my pc) than that exact version of the pp3 which was active while creating the jgeg/tiff/… is saved directly near the created file. So if you save your image you can save the relevant pp3 in the same moment.
I am learning that there are some complexities associated with this application that may not fit perfectly with the conventional model but there is a pretty simple answer to the question. It is called Menu>File>Open>New that is the conventional, and I might say intuitive, way to create a new instance of something when nothing yet exists.
However, this does imply that the profile rather than the image is what the user is focused on and intending to produce. Looking at it from my perspective which comes from lots of experience doing many different kinds of things on computers other than image processing this is what seems more natural but I now want to add image processing to that perspective and very much appreciate the help I’m getting here.
Well I can agree on that statement, But you are running a program that develops raw files. So that menu path would create a new raw file. However, this is done in the camera. That is the reason for the raw processor that you can’t create a file. You always just open it.
However, if this is the original intention of the developers I don’t know, but for me it seems to be logical to not have a file menu.
It looks like we’ve arrived at the source of the disparity. When I started using RT I also thought I was developing an image. However, it took me a while to figure out, and some help was needed doing it, that in fact I was NOT actually producing an image but rather what RT refers to as a profile. Since the profile is what RT is producing it is the profile (i.e., .pp3) file that conventional UI mechanisms would have you open and that is what I meant when mentioning the conventional Menu>File>Open>New (.pp3 file). Of course based on what is kept in existing profile files this would probably preclude the idea of selecting what you wanted to work on from thumbnails. The File Browser and Filmstrip do look like significant parts of RT that I’m sure are features appreciated by lots of users that I’m trying to become one of.
In the way of comparison, GIMP uses a conventional menu bar that has a File selection. I can open quite a variety of image files or, unlike RT, I start with nothing and create a New image. Like RT, when the original image comes from some other source, like a camera, such files are never altered. However, instead of the profile concept GIMP builds an entirely new rendering of the image in its own unique (i.e., non-standard) format. It only saves (i.e., Menu>File>Save [or “Save AS”]) files in this GIMP specific format. The term “Export” is used when the time comes to produce a result in one of many standard formats.
A big difference between GIMP and RT is that GIMP rewrites all of the basic image data into the working file (i.e., what can be repeatedly Opened and Saved for further revision) whereas RT avoids doing this and as I understand it only writes data that can be used to reprocess the image data that resides in a separate file. RT is clearly saving a lot of storage space at what I’d call the expense of making users devise a sufficiently precise work flow to know with certainty what separate raw image file has to be mated with a specific profile to reproduce a previously achieved outcome. This is aided by the RT naming convention but that is pretty vulnerable to unintended mistakes that might occur with storage management procedures. To be sure some user specific work flow is also needed with GIMP. While each GIMP specific file that is produced is capable of reproducing a specific image without needing other input, as in the case of RT, you can have a very difficult time figuring out what specific file (e.g., from your camera) corresponds to the image you are working on unless you’ve kept track of that yourself. This has a lot to do with GIMP’s extremely poor handling of metadata which is supposed to get fixed in the next stable release (Version 2.10) if and when that ever happens.
Ironically, perhaps, the way Rt, darktable, and other raw processors work is very similar to making a print from film, rather than the way that gimp or Photoshop works.
Think about your raw file as your negative, and the tiff/jpeg output from RT as your print. You negative doesn’t change, you always have the negative. You can always take your negative an put it in the enlarger, do some contrast adjustments, dodge and burn, etc etc, and end up with a print. No matter how many different prints you produce, you always have the same negative to start from. RT enhances this process with it’s pp3 sidecar file, which is essentially instructions on how to produce the “print” again and again.
When editing Nikon raw images (*.nef) files here and designating version file names, if possible I tend to just suffix the resulting (draft or final) image name with a date field (dsc_1259-20170904.tif) If I’m saving more than one revision during the same day (for which is rare), I then name something similar to “dsc_1260-20170904-01.tif, dsc_1260-20170904-02.tif, …”.
Since I sometimes use other raw editors, I’ll then add either “-rt-” for RawTherapee or “-nxd-” for Nikon’s Capture NX-D prior to the date field. (Lower case with underscores for spaces is best if you’re typing via command line, albeit another popular method is using camel case without underscores for spaces. Shrugs.)
For *.pp3 setting files, I haven’t mucked around with renaming any of them for designating revisions and they remain named as they were by RawTherapee, as it’s more time consuming unless I’ve have an “Oh My God… Great Photo!” (Then I may have multiple TIFF/JPEG along with their associated multiple PP3 files saved to the desktop or some other prominent folder.) If and when I do create a TIFF or JPEG, a PP3 settings file is created alongside the file, so in essence the saved PP3 file is a revision snapshot, granted lacking much description! (Would be nice to note somewhere, “Draft edit, colors look good, etc”, similar to a dated/timed CVS/SVN/GIT log entry.)
Shrugs concerning using GIT for version snapshots; I can barely grasp and utilize CVS/SVN as it is! I can just suffix a file name (eg. *.txt, dot config file, …) with a date field with far less thinking, far less typing and is much much quicker. (eg. readme-20170904.txt, .vimrc.20170904, …) From here, I can run a diff far quicker, for which I rarely do. For dot config or /etc files, I just suffix the filename with a date for which is automatically scripted and performed by VIM. I do use GIT for my one maintained BASH scripts for /home/roger/bin though, albeit sometimes fall behind on commits, and have yet to really have a need to search the GIT log history or utilized GIT for backups. GIT is just something here that sucks more from my time from my timeless life!
I change the file name to match the content. Also do it in ~/.config profiles folder where you can this way have multiple different pp3 files for the same shot. Manual work, but straight forward. This way:
It sounds to me like Roger is saying that .tiff is a good format for saving intermediate images.
I must admit that when I penned my prior remarks I thought that the only kind of files other than raw that RT could edit were of type jpeg. I’m not sure where that came from but was based on reading various documentation about raw editing. Particularly RawPedia. Because of the lossy compression jpeg would be undesirable for this purpose. Jpeg is desirable once you know you have a finished product.
Based on some new reading and experiments Roger’s suggestion looks like a good approach. I’ve now learned that RT seems to be able to edit, at least some, .tiff files. To the extent that RT can edit at least the .tiff files that it creates this looks like it could be a good way to save an intermediate result that you’d not want to lose but also want to retain the ability to continue editing it. I’d also like to thank Roger for elaborating on some of the details he finds useful.
Being able to edit exif data is a good answer for what I had in mind. Knowing that it is kept in the profile is especially good. While I suspect everyone invents file naming conventions as a way to include more information about the corresponding files there are limits to what can be done which I think are solved by being able to maintain exif data.
Usually, I prefer to archive TIFF image files when I can, for genealogy work or other. Although, 16 bit TIFF files can be quite large. As a last resort, archiving JPEG images.
Upon purchasing my Nikon D5600, I usually prefer archiving the camera’s ~20-25MB RAW image files, for which apparently is much better than the much larger TIFF files. (I then export a snapshot after editing the image to JPEG.) My rule of thumb, use RAW when I’m taking photos of something worthwhile looking at within a raw image editor for several hours. Use JPEG for all other photos.
It’s not a feature of RT that I generally use but it will add a version number automatically if the file name that is being saved already exists. This includes the pp3 file at that stage. The pp3 file will be associated with that version but I think that if the raw file is opened again later it will load the most recent pp3 file so the older one needs to be manually selected.
It also will load the last one used when a fresh raw file is opened. This is to help process lots of files taken under the same circumstances but it’s nvg for that style of processing. Most shots may need individual attention so applying the same processing pipe to them is unlikely to give the results that are wanted. The pp3 files can be saved though so if this form of processing is suitable one called say stage1 could be saved or say one to suit the initial steps needed on a particular camera.
I find myself generally selecting neutral profile each time a new raw file is opened. I don’t think that there is an option to make this happen automatically.
The GIMP is a different kettle of fish. Save in it’s own format and reloading it takes things back to where they were left. This is why it’s such a huge file.
Personally for versioning I prefer another application’s method. It has a save new version button. That saves and sets the new version as the current one. It also has save new file for renaming and the opportunity to make that current also overwrite without versioning it. In RT’s case all new version need do is save and version the pp3 file. I’ve never tried launching a pp3 file but would hope that it opened the associated raw file and applied it. It does version saved jpg’s etc
Unless another editor is going to be used on a shot there is no point in saving TIFF or 16bit PNG. TIFF is often used by conservators to account for future software changes. In other words that format will always be with us. Others such as some raw formats and others may not be. That includes the software that was used to produce a shot too.
@floessie I have never really delved into any default settings on RT so just mentioned what it does do with a straight install on Linux. I had noticed that if a raw file is re edited that it selects last one used. I also think that if that has been deleted it still finds it from some where. I assume this is an on the fly back up to account for power fails or crashes etc. Some time ago I deliberately deleted the pp3 and found that it still used the previous settings,
I do know that it will version saved format automatically and I assume a pp3 to go with them. Also that pp3’s can be saved and loaded.
One odd thing about me - maybe - is that I never ever use a packages image browser. This comes down to using more than one package - they all may want to catalogue them. I upload from the camera to a folder with a suitable name and use the desktop’s image browser or a separate image browser. Files are then edited via a right click and open with. That also allows me to select a suitable package for the editing. It’s not always RT and often I use more than one depending on what I want to do.
Yeh maybe i should have read the doc’s on default settings but it only takes seconds to set neutral. Also from a long time ago the only way to change these setting was via the image browser or maybe hand editing the config file.
Not 100 % sure, but I suppose: some where = ~/.cache/RawTherapee/profiles
You can delete profiles with the “clear” command in file browser and get rid of both the pp3 sitting next to the raw file in images folder and cached pp3.
Would be nice if the snapshots we save while editing could somehow be preserved in a pp3. And Yes I understand it’s basically having 2+ pp3s in one pp3; which could make for large files …but soooo convenient
Yeh maybe i should have read the doc’s on default settings but it only takes seconds to set neutral. Also from a long time ago the only way to change these setting was via the image browser or maybe hand editing the config file.