Well, this was a full clean installation of Kubuntu, so I didn’t have an existing database to work with. I guess I didn’t have the foresight to put my library.db in my separate partition. I do have a partition where I keep my user files (and photos), but it is not my /home directory.
Looks like I need to put library.db and data.db in a safe place.
What should be darktable’s expected behavior when importing images that have sidecar files? (Given a new installation of darktable and no existing databases).
I just installed darktable from the graphics:darktable:stable as mentioned above, and I’m still seeing the same problem.
I have an image I had previously edited with 3 spot removal fields. When I import this image into darktable, the xmp file ends up with 3 copies of the darktable:mask_... variable data. For example, the darktable:mask_name list looks like this:
Ok, I’ve installed darktable from the snapshot release: darktable 2.5.0~git389.2c4d40683.
I’m still seeing a number of seriously modified files. The worst are the ones where all of the darktable:history entries are deleted!
I have a moderate sized library of perhaps 50k images. I started with an empty darktable database (having removed all images) and then imported my files. I then ran diffs on the xmp files against my backup copies and examined the differences for a portion of them.
For the subset that I looked at, there were about 5000 total images with about 130 of them showing some differences. Out of those differences, about 25 were what I would consider to be ‘corrupted’, since they lost all of my image editng history.
Most of the other diffs seemed to be re-ordering of the <darktable:mask_… > lists (associated mostly with spot removal edits). I’m assuming that these changes are probably not significant, although I could be wrong.
I have been using darktable for many years now, having upgraded to new versions as they come along. It’s possible that my photo library has accumulated corruption from earlier darktable bugs.
I really appreciate your help! Any suggestions as to what to try?
If you can reproduce the deletion of the history when importing an image with that sidecar, could you please do so while running darktable in a terminal so you can see error messages printed there?
The strange thing is that I can re-import the ‘damaged’ images again manually with out problem! All of my edits survive correctly.
What happened initially was that I had done fresh install of Kubuntu on my computer along with the latest darktable (at the time; 2.4.4 I think). Since I had backed up my entire image library just before the OS update, after installing the OS, I simply opened up darktable and proceeded to import all of my photos.
Once the import was complete (it took a long time since I didn’t have OpenGL setup) I ran diffs between my xmp files and their backups. That’s when I discovered a large number of changes had been made.
I’m certain that I did not run any other photo application that might have messed up the xmp files.
At this point, I’m working on a script to identify the damaged files so I can re-import them again. I’ve re-imported about a dozen successfully so far, but I need to speed up the process.
