When in the lighttable i sometimes have a bug where it shows multiple instances of the same file.
In this case it is showing multiple images of the same raw file (the yellow hut). seemingly only the yellow hut photo.
I’m not sure how to replicate this but the duplications are increasing, maybe each time i save a style in a certain way???
How do i fix this?
There is only 1 dng file of the yellow hut in the directory. there are 46 raws in the directory but the lighttable shows 54 now…
Change your setting from film roll to folder… then select the folder and see what shows now
I decided to remove the offending file that causing duplications but the images shown in the screen shot do not disappear but i cant load the raw as expected as its not there.
I tried adding that dir to the library again but the 54 images remain even though there are now only 45…
so how to refresh that directory?
It looks like you are in windows. Can you navigate to that folder and see what other files you have there? Multiple xmp for that same raw?
Yes windows 10.
Sure here you are.
I moved the below files to a new dir.
Its worth noting that “CNRAW_05.DNG.xmp” the 05 file does not exist and it refers to CNRAW.DNG
This is what it now looks like
not sure whats causing it or how to refresh that directory.
I wanted to see the files in the directory that match the import. Darktable uses a database to point to the files in the folders. Moving files in folders won’t “move” them in the database.
As others have suggested there is most likely multiple xmp files for the image. Why I do not know. Go to the folder where the images are stored and sort the folder by file type. Then scroll to the xmp files and see if there are 54 duplicates.
Another solution in lighttable is to select 53 of the duplicates and use the remove from library option (not trash option). This should solve the problem.
Thanks, ive removed and re added the files inside darktable library and im still getting the same issue. I’ve narrowed it down though.
if i delete all the xmp files in the folder, remove from library and re add the folder to library the issue is fixed. If i just delete the the duplicated image xmp file the issue is not fixed. so appears to be caused by other xmp files in the folder, however…
I can now replicate the issue, if i remove that folders xmp files and remove from the library the issue is fixed. If i then select all images and apply my style to all the images in the folder then the issue returns and i get as many duplicated images as ive applied the style to. it always only duplicates the first image, which in this case is the yellow hut photo…
Not sure where to go from here though.
narrowed it down further
if i apply the style to another image im getting the duplication issue. If i look at the 2nd images xmp file i can see it is referring to the 1st image.
so the xmp file for CNRAW_16.DNG.xmp shows
xmpMM:DerivedFrom=“CNRAW.DNG”
it should show
xmpMM:DerivedFrom=“CNRAW_16.DNG”
What are the settings in your style?
Why? Do you have a raw file CNRAW_16.DNG? Your screenshot in lighttable bug? - #6 by moose shows a raw called CNRAW.DNG.
Maybe a bit of background:
darktable’s lighttable shows the photos you have in the database (imported originals, duplicates you created, and also duplicates imported by importing their XMP files);
you can always duplicate a photo; doing so does not create a copy of the raw file, just a new entry in the database;
unless you disable writing XMP files (which I don’t recommend), darktable writes an XMP file as well for each database entry;
each database entry (each icon on the lighttable) has its own editing history (also stored in an XMP), like this:
clicking remove on the lighttable will remove the entry from the database, but will not delete the raw file and the XMP sidecar, so you can always reimport it. Lighttable after ‘remove’ on 4 copies:
clicking ‘delete’ on the lighttable will remove the corresponding database entry and delete the XMP file; if there are more edits for the same image in the database, the raw file will not be deleted. Lighttable after using delete on the right-hand copy from the screenshot above:
DSC_5587_01.NEF.xmp has been deleted from the disk!
Again, using remove on the last lighttable icon/database entry removes it from the database, but the XMP files and the raw will be kept:
Reimporting gives me 5 icons, one for each XMP:
I now used remove on 4 copies, the lighttable has a single copy again, one that belongs to DSC_5587.NEF.xmp (version = 0):
If I now use delete, it removes the database entry, the raw file, and all sidecars (not only the sidecar for the entry managed by darktable). Note that:
If you edit, delete, copy or add XMP sidecars outside of darktable, the software will not take them into account (it will not add the changes, like star rating and so on) from the edit (unless you have the option to scan for updated XMPs on start-up enabled); it will not delete/remove anything from the lighttable, and will not add new entries automatically, either. This, and caching of thumbnails is the reason for what you experienced:
Thank you for taking the time to go over that.
Why? Do you have a raw file CNRAW_16.DNG ? Your screenshot in lighttable bug? - #6 by moose shows a raw called CNRAW.DNG .
Yes this raw also does exist.
I had some misunderstanding of how this works, not so straight forward… I thought that by clicking on remove would resolve this but it did not. I also thought delete would delete the raw but i can also use that on the xmp duplications. As soon as i deleted all the duplicated xmp files from within the lighttable (not raw) this issue was gone. I can now apply my style and get no more duplications… and can no longer replicate the issue.
I believe there is a bug there somewhere as i was getting a steady increase of duplications on only the first raw in the directory just by applying a style to all images and cant do that now.
Can i disable the database as i dont really need it as i use digikam? i do use xmp files.
You can switch to an in-memory database; you’ll have to import images to process whenever you restart darktable. If that is indeed what you want:
https://docs.darktable.org/usermanual/development/en/special-topics/program-invocation/darktable/
--library :memory:
