Ingo, nice to see you have time and motivation to use the dual pixel properties for enhancing 5D4’s output
Although there is a problem with these data because the 2 frames are not aligned … these is paralax offset depending on the used aperture and on how much OOF the objects are http://www.magiclantern.fm/forum/index.php?topic=17695.75
Well … maybe even with no correction the result will be interesting …(increased blur at OOF areas )
I hope I will have time to participate 1-2 weeks later …
IMHO the frames are aligned in xy but not in z. The difference in z is the trick which makes dual pixel possible. But that’s just a guess. I have only three files to test…
Ilias, afaik Canon dual pixel has this layout (ignore rgb)
ab ab ab ab
ab ab ab ab
ab ab ab ab
ab ab ab ab
where a combination of a and b is a ‘full’ pixel and ‘a’ and ‘b’ are half pixels. So they are perfectly aligned in xy (of course with half pixel distance in x). My guess is that b pixels are closer (or more far away) from lens a tiny bit to get the effect (z is the distance from lens).
Ingo, the xy arrangement is as you describe but there is no depth difference … the ab pair is under a single microlens and the result is each of the a/b sees only a part of the apperture (pupil). So for the OOF areas each one sees (and records) a different picture.
Try to cover the backside half of your lens, then the other half without changing anything else …
Bobn2 had pictured this at Dpreview forums but I cannot find the posts
The result is shown in the gif I linked as displacement
If the pixels were normal (just not square, like your old Nikon ;)) we could take double horizontal resolution with 5D4 …
Here’s a little example of sampling the light field from different directions. I took two photos from the same point of the same scene with the same lens (a 180/2.8). The only difference between them is in one I blocked off the left half of the rear element with a piece of black plastic foam, in the other I blocked off the right half.
Here’s a first example which uses frame 2 to get back some details in clipped regions of frame 1. Left is original frame 1, right is also frame 1, but uses values from frame 2 when pixels in frame 1 are clipped:
@saknopper I already have two raw dual pixel raw files. But that’s not enough for development. While developing Pentax Pixelshift for rt we used about 100 different raw files…
Just upload files with different shooting conditions. I will ask again, if I need more. Currently it’s quite cool to get some interest on this issue again to get motivation for further work on this.
Great that you gain motivation from interest in a feature . I think the highlight reconstruction is a nice thing but it’s unlikely that I shoot double size raws for the potential possibility to get better highlight under very special circumstances. However, even a very rough depth map would be a feature I see real use cases. There I know before that I require it and would switch on dual px raw. E.g. for greenbox purposes.
Next time I use the camera I will try some dual raw shots, but that won’t be soon.