I documented some of my findings along the following thread (scroll down a bit to see some example images).
The photos I am scanning are old family photos with some of them already in a very poor condition, therefore infrared is particularly helpful since it separates scratches from other degradations.