not exactly. In fact before let geotag find the geo data in the gpx file, it needs to set properly the date time of the image by the mean of an offset. You can apply the same time offset to a selection of images. If that does the trick it should not be difficult to extend the offset to some days…
EDIT: in fact applying an offset of + or - 36:00:00 hours works perfectly. Should work until 99:99:99 hours …