partial downloading from https://raw.pixls.us/

@patdavid
Is it possible to download all the raw files for Pentax cameras and only them? and then how to proceed.
I am now only able to download the whole data base (which is huge) or one photo at a time (which will take a lot of time).
Thanks

Good question - let’s ping @andabata to find out!

You can use Index of /data/Pentax in combination with something like wget or lftp
Or you can use rsync://raw.pixls.us/data/Pentax/ (but you do need to use the -L flag)

2 Likes

[edit] - This was just me playing around, please use rsync.

Using wget:

wget --no-parent --recursive -nd -R *.html* https://raw.pixls.us/data/Pentax/
option info
--no-parent doesn’t ascend to parent directory
--recursive recursively enter directories
--nd files saved to current directory (no sub-directories)
-R reject files with this pattern *.html*

@patdavid @andabata

using wget just do what I want.
:grinning:
Thanks

If the data is to be further redistributed, please keep in mind that not all of the samples are CC0 yet.

2 Likes

No redistribution foreseen. Only for lensfun test.