I can confirm that I can use cURL to download .avi's and .jpegs via dos command line from my computer, with admin/password. (Trust me, it's just as slow as downloading the files with the web browser
)
Anyways, next step would be to build some sort of parser with some intelligence to only do current day and not bother with previous directory structures built.
This is an example command that works on my x32 vista with cURL installed in my home user folder:
C:/Users/YOURUSERNAME/Downloads/curl-7.29.0-ssl-sspi-zlib-static-bin-w32/curl-7.29.0-ssl-sspi-zlib-static-bin-w32/curl.exe -k --user admin:PASSWORD -O "https://192.168.1.66/cgi/admin/getSDFile.cgi?file=20130225_223938.jpg&path=DCS-5222L/20130225/22/20130225_223938.jpg"
I guess the worst thing would be requesting an incomplete, unusable stored file... would have to get complicated comparing file sizes and re-downloading if "new file size>previous file size"... since there would be no way to tell when it was finished writing to the SD card.
If you feel brave and download cURL, just replace my URL with a valid file on your SD card... in IE, right click and "copy shortcut" on a valid jpg or avi file... you must use the quotes...
The only other problem that I have in writing in Java using cURL, is that I don't know when the download is "finished".... (I've thought about this, and my final goal would be to upload to an offsite place, encrypted). I haven't figured many of these parts out yet...and I'm not sure I want to be sole developer on this...
I'm not new to programming, but I'm new to cURL and this whole DCS camera thingy...and my day job deals nothing with this type of stuff....and I'm usually burnt out when I get home....