wget – recursively download all files from certain directory listed by apache

Case: recursively download all the files that are in the ‘ddd’ folder for the url ‘http://hostname/aaa/bbb/ccc/ddd/’

Solution:
wget -r -np -nH –cut-dirs=3 -R index.html http://hostname/aaa/bbb/ccc/ddd/

Explanation:
It will download all files and subfolders in ddd directory:
recursively (-r),
not going to upper directories, like ccc/… (-np),
not saving files to hostname folder (-nH),
but to ddd by omitting first 3 folders aaa, bbb, ccc (–cut-dirs=3),
excluding index.html files (-R index.html)

Linux

10 thoughts on “wget – recursively download all files from certain directory listed by apache”

Mike says:

23/02/2011 at 16:38

Thanks, you saved my time…

Reply
Senapathy Thirugnanasambandam says:

24/08/2011 at 11:09

Great, I owe 10 minutes of my life time to you.

Pls command me what (good things) can I do for you 🙂

Reply
nerf12345 says:

13/03/2012 at 21:28

“–cut-dirs=3” should be “–cut-dirs=3”

Reply
Gn0m3 says:

17/04/2012 at 17:19

I think you meant –cut-dirs= 3

Reply
Marcos Rondinelli says:

18/04/2012 at 14:55

Thanks, good tip!

Reply
zioproto says:

27/07/2012 at 23:11

Thanks ! I will make an alias for this ! 🙂

Reply
Oceanography Lucas Barbedo de Freitas says:

08/08/2012 at 15:32

fantastic! Neymar does something like your play football for Brazil. 🙂

Reply
kraz says:

15/01/2013 at 13:25

thanks for this post, it helped me

Reply
Vegetarian says:

08/09/2013 at 06:27

Thanks very much, this helps a lot.

Reply
kravi says:

09/04/2015 at 11:43

Better to use -R “index.html*” instead of -R index.html to exclude download of “index.html?blah=blah” kind of files

Reply