[00:17] arkiver: for a general FTP site (not a monster TB-size one), here's what SketchCow recommended: [00:17] For packaging in Internet Archive: [00:18] wget -r -l 0 -np -nc ftp://ftp.reallyold.mil.us [00:18] tar cvf 2014.01.ftp.reallyold.mil.us.tar ftp.reallyold.mil.us [00:18] tar tvf 2014.01.ftp.reallyold.mil.us.tar > 2014.01.ftp.reallyold.mil.us.tar.txt [01:06] hi, is there some way to run this script: https://github.com/ArchiveTeam/ftp-nab against a regular textfile of FTP sites? [01:12] dashcloud: I wrote it, it's still under development [01:12] but yeah you just run what's in the readme [01:12] it's kind of tailored for ip addresses, you might want to remove the calls to `host' [01:13] I was trying to run it against the set from here: https://www.piratepad.ca/p/old-ftp-list and so I copied the ftp addresses to a file, one per line, and put the list and the check-ftp in the same folder and tried running the ./check-ftp.sh [01:26] check-ftp.sh only checks one address [01:26] you have to use `parallel' to run it against all of them [02:17] hmm- apparently I misread the script- it expects a file named .ls.txt ? [02:17] ./check-ftp.sh: line 8: http://www.wu-wien.ac.at/ftp/pub/games/.ls.txt: No such file or directory [02:17] mv: cannot stat `http://www.wu-wien.ac.at/ftp/pub/games/.ls.txt': No such file or directory [02:17] maybe not the best example [02:41] you want to run it as [02:41] ./check-ftp.sh ftp.example.com [02:41] it is a script to check a single ftp site [02:42] huh- apparently I totally misunderstood the example in the readme then [02:43] thanks for clearing it up! [02:46] sorry for the unclear readme! [02:46] I just kind of threw something together [02:47] now uploading one 480 gbyte .tar to: https://archive.org/details/2012.12.ftp.oracle.com [02:47] this might take a few days [02:49] 4 days 10 hours, according to calculator [03:55] SketchCow: surely that HP thing is not meant to derive as a media file? [05:54] We had the problem that it exploded. So nothing else could happen. [05:54] Also: Our first FTP site takedown! [06:15] Exciting! Which one? [06:25] https://archive.org/details/2012.01.www.quortech.com [09:18] why is it taken down? [09:59] bunch of nonpublic stuff in it, probably [13:07] http://kimonify.kimonolabs.com/kimload?url=http%3A%2F%2Fwww.kimonolabs.com%2Fwelcome.html [18:02] that's spiffy