#archiveteam 2014-01-16,Thu

↑back Search

Time Nickname Message
00:17 🔗 dashcloud arkiver: for a general FTP site (not a monster TB-size one), here's what SketchCow recommended:
00:17 🔗 dashcloud For packaging in Internet Archive:
00:18 🔗 dashcloud wget -r -l 0 -np -nc ftp://ftp.reallyold.mil.us
00:18 🔗 dashcloud tar cvf 2014.01.ftp.reallyold.mil.us.tar ftp.reallyold.mil.us
00:18 🔗 dashcloud tar tvf 2014.01.ftp.reallyold.mil.us.tar > 2014.01.ftp.reallyold.mil.us.tar.txt
01:06 🔗 dashcloud hi, is there some way to run this script: https://github.com/ArchiveTeam/ftp-nab against a regular textfile of FTP sites?
01:12 🔗 xmc dashcloud: I wrote it, it's still under development
01:12 🔗 xmc but yeah you just run what's in the readme
01:12 🔗 xmc it's kind of tailored for ip addresses, you might want to remove the calls to `host'
01:13 🔗 dashcloud I was trying to run it against the set from here: https://www.piratepad.ca/p/old-ftp-list and so I copied the ftp addresses to a file, one per line, and put the list and the check-ftp in the same folder and tried running the ./check-ftp.sh
01:26 🔗 xmc check-ftp.sh only checks one address
01:26 🔗 xmc you have to use `parallel' to run it against all of them
02:17 🔗 dashcloud hmm- apparently I misread the script- it expects a file named .ls.txt ?
02:17 🔗 dashcloud ./check-ftp.sh: line 8: http://www.wu-wien.ac.at/ftp/pub/games/.ls.txt: No such file or directory
02:17 🔗 dashcloud mv: cannot stat `http://www.wu-wien.ac.at/ftp/pub/games/.ls.txt': No such file or directory
02:17 🔗 dashcloud maybe not the best example
02:41 🔗 xmc you want to run it as
02:41 🔗 xmc ./check-ftp.sh ftp.example.com
02:41 🔗 xmc it is a script to check a single ftp site
02:42 🔗 dashcloud huh- apparently I totally misunderstood the example in the readme then
02:43 🔗 dashcloud thanks for clearing it up!
02:46 🔗 xmc sorry for the unclear readme!
02:46 🔗 xmc I just kind of threw something together
02:47 🔗 xmc now uploading one 480 gbyte .tar to: https://archive.org/details/2012.12.ftp.oracle.com
02:47 🔗 xmc this might take a few days
02:49 🔗 xmc 4 days 10 hours, according to calculator
03:55 🔗 joepie91 SketchCow: surely that HP thing is not meant to derive as a media file?
05:54 🔗 SketchCow We had the problem that it exploded. So nothing else could happen.
05:54 🔗 SketchCow Also: Our first FTP site takedown!
06:15 🔗 mistym Exciting! Which one?
06:25 🔗 xmc https://archive.org/details/2012.01.www.quortech.com
09:18 🔗 DDG why is it taken down?
09:59 🔗 xmc bunch of nonpublic stuff in it, probably
13:07 🔗 ersi http://kimonify.kimonolabs.com/kimload?url=http%3A%2F%2Fwww.kimonolabs.com%2Fwelcome.html
18:02 🔗 xmc that's spiffy

irclogger-viewer