Time |
Nickname |
Message |
00:17
🔗
|
dashcloud |
arkiver: for a general FTP site (not a monster TB-size one), here's what SketchCow recommended: |
00:17
🔗
|
dashcloud |
For packaging in Internet Archive: |
00:18
🔗
|
dashcloud |
wget -r -l 0 -np -nc ftp://ftp.reallyold.mil.us |
00:18
🔗
|
dashcloud |
tar cvf 2014.01.ftp.reallyold.mil.us.tar ftp.reallyold.mil.us |
00:18
🔗
|
dashcloud |
tar tvf 2014.01.ftp.reallyold.mil.us.tar > 2014.01.ftp.reallyold.mil.us.tar.txt |
01:06
🔗
|
dashcloud |
hi, is there some way to run this script: https://github.com/ArchiveTeam/ftp-nab against a regular textfile of FTP sites? |
01:12
🔗
|
xmc |
dashcloud: I wrote it, it's still under development |
01:12
🔗
|
xmc |
but yeah you just run what's in the readme |
01:12
🔗
|
xmc |
it's kind of tailored for ip addresses, you might want to remove the calls to `host' |
01:13
🔗
|
dashcloud |
I was trying to run it against the set from here: https://www.piratepad.ca/p/old-ftp-list and so I copied the ftp addresses to a file, one per line, and put the list and the check-ftp in the same folder and tried running the ./check-ftp.sh |
01:26
🔗
|
xmc |
check-ftp.sh only checks one address |
01:26
🔗
|
xmc |
you have to use `parallel' to run it against all of them |
02:17
🔗
|
dashcloud |
hmm- apparently I misread the script- it expects a file named .ls.txt ? |
02:17
🔗
|
dashcloud |
./check-ftp.sh: line 8: http://www.wu-wien.ac.at/ftp/pub/games/.ls.txt: No such file or directory |
02:17
🔗
|
dashcloud |
mv: cannot stat `http://www.wu-wien.ac.at/ftp/pub/games/.ls.txt': No such file or directory |
02:17
🔗
|
dashcloud |
maybe not the best example |
02:41
🔗
|
xmc |
you want to run it as |
02:41
🔗
|
xmc |
./check-ftp.sh ftp.example.com |
02:41
🔗
|
xmc |
it is a script to check a single ftp site |
02:42
🔗
|
dashcloud |
huh- apparently I totally misunderstood the example in the readme then |
02:43
🔗
|
dashcloud |
thanks for clearing it up! |
02:46
🔗
|
xmc |
sorry for the unclear readme! |
02:46
🔗
|
xmc |
I just kind of threw something together |
02:47
🔗
|
xmc |
now uploading one 480 gbyte .tar to: https://archive.org/details/2012.12.ftp.oracle.com |
02:47
🔗
|
xmc |
this might take a few days |
02:49
🔗
|
xmc |
4 days 10 hours, according to calculator |
03:55
🔗
|
joepie91 |
SketchCow: surely that HP thing is not meant to derive as a media file? |
05:54
🔗
|
SketchCow |
We had the problem that it exploded. So nothing else could happen. |
05:54
🔗
|
SketchCow |
Also: Our first FTP site takedown! |
06:15
🔗
|
mistym |
Exciting! Which one? |
06:25
🔗
|
xmc |
https://archive.org/details/2012.01.www.quortech.com |
09:18
🔗
|
DDG |
why is it taken down? |
09:59
🔗
|
xmc |
bunch of nonpublic stuff in it, probably |
13:07
🔗
|
ersi |
http://kimonify.kimonolabs.com/kimload?url=http%3A%2F%2Fwww.kimonolabs.com%2Fwelcome.html |
18:02
🔗
|
xmc |
that's spiffy |