[05:29] That's useful information. :) [05:30] I think most FTP servers in the world are probably unwatched by now [07:09] http://devslovebacon.com/conferences/bacon-2014/talks/from-colo-to-yolo-confessions-of-the-angriest-archivist [07:09] This one..... this one's pretty out there [07:10] sigh: http://www.thejerrysite.com [07:11] managed to find the original site still running for now: http://165.225.131.245 [07:14] archivebot job launched against [07:17] thanks, assuming that's at me. machine froze right after i pasted. [07:31] SketchCow: i can grab the devslovebacon videos from there site using youtube-dl [07:34] i couldn't get the link to vimeo.com to work so i went with your link [07:36] i will see about downloading all of the devslovebacon talks [09:47] SN4T14, SketchCow the host pissed it's pants around 80% into the second stage of ftp-nab, I couldn't reach anything on port 21 for the following 24 hours so the output was never processed, it also generated a stupid amount of abuse claims at my other host which resulted in them forwarding 140+ emails to me about it, mostly from edu sites [09:48] classy [09:50] #yolo [09:50] SN4T14, no complaints they just (or automatically) stopped us from reaching anything on port 21, letting them know what we were doing first would of been a good idea, generally isn't my style though .. [09:55] I'm 20 minutes into that talk at devslovebacon; lovin' it so far. [10:03] new CCC [10:03] masscan port 21 + massive ftp grab :) [10:04] new list? :D [10:04] i wonder what happens if i run this on one of my hosted boxes [10:08] so the script just trashed the output from the first 80 % ? [10:12] just a small tip to not break the internet, limit the bandwidth a tad :p [10:12] ok it might take a bit longer but thats fine with me [10:13] yes, make it 10 or 100 times slower than what ohhdemgir did and they won't notice (or 10 times slower from 10 machines?) [10:14] Nemo_bis, I dumped it, not sure what it did, I still have the file from the first stage, should run again, I'm shocked no one else has but after running it I can see why.. midas yeahhh, limiting, that's a bad word!! [10:14] :D [10:14] im limiting it to 200Mbit now [10:14] 4 hours [10:14] probably longer anyway [10:14] After that, IPv6! [10:14] \o/ [10:15] great idea Nemo_bis [10:15] it wasn't a bandwidth issue, I just think hitting every ftp site in the world ruffled a few feathers [10:15] probably yeah [10:15] the box im abusing isnt a livebox anyway [10:16] oops [10:16] something just broke [10:17] box is offline :X [10:17] lol [10:18] that was pritty quick [10:18] IPMI IS DOWN [10:18] ... [10:18] Now you actually have to call somebody! [10:19] remote reboot [10:19] I'll cross my fingers for you [10:19] thanks [10:20] maybe they think zmap is abusive? [10:21] what's scans.io https://github.com/zmap/zmap/issues/84 [10:21] midas: what a weird thought that would be [10:22] https://github.com/zmap/zmap/issues/129 [10:22] pussies [10:24] "stop looking at my house" [10:24] schbirid: you have a box at oneprovider, try zmap :D [10:24] :P [10:25] it kinda killed my dual xeon already [10:25] :P [10:25] aka https://github.com/zmap/zmap/pull/156 ? [10:28] "On a typical desktop computer with a gigabit Ethernet connection, ZMap is capable scanning the entire public IPv4 address space in under 45 minutes." ... That. Sounds. Fucking. Awesome. [10:28] -bs [10:29] is the -R really necessary? https://github.com/ArchiveTeam/ftp-nab/blob/master/check-ftp.sh#L8 [10:36] not really [10:37] listing all directories is nice though [10:37] midas, like I said, is causes some havok XD [10:48] 12:15 ohhdemgir> it wasn't a bandwidth issue, I just think hitting every ftp site in the world ruffled a few feathers [10:48] that's why i want to do it from CCC's network [10:48] yes, that, do that [10:48] last time a few people have done that from 30c3 [10:56] i'm grabbing another news paper: http://www.colebrookchronicle.com/ [11:04] LOL ohhdemgir [11:04] Hello, [11:04] your server is suspended for flood. [11:04] Do you explain that? [11:04] reply: wait, isnt that allowed? [11:04] yiss [11:08] it was rate limited, what a pussy :p [11:08] exactly, I tells you XD [11:09] I should try run masscan from school again, I crashed their firewall last time [11:09] heh [11:09] SketchCow, I'm enjoying this talk - http://i.imgur.com/pqmawVr.png [11:33] Cameron_D: the event network team i was in crashed the edge firewall off a whole belgian campus [11:34] s/off/of/ [11:34] with 100 mbps in a gre tunnel [11:34] next time they will give us the f***** dark fiber we requested every year [11:40] Hello, [11:40] you must not use ZMap. [11:40] well yeah, i understand that. now give me access to my box [12:31] Is there a channel for the ftp-nab project thing? If not, maybe time to create one :) [12:39] it's part of the ftpsite project which I don't think there is a chan for [12:39] ersi, make it :) [12:39] I've ripping a few sites a day [12:39] been* [12:47] create all the chans! [12:48] and let me know where to dump the new list :p [17:59] For the record, STILL downloading the crap from games.mirrors.tds.net/ [20:04] SketchCow: That was an *epic* twitter smackdown... love it. [20:07] ersi, SketchCow channel for ftp site project? [20:13] #effteepee [21:42] Sorry, new here and don't know where to put this, but I'm quite worried about http://forums.spacebattles.com/ [21:43] there's a large number of fanfics, many of which may not be archived [21:44] that's fine- thanks for telling us about it [21:44] it's an old forum, but there's a new competitor (http://forums.sufficientvelocity.com/ ) which popped up after some site politics, and most of the staff moved over there [21:45] apparently it's been in technical decay for some time [21:45] the forums are still readable, but the forum index is hidden [21:45] how practical is it to save fairly large forums? [21:47] should I submit it somewhere in particular? [21:47] especially concerning is the possibility that one solution to memory issues is pruning the database [21:48] here is fine- someone will look at it and figure out how to archive it [21:48] I /really hope/ they at least avoid the most valuable forums, but I'd rather not leave it up to chance [21:49] okay, thank you :) [21:49] you guys are awesome [21:49] that site isn't publicly navigable [21:49] etesp, it'd be kind of hard to archive that, since you say the index is hidden [21:49] hang on [21:49] http://forums.spacebattles.com/forums/vs-debates.4/ [21:50] you can still view individual forums like that [21:50] Actually, hang on, I have an idea [21:51] the text before the number is irrelevant, I think, so you should be able to find each forum by testing numbers sequentially? [21:52] e.g. http://forums.spacebattles.com/forums/testing.5/ http://forums.spacebattles.com/forums/testing.4/ [21:52] Huh, yeah [21:53] Yeah, it should be pretty easy to archive it, then [21:53] excellent :D [21:54] Looks like a pretty big forum, though [21:54] yea. [21:54] It's been going for a long time, and pretty high activity [21:55] if it's going to take some time and your tools are set up for it [21:55] prioritising the creative writing and roleplay archives would be good [21:57] the competitor forum, sufficient velocity, apparently has db access, but will only pull over posts if each author gives permission [21:57] which would miss out a huge amount of content just from people's who're no longer active so can't agree to it [21:58] Pfft, consent is overrated. :p [21:58] as a first step I've thrown the aforementioned links into archivebot [21:59] shall I grab the creative writing forum for you? [22:03] http://forums.spacebattles.com/forums/creative-writing.18/ http://forums.spacebattles.com/forums/creative-writing-archive.40/ [22:04] also, unrelated, but I'm an op on wikiapiary and am expecting to have some free time to play around with projects in a couple of months. [22:05] one of the things I'm considering is making a few more bots and adapting wikiapiary to collect basic info from foums [22:06] would be a whole lot less fancy than wikiapiary because more diverse software and less good statistics api [22:07] but i'd like to help you guys have a good auto-updating index of forums [22:15] hmm there used to be big-boards but it seems to be gone [22:15] but there's http://www.thebiggestboards.com/ [22:19] there is that, but the apiary framework is kinda awesome. SMW queries, time series data, presented nicely, other fun things. [22:24] http://forums.sufficientvelocity.com/threads/sb-server-errors.3321/page-27#post-474520 posted on SV, maybe we'll get a few more people running archive warrior :) [22:27] rm [22:27] oops [22:28] Silly yipdw, this isn't your shell. :p [22:28] touchpads suck [22:29] etesp: the links you added have been added to archivebot's queue [22:29] #archivebot for monitoring [22:29] thank you :) [22:33] https://archive.org/download/Mattel_Intellivision_TOSEC_2012_04_23/Mattel_Intellivision_TOSEC_2012_04_23.zip [22:33] and.... [22:33] FINISHED --2014-06-10 21:59:04-- [22:34] Downloaded: 11188 files, 684G in 1d 2h 1m 44s (7.48 MB/s) [22:34] Total wall clock time: 1d 2h 18m 43s [22:34] (Planetquake 3) [22:34] slightly lower priority forums (RP): http://forums.spacebattles.com/forums/a-brob-is-for-you-for-all-your-roleplaying-need.60/ http://forums.spacebattles.com/forums/story-debates-play-by-post-games.10/ http://forums.spacebattles.com/forums/story-debate-archives.15/ [22:40] why intellivision [22:41] All the links on that forum: http://pastebin.com/wdkhuN3Q [22:41] subforums, not all the links [22:42] thanks SN4T14 :) [22:43] Although I only did 1-99, going to check if there are any >99 [22:46] unlikely that there's 35 they deleted/hid in a row [22:46] ha ha [22:46] Intellivision was a mispaste [22:46] I'm on a mac, I'm all in crazy land [23:01] i'm out for now. thanks for putting SB on the list.