[01:47] Do we have best practices for mailing list archives? Just dump messages into an mbox? [01:57] here's the wiki page on mailman lists: http://www.archiveteam.org/index.php?title=Mailman [02:00] yeah, I saw that... it's what made me ask about an mbox [04:37] I created a github account and cannot figure out how to become of a member of Archive Teams page/group [04:51] arkhive: you're considered a member of the github ArchiveTeam organization if you are on a ArchiveTeam team or an owner [04:52] (the latter requiring an initiation process) [05:00] I've been with AT since Google Vid/StarWars.com/forums save [05:00] but it won't let me join the group of members [05:00] i don't see the join button [05:00] https://github.com/ArchiveTeam [05:03] arkhive: what's your username? [05:03] arkhive [05:13] haha [05:13] chfoo: nice team name [05:14] ? [05:14] chfoo made a team called i-wanna-be-the-very-best and added you to it [05:14] yeah, it'll be useful as a catch all team without giving owner permissions [05:15] since most of the teams are just a single member [06:17] it am unable to create a repository for the failed klik.me save(aquired by facebook). I wrote a script, though and thought it might be good to host it for historical/archival purposes. it's a shell wget script [06:20] so can you make it so i can upload it(i'm new to github..) [06:22] arkhive: https://github.com/ArchiveTeam/klik-grab [06:22] you should have push access to it [06:23] thank you :) [06:29] uploaded. version 2 and version 3. [06:30] first shell script i've ever written. i tried. :P [06:32] Whatchya think? [08:22] what happened to h-online.com? https://en.wikipedia.org/w/index.php?title=MusicBrainz&curid=20797&diff=592783333&oldid=592004601 [08:50] Nemo_bis: they closed down [08:59] * Nemo_bis doesn't find anything in lastlog [09:29] What nice things one discovers archiving wikis. http://wiki.worldnakedbikeride.org/ [10:16] Nemo_bis: they had one of those in Boulder, CO not too long ago [21:05] yay! i killed my fiber! [21:19] ?? [21:19] really? [21:19] :P [21:19] what did you do? [21:20] ^ midas [21:22] arkiver: started a scan for all FTP servers on the internet [21:22] lol [21:22] how many links per second? [21:23] it was baad, hitting 6MB/s with just scanning, will need to check how many mpps it was [21:23] LOL [21:23] first need to see if my connection returns [21:24] and that's a big IF [21:24] yeah [21:24] 6 MB/s shouldn't be a problem I think [21:24] just the number of links... [21:24] O.o [21:26] yeah, it was doing about 5000 servers / hour. so actual servers it found. [21:35] midas, you use the wrong scanner :-) [21:36] bauruine: zmap ftw :p [21:36] midas, ok in this case a bad connection :D [21:36] yes, it killed my connection, but hey. it's still ftw :p [21:36] got 72k in 20 minutes [21:36] it's not really my router that broke [21:36] it's the router in the pop [21:38] hehe online.net blocked my server on my first try because of "flood". [21:38] i can still reach my server, it responds to sms :p [21:39] it killed my server and the last router in about 30seconds. [21:39] midas, how do you scan for anonymous ftp? nmap is dead slow. [21:40] zmap ;) [21:41] zmap scans all ip's in 45 minutes if you have 10gbe+, [21:41] fyi, i dont. [21:41] so takes a bit longer, but you can tell it scan for all ip's with port 21 open [21:42] from there it's just a bit of scripting to build something that connects to the server and checks if it's open for anyone [21:43] midas, i used the output from zmap for nmap. [21:44] ah yes [21:45] and after that a small 5 line bash script to get a list (ls -R) of every ftp :-) [21:45] :p [21:45] see. it's easy! :P [21:46] midas, yes but nmap is sloooow i think my bash script was faster. [21:46] yeah, nmap does 1 ip at a time [21:46] very slow [21:55] midas: I did that last week or so [21:56] I got 85% of the way through the /0 space [21:56] and then this https://github.com/ArchiveTeam/ftp-nab [21:56] is that list saved somewhere? [21:56] http://bl-r.com/trx/ftps.txt.gz [21:57] for the IPs [21:57] I haven't gotten around to checking any of them [21:58] xmc: ill update the list :p [21:58] great [22:00] I'd prefer to be downloading the FTPs. [22:01] (Versus someone else) [22:01] This way they're high-grabbed through the Internet Archive and can be shoved in really quickly. [22:01] ok [22:02] how about we distribute the chore of checking them for anonymous access [22:02] and then hand up you a list of valid addresses or so [22:03] there is a shitload of poorly configured nas with anonymous ftp access on the internet. [22:07] with pirated movies and sound and private data (customer lists / invoices from small companies etc.) [22:07] do you really want to download all this stuff? [22:07] why not? [22:07] it's data [22:08] xmc: I think that's a good approach. [22:08] great [22:24] I'd be interested in helping with the FTP project [22:28] bauruine: it's not really our jobs to check that, we just grab it all. archive.org can do all the hard stuff ;-) [22:34] "Huh, you radical hardline archivists seem to be rather radical and hardline in your archiving" says someone once every month in here. [22:35] and about 5 minutes later they run away scared. [22:36] SketchCow: it's a shame you cant read dutch because the reactions during the hyves grab were epic. [22:37] "oh no, all my private messages will be in archive.org forever! how can i remove them from them? why do they steal my data?" [22:37] tall people, we have alot of brainfreeze. [22:38] I saw it. [22:38] Google Translate [22:38] hah [22:38] SketchCow: yeah, when I saw the FTP grabs starting my first thought was "shit, better tell the boss to tidy up his public home directory on work's FTP server" [22:38] And I did talk about Hyves at an event [22:38] They killed it the morning of my talk - best timing ever [22:38] then I realised, hang on, he's had it public for a decade, what difference does it make? [22:38] Opened my speech with "Who here has a hyves account?" (hands went up) "WRONG" [22:39] haha [22:39] hah epic [22:39] I can just hear you saying that, in fact [22:39] is that talk online anywhere? [22:39] I showed memorial pages, wiped out [22:39] aka, did we archive that yet? [22:41] http://vimeo.com/81873487 [22:44] i may push dish 2013 up to IA [23:33] Oh shit, Archiveteam is here: http://i.imgur.com/0NysV2K.gif [23:33] howmanyusersdoyouhave whereareyourfiledirectoreies isthisvirtualorhostedinstances whathappensifidothis whatiswrongwithyourbandwidth heyisthataban ohshitiopened100connectionsandthey'restruggling [23:34] you could probably compare your list to shodan using their api [23:44] lol, SketchCow [23:47] one big textballoon above it: "YAHOO SUCKS!" [23:48] great talk SketchCow