#archiveteam 2014-01-29,Wed

↑back Search

Time Nickname Message
01:47 🔗 SadDM Do we have best practices for mailing list archives? Just dump messages into an mbox?
01:57 🔗 dashcloud here's the wiki page on mailman lists: http://www.archiveteam.org/index.php?title=Mailman
02:00 🔗 SadDM yeah, I saw that... it's what made me ask about an mbox
04:37 🔗 arkhive I created a github account and cannot figure out how to become of a member of Archive Teams page/group
04:51 🔗 chfoo arkhive: you're considered a member of the github ArchiveTeam organization if you are on a ArchiveTeam team or an owner
04:52 🔗 chfoo (the latter requiring an initiation process)
05:00 🔗 arkhive I've been with AT since Google Vid/StarWars.com/forums save
05:00 🔗 arkhive but it won't let me join the group of members
05:00 🔗 arkhive i don't see the join button
05:00 🔗 arkhive https://github.com/ArchiveTeam
05:03 🔗 chfoo arkhive: what's your username?
05:03 🔗 arkhive arkhive
05:13 🔗 yipdw haha
05:13 🔗 yipdw chfoo: nice team name
05:14 🔗 arkhive ?
05:14 🔗 yipdw chfoo made a team called i-wanna-be-the-very-best and added you to it
05:14 🔗 chfoo yeah, it'll be useful as a catch all team without giving owner permissions
05:15 🔗 chfoo since most of the teams are just a single member
06:17 🔗 arkhive it am unable to create a repository for the failed klik.me save(aquired by facebook). I wrote a script, though and thought it might be good to host it for historical/archival purposes. it's a shell wget script
06:20 🔗 arkhive so can you make it so i can upload it(i'm new to github..)
06:22 🔗 yipdw arkhive: https://github.com/ArchiveTeam/klik-grab
06:22 🔗 yipdw you should have push access to it
06:23 🔗 arkhive thank you :)
06:29 🔗 arkhive uploaded. version 2 and version 3.
06:30 🔗 arkhive first shell script i've ever written. i tried. :P
06:32 🔗 arkhive Whatchya think?
08:22 🔗 Nemo_bis what happened to h-online.com? https://en.wikipedia.org/w/index.php?title=MusicBrainz&curid=20797&diff=592783333&oldid=592004601
08:50 🔗 joepie91 Nemo_bis: they closed down
08:59 🔗 * Nemo_bis doesn't find anything in lastlog
09:29 🔗 Nemo_bis What nice things one discovers archiving wikis. http://wiki.worldnakedbikeride.org/
10:16 🔗 arkhive Nemo_bis: they had one of those in Boulder, CO not too long ago
21:05 🔗 midas yay! i killed my fiber!
21:19 🔗 arkiver ??
21:19 🔗 arkiver really?
21:19 🔗 arkiver :P
21:19 🔗 arkiver what did you do?
21:20 🔗 arkiver ^ midas
21:22 🔗 midas arkiver: started a scan for all FTP servers on the internet
21:22 🔗 arkiver lol
21:22 🔗 arkiver how many links per second?
21:23 🔗 midas it was baad, hitting 6MB/s with just scanning, will need to check how many mpps it was
21:23 🔗 Smiley LOL
21:23 🔗 midas first need to see if my connection returns
21:24 🔗 midas and that's a big IF
21:24 🔗 arkiver yeah
21:24 🔗 arkiver 6 MB/s shouldn't be a problem I think
21:24 🔗 arkiver just the number of links...
21:24 🔗 arkiver O.o
21:26 🔗 midas yeah, it was doing about 5000 servers / hour. so actual servers it found.
21:35 🔗 bauruine midas, you use the wrong scanner :-)
21:36 🔗 midas bauruine: zmap ftw :p
21:36 🔗 bauruine midas, ok in this case a bad connection :D
21:36 🔗 midas yes, it killed my connection, but hey. it's still ftw :p
21:36 🔗 bauruine got 72k in 20 minutes
21:36 🔗 midas it's not really my router that broke
21:36 🔗 midas it's the router in the pop
21:38 🔗 bauruine hehe online.net blocked my server on my first try because of "flood".
21:38 🔗 midas i can still reach my server, it responds to sms :p
21:39 🔗 bauruine it killed my server and the last router in about 30seconds.
21:39 🔗 bauruine midas, how do you scan for anonymous ftp? nmap is dead slow.
21:40 🔗 midas zmap ;)
21:41 🔗 midas zmap scans all ip's in 45 minutes if you have 10gbe+,
21:41 🔗 midas fyi, i dont.
21:41 🔗 midas so takes a bit longer, but you can tell it scan for all ip's with port 21 open
21:42 🔗 midas from there it's just a bit of scripting to build something that connects to the server and checks if it's open for anyone
21:43 🔗 bauruine midas, i used the output from zmap for nmap.
21:44 🔗 midas ah yes
21:45 🔗 bauruine and after that a small 5 line bash script to get a list (ls -R) of every ftp :-)
21:45 🔗 midas :p
21:45 🔗 midas see. it's easy! :P
21:46 🔗 bauruine midas, yes but nmap is sloooow i think my bash script was faster.
21:46 🔗 midas yeah, nmap does 1 ip at a time
21:46 🔗 midas very slow
21:55 🔗 xmc midas: I did that last week or so
21:56 🔗 xmc I got 85% of the way through the /0 space
21:56 🔗 xmc and then this https://github.com/ArchiveTeam/ftp-nab
21:56 🔗 Jonimus is that list saved somewhere?
21:56 🔗 xmc http://bl-r.com/trx/ftps.txt.gz
21:57 🔗 xmc for the IPs
21:57 🔗 xmc I haven't gotten around to checking any of them
21:58 🔗 midas xmc: ill update the list :p
21:58 🔗 xmc great
22:00 🔗 SketchCow I'd prefer to be downloading the FTPs.
22:01 🔗 SketchCow (Versus someone else)
22:01 🔗 SketchCow This way they're high-grabbed through the Internet Archive and can be shoved in really quickly.
22:01 🔗 xmc ok
22:02 🔗 xmc how about we distribute the chore of checking them for anonymous access
22:02 🔗 xmc and then hand up you a list of valid addresses or so
22:03 🔗 bauruine there is a shitload of poorly configured nas with anonymous ftp access on the internet.
22:07 🔗 bauruine with pirated movies and sound and private data (customer lists / invoices from small companies etc.)
22:07 🔗 bauruine do you really want to download all this stuff?
22:07 🔗 xmc why not?
22:07 🔗 xmc it's data
22:08 🔗 SketchCow xmc: I think that's a good approach.
22:08 🔗 xmc great
22:24 🔗 dashcloud I'd be interested in helping with the FTP project
22:28 🔗 midas bauruine: it's not really our jobs to check that, we just grab it all. archive.org can do all the hard stuff ;-)
22:34 🔗 SketchCow "Huh, you radical hardline archivists seem to be rather radical and hardline in your archiving" says someone once every month in here.
22:35 🔗 midas and about 5 minutes later they run away scared.
22:36 🔗 midas SketchCow: it's a shame you cant read dutch because the reactions during the hyves grab were epic.
22:37 🔗 midas "oh no, all my private messages will be in archive.org forever! how can i remove them from them? why do they steal my data?"
22:37 🔗 midas tall people, we have alot of brainfreeze.
22:38 🔗 SketchCow I saw it.
22:38 🔗 SketchCow Google Translate
22:38 🔗 midas hah
22:38 🔗 Baljem SketchCow: yeah, when I saw the FTP grabs starting my first thought was "shit, better tell the boss to tidy up his public home directory on work's FTP server"
22:38 🔗 SketchCow And I did talk about Hyves at an event
22:38 🔗 SketchCow They killed it the morning of my talk - best timing ever
22:38 🔗 Baljem then I realised, hang on, he's had it public for a decade, what difference does it make?
22:38 🔗 SketchCow Opened my speech with "Who here has a hyves account?" (hands went up) "WRONG"
22:39 🔗 Baljem haha
22:39 🔗 midas hah epic
22:39 🔗 Baljem I can just hear you saying that, in fact
22:39 🔗 midas is that talk online anywhere?
22:39 🔗 SketchCow I showed memorial pages, wiped out
22:39 🔗 midas aka, did we archive that yet?
22:41 🔗 SketchCow http://vimeo.com/81873487
22:44 🔗 godane i may push dish 2013 up to IA
23:33 🔗 SketchCow Oh shit, Archiveteam is here: http://i.imgur.com/0NysV2K.gif
23:33 🔗 SketchCow howmanyusersdoyouhave whereareyourfiledirectoreies isthisvirtualorhostedinstances whathappensifidothis whatiswrongwithyourbandwidth heyisthataban ohshitiopened100connectionsandthey'restruggling
23:34 🔗 S[h]O[r]T you could probably compare your list to shodan using their api
23:44 🔗 xmc lol, SketchCow
23:47 🔗 midas one big textballoon above it: "YAHOO SUCKS!"
23:48 🔗 midas great talk SketchCow
irclogger-viewer