[00:02] Right. [00:03] No, that's the thing. [00:03] this list is going to be quite dead all over. It's a 1996 list! [00:03] You only get so many FTP sites living for 15 years. [00:06] true, true. I have 5 grabs running atm, pulling in 15MB/s. i'll add the rest when i get to work tomorrow morning [00:10] so, if I want to check a list of links to see if they are still live or not, what's the quickest way to do that? [00:10] Hmmm. [00:11] Well, non-downloading wget options let you get returns. [00:18] if you want a gruesome one-liner: [00:18] perl -MLWP::UserAgent -n -e 'chomp; print $_, "\t", LWP::UserAgent->new->request(HTTP::Request->new(HEAD => $_))->status_line, "\n";' [00:18] interesting [00:18] (NB: I just cobbled that together quickly based on something I hacked together for another script last night, so it's doubly-gruesome. but it might be useful, perhaps.) [00:19] just feed it a list of links, one per line [00:21] I'll throw up a port strobe to see how many ftp sites I can dig up [00:24] Appreciated. [00:28] zmap claims 19h left to scan all ipv4 addresses [00:28] I love the future [00:41] 10:03 1% (19h left); send: 36078030 59.5 Kp/s (59.8 Kp/s avg); recv: 247854 420 p/s (410 p/s avg); drops: 0 p/s (0 p/s avg); hits: 0.69% [00:41] that's like a 25 mbit line, or so [00:44] Works for me. [00:45] We'll get the list, and then we'll look at ports. [00:45] Some are on odd ports. [00:45] We'll do a search out there for what ports are generally used. [00:45] But I am sure these will be light and fluffy off-color FTPs. [00:45] I'm just looking at port 21 [00:45] spot checking, most of these are ftp servers that don't allow anonymous access [00:45] we can blow through those pretty fast [01:32] https://github.com/elvanderb/TCP-32764/blob/master/an_open_letter_to_journalists.md [01:32] just lol [01:41] I got to the bit where it transpires the guy writes for The Register and my eyes rolled out of my head. what a surprise. [01:51] okay [01:52] if you tar cvf your webroot [01:52] don't put the tar in the webroot [01:52] and don't name it all.tgz [01:53] so yale account, mysql acccount, amazon api key [01:54] nico_32: haha <3 [01:55] The provided credentials are for an AWS root account! These credentials have ALL permissions. [01:55] #epic fail [01:56] oooooops [02:02] send an email to the contact email [02:03] i am in another country so i should be fine [02:03] (i wonder how many people who will read the HackerNews'post will play with their account) [02:04] and on it, bye everyone - i need to sleep :) [06:33] nico_32: "By the way: your attitude is the exact exemplar of what's wrong with hacker culture. You don't deign to explain to outsiders. I'm an outsider asking for explanation." [06:33] outsider? [06:33] I would not consider a "tech journalist" to be an "outsider"... [06:45] joepie91:) :D [06:49] Hello [06:49] Click on ma new site and comment on the looks http://tinyurl.com/m9zujb7 [06:49] thanks! [07:36] how about no dl-boy-? [07:38] dont like tinyurls, they are scary :p [07:53] mn-county.myminicity.com is the actual site [08:17] * joepie91 pokes Smiley, twrist, SketchCow, xmc, and points at the spammer [08:18] There's a spammer? [08:19] yes, mr. tinyurl/myminicity above [08:19] was a spammmer* [08:19] :P [08:19] that myminicity stuff has some retarded scheme where the more people visit your link, the bigger your city "grows" [08:20] basically, it's like farmville meets affiliate spam, circa 2006 [08:21] impressive [08:28] ultimate revenge, hire a botnet and use a useragent called "earthquake" to hit that site. it would be a natural disaster [08:33] midas: lolol [08:40] ahaha [08:41] * joepie91 plays the bad-pun drums [08:41] puns are great [08:42] puns form the backbone of my relationships [09:16] Someone recorded the sound of downloading the entire FTP capacity of the internet. [09:16] https://www.youtube.com/watch?v=PtceqVHlcak [09:19] oh jesus no wonder my disk is full, I've had this directory on there for over a year [09:19] 480G ftp.oracle.com [09:19] maybe I should figure out how to tar that up [09:19] tar -cf would tar it up [09:19] but you probably knew that already :p [09:19] /dev/sda3 1.7T 1.7T 59G 97% /mnt/sock [09:20] df on that drive [09:20] oh wait you can tar across disks [09:20] I'm such a doof [09:20] it's even faster [09:21] yeah [09:21] question: should i go with ZFS or btrfs, btrfs has the abillity to grow as you go, ZFS is more production ready. [09:21] I like btrfs [09:21] but that's justme [09:22] or, should i go with ceph and add more storage per pod [09:22] so there is an open ftp index at http://www.mmnt.net/ [09:29] Already finding ones in there completely dead. [09:35] ever wonder what a payphone company would put on its ftp site? https://archive.org/details/2012.01.www.quortech.com [09:36] still uploading, probably be done in about 8h [09:36] index is up though [09:37] This FTP site I'm getting from poland, there are files going back as far as 1988 [09:37] 26 years! [09:37] yow [09:37] that's almost as old as some of your socks, I bet [09:38] It's getting tyhere. [09:43] 1988, i was 4! [09:43] SketchCow: If you happen to ahve some time I would appreciate if you would share the address... I might bump into gopher stuff there [09:43] there's a lot of weird ftp in .pl [09:43] xmc: Polish love to keep old stuff... good for us [09:43] xmc: you know what the best thing is, they have fast internet connections there. [09:44] kinda [09:44] the bandwidth-delay product causes some bullshit [09:44] the bad thing is that they use the same hardware as 26 years ago... [09:44] There's, like, no gopher stuff left. [09:44] You know this, right [09:44] SketchCow: I kind of disagree, gopher is still around, also there is a running Veronica service too [09:45] SketchCow: I also collect old gopher source codes too [09:45] Gopher is still around like a burning ice cream stand is still around [09:45] https://archive.org/details/quux-gopher-mirror [09:45] https://archive.org/details/OldGopherSources is yours of course [09:46] yes, yes it is around [09:46] https://archive.org/details/2007-gopher-mirror [09:46] That mirror is quite full with holes and got the gopherdump. Sadly it's very uncomplete and lacks almost all... [09:46] Extracted the whole thing [09:46] reviewed too [09:46] not useful sadly [09:47] It is missing almost all :( [09:47] https://archive.org/details/wais [09:47] yes, that's more interesting, but still need time to evaulate it all [09:47] gopher is, by any reasonable measure, not still around [09:47] The 2007 gopher dump was badly created [10:08] perfect way to be doing work: http://owely.com/1WHQDy [10:09] http://www.scribd.com/doc/199664565/Kanye-West-v-0DayCoins-and-Amazon-Coinye-Lawsuit [10:09] needs archiving [10:09] no scribd account handy [10:09] "perfect way doing work" -> Meh, depends on the cat... [10:10] Reminds me of this: https://www.youtube.com/watch?v=BWIPZvwcnX8 [10:15] headset on: check, fatboyslim on: check. cant hear collegues: check! [10:15] Sitting in small office room with two other colleagues and enjoying the quiet place: check [10:15] :) [10:16] they cant hear me :p [10:16] love active noise cancellation [10:16] How many are you in one space? [10:16] currently 2, entire office is 60 or so [10:16] ah [10:16] makes sense [10:17] and he loves to talk when you are busy, not really productive that way [10:18] Yeah, got you [10:24] "perfect way doing work" -> Meh, depends on the cat... [10:24] cat is nice cat [10:24] and tries not to get in the way [10:24] :p [10:26] Good [10:26] I guess that's you then, right? [10:26] example of my daily struggle: "user is recieving mail from X@vodafone.nl/com. IT manager says: block vodafone.nl/com so spam will stop" [10:27] sledgehammer way of stopping spam... [10:27] lol [10:27] Christ [12:15] .title http://tech.slashdot.org/story/14/01/14/2253228/irish-politician-calls-for-crackdown-on-open-source-internet-browsers [12:15] joepie91: Irish Politician Calls For Crackdown On Open Source Internet Browsers - Slashdot [12:15] wtf [12:15] good luck :D [12:16] Too much beer can cause brain issues indeed [12:18] norbert79: wondering if they're really this stupid [12:19] Politicans? [12:19] Are you serious asking this? [12:19] The mass yes, there are luckily exceptions [12:19] ehm... is there anything I can help with? I hate waiting on a new project for the warrior D: [12:20] does somebody know anything? [12:21] Well, you can always save things from the net on your own too... Or digitalize CD-ROMs... this is what I do at least [12:21] well, the problem is... I don't know where to start... [12:23] I do have about all Grandmixes from Ben Liebrand apart from one (does anyone know him)? [12:24] but I don't think that can be uploaded due to copyright stuff [12:25] DDG: let IA deal with copyright :) [12:25] do you know Ben Liebrand? [12:26] just a question out of curiousity... [12:26] I do not [12:26] https://nl.wikipedia.org/wiki/Ben_Liebrand#Grandmix [12:27] that's what he's most know for [12:27] he presents them every year on 31th of December [12:27] since the last few year [12:27] s [12:28] DDG: definitely upload those [12:28] I'm in the process of coverting them to .ogg's [12:28] converting* [12:28] from mp3 [12:28] DDG: don't [12:28] IA will do that for you, and retain the original MP3s [12:29] of lol, I just about half of them lol [12:29] oh* [12:29] did& [12:29] transcoding to OGG yourself first will just incur more quality loss [12:29] and means the originals won't be available [12:29] well [12:29] your originals, that is [12:29] just upload them to IA as you got them, IA will transcode it to OGG and make it available in both MP3 and OGG [12:29] there's a period of a few years where there none available [12:30] were [12:31] http://www.liebrand.nl/grandmix/ [12:31] "All mixes between 1993 and 1999 presented as being GRANDMIXES [12:31] (including stuff like "Uncle Ben's" and DJ Bootleg 99 mixes) of the year 1993, 1994, 1995, 1996, 1997, 1998 and 1999 are NOT mixed by Ben Liebrand" [12:31] so everything since 1983 I have here right now on a 1 TB drive [12:32] apart from those years [12:32] joepie91: do they need covers? I can find them and add them if neccesary [12:37] they are not all mp3's btw..a few of them are an other format [12:43] DDG: it would be preferable if they included covers, yes [12:43] hm, ok. [12:44] in as high quality a format as you can find :P [12:44] also, what's the other format? [12:44] m4a [12:44] I think [12:44] ah, that's fine [12:44] and one is mp4 [12:44] pretty sure IA can read that [12:44] and it'll transcode that to both MP3 and OGG, most likely [12:44] yeah, you can upload all of it in the original format [12:44] it's mp4, but in fact it's only sound [12:44] lol [12:45] (also, try calling the covers cover.png or cover.jpg - that might make a difference in them being recognized as covers by some applications, though not sure if IA gives a damn) [12:45] I only dont have 2009 yet [12:45] DDG: yeah, ran across that before [12:45] m4a == mp4 [12:45] just like you can call an OGG video file either ogv or ogg [12:47] m4a is just apple's way of using the codec mpeg4 (ot however it's called) [12:47] or* [12:48] I'm pretty sure that it's the exact same container format as audio-only .mp4 [12:48] it would make sense to call it m4a though [12:48] makes it easier to recognize as "oh, this is just audio" [12:49] .m4a does have a better compression then mp3, I tought.. [12:53] well, a first step is to create an account, I think [12:54] DDG: indeed :) [12:55] This screen name is not available, please choose another one. <- .... my chosen name is too short? or maybe already used? [12:57] already used, proably [12:57] probably * [13:13] hm... I read the terms of IA and they says "(e) not to infringe any copyright, trademark, patent, or other proprietary rights of any person" <- if i upload wouldn't it be that i fringe the copyright of the person that made it? [13:14] that's the only thing holding me back from creating an account and upload it [13:16] joepie91: ^ [13:18] yes, but ArchiveTeam policy is basically "screw that, upload everything, if it's a problem IA will make the item dark" [13:18] on authority of SketchCow himself ;) [13:19] mhm, ok [13:20] pretty much what Baljem said [13:20] I wanted to upload mixes of one person which maybe lost in a few years (for example if nobody's torrenting it). [13:20] or if it isn't available at all. [13:21] i hope it's never going to be a problem [13:23] yes, that's the sort of thing where it's more important that we have a copy of it somewhere just in case it ends up being the last copy, rather than worrying about copyright issues until it's too late :) [13:23] true [13:24] if someone does complain, then IA will simply make it unavailable - but they'll keep it safely 'behind the scenes' so that it's still preserved for when copyright's not a problem any more [13:24] only thing i have to do is find covers for most of the items (mp3's) [13:44] mhm, I can't seemd to find 2009... oh well.. [14:00] ah yes, the thing I warned this company just happened. "lets put the websites here and the databases here. But lets mix it so nobody knows what is connected to who!" [14:01] and now mysql started to bitch and whoopafucking-do, they told me to fix it, because I broke it. wohoo :p [14:02] lol [14:04] broken by design... [14:13] lol @ spam with a large "commercial use of this [mass-mailing] software is prohibited; buy a license to remove this notice" banner at the top [14:16] if you're going to spam, then reputation loss through lack of licensing is probably not of concern [14:16] :) [14:18] well, quite. I idly wonder how many users of the software heed the notice, though ;) [14:20] hehe [14:41] joepie: I added to almost every one a cover [14:42] a few left to do [14:42] even added them to the mp4 and m4a ones :P [14:43] joepie91, i mean :P [14:43] :) [14:43] DDG: did you name them cover.*? [14:44] cover.jpg [14:44] is that right? [14:45] most of them are 300px by 300px [14:48] DDG: better just do cover.jpg [14:48] most players only look for an exact match of cover.png or cover.jpg [14:48] afaik [14:48] ow.. [14:49] will do. will have to remove all of them then [14:52] :) [14:52] DDG: just rename [14:53] isn't that difficult if you have all jps in the same folder? :P [14:53] jpgs* [14:54] DDG: oh... it's probably best to put each in a separate folder [14:55] :p [14:55] DDG: you'll end up making a separate item on IA for each anyway [14:55] yea [14:55] or should, anyway [14:55] was planning to do that [14:55] after I removed them all [14:55] with a program like mp3tag it's piece of cake to do that :P [15:28] joepie91: is it the plan to do them as a collection? [15:28] what are you guys doing? [15:28] always interested in music [15:29] collection of the grandmix from ben liebrand [15:29] nice [15:29] I have 1983-1992, between 1992 and 1999 there were none, and then 2000 to 2012 [15:30] 2013* [15:30] but 2009 is missing tough [15:30] couldn't find that one [15:30] now in the process of adding covers [15:31] so, that's about it Schbirid :P [15:31] :) [15:35] fun note: the ones from recent years are about 3 hours, while older ones are 1 hour [15:35] i downloaded all bbc1 essential mixes once and am still weeding out the trash D: [15:37] when did you downloaded them? [15:38] because i could [15:38] welcome to #archiveteam! [15:41] joepie91: and..... done! [15:41] all of them now have a cover [15:44] I don't know how to upload here... :s [15:44] on IA [15:58] DDG: :) [15:58] and just go to Upload [15:58] right top of the page [15:58] on IA [15:58] and use the HTML5 uploader [15:58] because i could [15:59] I think he asked when, not why ;) [16:00] joepie91: does it require certain ports to be open (other than 80 ofc)? [16:00] oh oops [16:00] ~2011 i guess [16:00] when i could ;) [16:00] o.O [16:01] otherwise I'll wait till tommorow. where i am right now the connection sucks balls.. [16:02] it's 14 mbit down and 0.6 mbit up right here -,- [16:02] .5* [16:07] DDG: huh? [16:07] it's just a browser upload [16:07] it works like any other web-based upload would [16:08] i mean, the upload on other location i am is way higher... [16:08] but... almost all ports all blocked [16:08] so that's why i aske [16:08] d [16:10] oh well, i just upload it right now will take some time tough [16:15] I can't think of a good name [16:16] collection of the grandmix from ben liebrand? [16:17] Grandmix Collection Ben Liebrand, maybe? [16:20] joepie91: license thingy should be blank, right? [16:20] yeah [16:20] i'd say [16:21] ok [16:21] and I chose as name: Grandmix Collection: all Grandmixes made by Ben Liebrand since 1983 [16:21] should be descriptive enough I guess :P [16:27] well, this is going to take between 8 - 10 hours to upload [16:39] DDG: you're putting all of them in one item? [16:45] into a collection, yes [16:46] shouldn't I have done that, then? [16:46] @joepie91 [16:47] it the made the most for me atleast.. [16:47] sense [16:47] DDG: I'd argue that it's probably better to have separate items [16:47] since they are technically separate things [16:47] it also lets you do the cover.jpg thingie properly [16:47] i cant stop it now, right? [16:48] maybe with closing the browser I can [16:48] but i dont know if that might screw up stuff [16:48] do you know that? [16:49] joepie91: so... should i stop it or let it running? [16:50] DDG: well, how far in are you [16:50] only about 130 mb or so [16:50] out of 3.5 GB [16:51] i personally would stop it [16:53] so what do you advise me to do, joepie91? [16:53] yeah [16:53] I'd say stop it [16:53] and do one item per set [16:53] er [16:53] per mix [16:54] SketchCow: any way to remove https://archive.org/details/GrandmixCollectionBenLiebrand completely? [16:54] I decided to it one by one [16:55] as per adice of joepi [16:55] advice* [16:56] joepie91: which goes faster.. pinging sketch here or email? [16:57] SketchCow will probably get around to it, eventually... but you can also just remove the 1984 mix [16:57] and rename it to "1983" [16:57] the identifier won't be perfect, but the title will be fine [16:58] (there's an "Edit item" option in the bar next to the search) [16:58] then you just upload everything except for the 1983 mix into their own item afterwards [16:58] (and you'd want to add the cover for 1983 into the existing item) [17:02] joepie91: can he edit the identifier? [17:02] not sure [17:02] otherwise that's the easiest way... [17:08] oh well [17:08] fixed now [17:08] as far I could ofcourse [17:18] joepie91: does IA start to convert that file immediately? [17:18] DDG: it will be queued once it's done uploading [17:18] after it's uploaded [17:18] it will be converted eventually(tm) [17:18] :) [17:18] oh ok [17:18] good [17:19] SketchCow calls it Brewsters Amazing Contraption or something along those lines [17:19] :P [17:19] I call it the Principle Of Eventually [17:19] second one is almost done uploading [17:23] 441 tasks before mine? lol [17:31] joepie91> (there's an "Edit item" option in the bar next to the search) <- there's another one too, btw. It's besides your name "Hello " :P [17:31] :0 [17:31] DDG: that's the one I meant [17:31] :) * [17:31] also, most of those 441 tasks are tiny [17:32] but under "Resources" there's another edit item link [17:33] third one 50% done uploading.. [17:40] Bing. [17:57] hey SketchCow, I had a question. Is it possible to edit the identifier? [17:57] YEs. [17:57] I mean, I kind of have to do it. [17:57] I have a item with the wrong identifier [17:57] Tell me the name. [17:58] sure [17:59] https://archive.org/edit/GrandmixCollectionBenLiebrand should be "BenLiebrandGrandmix1983" [17:59] i wanted to do it all in once, but decided to one by one as per advice of joepi [18:00] so this identifier isn't correct [18:00] yeah, one-per-item is better [18:00]