[00:52] fuck yeah. I got something to contribute [00:52] I got 50 disks for the cdbbsarchive [00:52] I collect video games and I got shareware disks [00:56] Wonderful. [00:56] Want to scan them and I can give you a FTP? [00:56] SketchCow: i added to cdroms to archive.org [00:57] http://archive.org/details/cdrom-3d-world-119 [00:57] http://archive.org/details/cdrom-3d-world-150 [00:57] can you put them in shareware section? [01:03] I am going to dig them out. Is there a list to check against besides the archive.org page you posted earlier? [01:04] SketchCow: my brother has been using a Panasonic GH1 SLR for video, does a pretty darn good job [01:14] SketchCow, I just watched the open source bridge 2012 keynote. What exactly am I supposed to get out of it? [01:14] wait a sec [01:15] ugh, didn't notice it started 6m in [01:15] lets see who is before [01:21] I was just showing that they do a good keynote recording. [01:22] they do — any midrange HD camcorder will give decent results [01:23] Both cdroms ingested. [01:23] yes it is a good recording [01:24] a bad one is the recent Linus Torvalds one. In and out of focus constantly and whipping the camera around to find the "action" [01:24] shit kinda sucked. Content was great [01:26] a lot has to do with technique [01:27] balrog-, do you mean lack of technique? ;) [01:27] more or less :P [01:28] It is disappointing. I have helped organize conferences and there is never the money to get even semi-pros to do shooting [01:32] my 'touch STOP' isn't working [01:32] arkhive: it takes a little time, the current job needs to finish [01:32] ya it did [01:32] well it worked for me... [01:33] iu tried then it fetched another user name about 30 minutes ago [01:34] Can't I try putting a blank file called STOP in my directory? I think I did that with Google Video [01:34] touch should create such a blank file [01:35] The STOP needs to have a newer modified time than when the instance started running. [01:36] So if you have a STOP file from yesterday, it will never affect a download you started today. [01:37] a stop file was never created :/ [01:37] Hm. Is it in the root of the project (e.g. mobileme-grab/STOP)? [01:41] nope [01:41] I added one though. [01:42] still stuck at the - Discovering urls (XML) [01:42] for the next user [01:42] The next user after you created the STOP file? Or the user that was already running? [01:43] the user before i created the stop file is still at 'discovering urls(xml) [01:43] even after i created the STOP file [01:43] That's fine. That user will go until it's complete. [01:44] The downloader only checks when a user is done. [01:44] The "discovering" step can take a while; it has to parse a (sometimes large) XML file, grab the URLs, sort them and remove duplicates. I had one user that took 12 hours on that step. [01:45] alright. [01:45] Ya, I'm at ~14 GB now [01:46] Yup. As long as you're not low on drive space just let it run. It'll finish eventually (or die trying). [01:48] 700 GB left [01:48] You'll be fine. [01:49] All right, gonna go zonk out. Later. [01:56] I have 3 machines running, 2 of them running seesaw [02:18] http://forum.cultofmac.com/discussion/comment/144780/#Comment_144780 [02:18] LOVE THIS GUY [02:20] no one said apple users had brains [02:22] underscor: You have people like that everywhere :/ [02:22] yeah :( [02:24] has anyone ever challenged the legality of the project? I mean with fools like that guy who is suing the oatmeal [02:27] we have advertising? [02:28] We have a Grandstand? [02:28] shit, why didn't anyone tell me? Where do I get my cut? [02:29] As far as I know, there isn't much case law to go on concerning online archiving and online libraries. [02:30] the point that always sticks we me about this: If you view something online, then you have already downloaded it how is keeping a copy a bad thing? [02:30] *sigh* here we go again. :-\ If you wish to continue the discussion of legality, please move it to -bs [02:30] I just wondered if anyone tried to start shit. It is legal until the courts say it isn't. [02:31] damn the shareware rip I just did failed. [02:31] This drive is a constant problem [02:32] SketchCow: can you setup the ftp for me? [02:32] I don't even get what we're advertising? [02:33] It's not like we sell things [02:33] Grandstanding for what? [02:33] We do what we do regardless of who knows or whatever >:| [03:01] Archive Team is a sting operation; archive.org actually pipes to /dev/null [03:42] lol [03:55] found newer byte magazine pdfs: http://thepiratebay.se/torrent/7380688/BYTE_magazine_full-res_scans_PDF_JC1.0_20120622 [03:56] you can all just download them here too: http://malus.exotica.org.uk/~buzz/byte/pdf/ [05:34] thanks for those bytes [07:07] grr connection is going f***ing haywire [10:36] https://www.youtube.com/watch?v=tJqZGRIwtxk&feature=plcp [10:54] I am watching your talk now [11:00] wow that is a large amount of shareware disks. Are they all available online? [11:02] a lot of them are at cd.textfiles.com and probably on archive.org by now [11:03] that is dope as hell. That is why I want to add stuff too. I collect video games and things surrounding it [11:24] Coderjoe: yeah, AFAIK all of SketchCow's shareware disks from cd.textfiles.com have been ingested into IA, think there's a couple o blogposts about it~ [11:29] RTTY art? wow [11:33] haha [11:33] nice use of the Tsukasa cellphone gif [13:25] yay [13:25] i just attached another 15 tb to my home esxi [13:25] :) [13:26] :) [13:27] i love esata-external-raid-bays [13:27] no need to care about the cableing inside the server anymore [13:27] just attach and become happy [13:27] =) [13:30] proper servers are fun? :) [13:30] by that I mean proper backplanes. btw this should be -> #archiveteam-bs [13:30] what does bs mean ? [13:30] im new here, sorry [13:31] erm, something that comes outta a cows bottom ;) [13:31] This channel is strictly for archive-team discussion onjly [13:31] :D [13:31] ah bullshit [13:31] everything offtopic goes in-> -bs :) [13:31] thanks :-) [16:12] 80M unwound url-shortener urls from the twitter spritzer stream since Oct 2011: https://www.dropbox.com/s/xjle0ksvzeik8mf/urls.txt.bz2 [1.75GB] [16:24] Grab it!!!! [16:24] It's actually mine. I'll leave it there for a while. [16:26] Nice grab swebb [16:27] SketchCow, I'm watching the OSB keynote and just got to the ArchiveTeam Warrior part, was this based off the old ArchiveBox project? [16:28] link? [16:28] I've been pulling the spritzer stream since Oct. I'm now unwinding all of the urls as they come in. [16:28] https://www.youtube.com/watch?v=tJqZGRIwtxk&feature=plcp < 26:30 ish [16:29] thx [16:34] I'm downloading the ArchiveTeam Warrior now [16:34] Wasn't it me that came up with that idea? [16:34] It was ages ago, sure [16:35] might have been someone else [16:37] Like we had half a team working on it but it kinda fell by the wayside [16:37] And here's the Javascript MESS Project :D [16:38] Yes, this is 2.0 [16:39] Was that my idea or not? I honestly don't remember, I remember doing a Piratepad/Etherpad on it writing down ideas though [16:39] No, we were circle jerking and talking about what GUI we should ship with a VM *if* we'd actually make a VM [16:39] then alard whipped together a VM with some scripts and stuff, now - that's AT Warrior. Doing in action [16:40] Does it matter who's idea it was? :) [16:40] lol, not at all, I swear I thought of something like that and told you all about it :P [16:41] SketchCow: added http://archive.org/details/cdrom-3d-world-142 [16:41] haha, Lucky Star reference at the end [16:41] i really need access to adding to software section [16:46] anyone got a good idea [16:46] :D [16:46] howto use my new 15 tb ? [16:47] be right back [16:47] wget -r google.com [16:47] kidding me ? [16:47] already done!!1 [16:47] ees a joke [16:47] orly ;) [16:49] BlueMax: Yeah, I think you said the first thing [16:49] like a year ago [16:49] lol [16:50] was it really only a year? Feels so much longer :P [16:50] oi, BlueMax, get outta here [16:50] My year-versary with archiveteam was February [16:51] Hurrah [16:51] so I couldn't have been too much longer than that [16:51] s/I/it/ [16:51] I remember the day I joined was the day that Slashdot put up an article on the Geocities torrent [16:51] "anniversary" already means year-versary :P [16:51] underscor: Yea! [16:51] DFJustin: :P fiiine [16:51] :o SketchCow enters [16:52] Everyone look busy [16:52] I joined in October 2010 so I've been here longer than you underscor :P [16:52] I just wish I was near as useful [16:52] I started in 2008/2009 range and my first major project was GeoCities. [16:52] I've been here since yahoo video [16:52] which was before BlueMaxim joined, isn't it? [16:52] but I'm not here every day. [16:52] I swear I came in here when Slashdot put an article up on the Geocities torrent, and I googled it and it was in October 2010 [16:53] been here since google videos back [16:53] I think I registered on the wiki in January of 2009 [16:53] there were like 8 people in here [16:55] We need more people!! [16:55] public service announcement: IGN/Gamespy are a bunch of idiotic fuckwits [16:55] MORE MORE [16:55] my big project right now is uploading all the 3d world isos i have found [16:55] SketchCow if I had the ability I'd go on public television with a cry for members :) [16:56] BlueMaxim: I swear you came after me :P [16:56] that's a go idea [16:56] underscor I would rephrase that sentence [16:56] right goddamn now [16:56] <3 [16:56] hahahahahahahha [16:56] lets buy adspace on late night television [16:56] Wow [16:56] :P [16:56] Fileplanet made all files not-downloadable now [16:56] not that [16:57] but they ruined our way [16:57] er, yeah. [16:57] they made it much more difficult [16:58] Whatever happened to...Andrea, wasn't it? [16:58] I think he/she was working on the QDB archival project [17:01] Also I need to get the ArchiveMeme thing working again, it was fun when Jason had a beard [17:01] lesson learned: never contact a host you are trying to save [17:02] SketchCow: do you need any direct donations for the last two days of mobile.me archiving? [17:02] other than helping to grab the data [17:03] Schbirid: so there's no way to archive fileplanet now? :( [17:05] balrog-: we got the easy part done 99%. but the oldest/rarest files were not grabbed that way (i was simply incrementing an ID, not all files were accessible through that) [17:05] ugh. [17:05] right now it looks like they completely stopped serving the old files [17:05] Schbirid: can you link me one of the old files? [17:05] or is there a list somewhere? [17:05] http://archiveteam.org/index.php?title=Fileplanet/non-id-urls is our (very incomplete) dump [17:05] i'm gone in a moment, bb tomorrow [17:05] ok. [17:05] how soon do we expect this to go away? [17:06] was not expected soon at all (a year or so). but those files ARE "gone" now [17:06] yeah, 404 :( [17:06] maybe, if i am super lucky, my contact still has a way to get them. we'll see [18:02] Is there anyone around working on the fileplanet thing? I think I found a way to *fix* all the urls. I posted it in #fireplanet 30 minutes ago and with no response I thought I would mention it here [18:12] I just moved all of godane's CD-ROM images over. [18:12] Godane, just keep uploading them, I can do bulk transfers. [18:16] SketchCow: I [18:16] SketchCow: I'm done with the OSS repo for now - disk crashed, but I think I uploaded all repos that are dead upstream [18:24] SketchCow: Why is this listed as text: http://archive.org/details/cdrom-3d-world-141 [18:24] i know its in shareware cd archive but its a iso image not text file [18:24] patrickg: Thank you. [18:25] godane: It's not [18:25] Reload. [18:25] patrickg: So should I start trying to upload it to archive.org? [18:27] I see a number of empty directories. [18:28] Oh, I see.... [18:28] there is empty folders in 3d world isos alot [18:29] SketchCow: ignore everything but packed-mirror [18:29] i think its mostly cause of the way it uses 3dw.exe [18:29] Really? [18:29] LEt's take this to a pm. [18:29] Let's quickly work through it. [18:56] alard: do you have a /56 aware google scraping script? [18:58] underscor: https://gist.github.com/2788197d2db2779cb7b0 [18:58] er, yeah, 58 [18:58] 48* [18:58] thank [18:58] thanks! [19:31] btw [19:31] i used google ipv6-"exploit" for so long now [19:31] need it for google maps requests [19:31] so i can do like unlimited per day without paying for it [19:33] fLoo, was openstreetmap not working for you? [19:34] well [19:34] i need several things which doesnt make osm an option [19:34] data [19:34] I got you [19:34] well basically its the geocoding [19:36] looks like there are dvd disk of 3d world magazines [19:37] was not sure if the dvd was special magazines or not [19:45] SketchCow: Add to shareware cd section: http://archive.org/details/cdrom-3d-world-139 and http://archive.org/details/cdrom-3d-world-140 [19:45] Shhh. [19:45] You need not do this. [19:45] Just upload, I'll do a bulk. [19:45] sorry [19:46] * Nemo_bis eager to see the next bunch of Italian shareware discs [19:48] It'll be a while [19:48] I'm only home for hours at a time this month and the next. [19:50] I see [20:44] err. I keep timing out while archiving mobileme... [20:44] - Running wget --mirror (at least 4298 files)...NOTE: you should run 'diskperf -y' to enable the disk statistics [20:45] since 1:03 am Mountain time. [21:12] i must have uploaded 4.4gb of just 3d world isos so far [21:14] 109, 110, 116, and 125 are next iso images to do [21:14] i want to save 151 thur 157 for last [21:15] even though i got them completed [21:15] those came out this year so i don't want ia to dark archive them