#archiveteam 2012-06-28,Thu

↑back Search

Time Nickname Message
00:52 πŸ”— omf_ fuck yeah. I got something to contribute
00:52 πŸ”— omf_ I got 50 disks for the cdbbsarchive
00:52 πŸ”— omf_ I collect video games and I got shareware disks
00:56 πŸ”— SketchCow Wonderful.
00:56 πŸ”— SketchCow Want to scan them and I can give you a FTP?
00:56 πŸ”— godane SketchCow: i added to cdroms to archive.org
00:57 πŸ”— godane http://archive.org/details/cdrom-3d-world-119
00:57 πŸ”— godane http://archive.org/details/cdrom-3d-world-150
00:57 πŸ”— godane can you put them in shareware section?
01:03 πŸ”— omf_ I am going to dig them out. Is there a list to check against besides the archive.org page you posted earlier?
01:04 πŸ”— balrog- SketchCow: my brother has been using a Panasonic GH1 SLR for video, does a pretty darn good job
01:14 πŸ”— omf_ SketchCow, I just watched the open source bridge 2012 keynote. What exactly am I supposed to get out of it?
01:14 πŸ”— omf_ wait a sec
01:15 πŸ”— omf_ ugh, didn't notice it started 6m in
01:15 πŸ”— omf_ lets see who is before
01:21 πŸ”— SketchCow I was just showing that they do a good keynote recording.
01:22 πŸ”— balrog- they do Ҁ” any midrange HD camcorder will give decent results
01:23 πŸ”— SketchCow Both cdroms ingested.
01:23 πŸ”— omf_ yes it is a good recording
01:24 πŸ”— omf_ a bad one is the recent Linus Torvalds one. In and out of focus constantly and whipping the camera around to find the "action"
01:24 πŸ”— omf_ shit kinda sucked. Content was great
01:26 πŸ”— balrog- a lot has to do with technique
01:27 πŸ”— omf_ balrog-, do you mean lack of technique? ;)
01:27 πŸ”— balrog- more or less :P
01:28 πŸ”— omf_ It is disappointing. I have helped organize conferences and there is never the money to get even semi-pros to do shooting
01:32 πŸ”— arkhive my 'touch STOP' isn't working
01:32 πŸ”— balrog- arkhive: it takes a little time, the current job needs to finish
01:32 πŸ”— arkhive ya it did
01:32 πŸ”— balrog- well it worked for me...
01:33 πŸ”— arkhive iu tried then it fetched another user name about 30 minutes ago
01:34 πŸ”— arkhive Can't I try putting a blank file called STOP in my directory? I think I did that with Google Video
01:34 πŸ”— balrog- touch should create such a blank file
01:35 πŸ”— DoubleJ The STOP needs to have a newer modified time than when the instance started running.
01:36 πŸ”— DoubleJ So if you have a STOP file from yesterday, it will never affect a download you started today.
01:37 πŸ”— arkhive a stop file was never created :/
01:37 πŸ”— DoubleJ Hm. Is it in the root of the project (e.g. mobileme-grab/STOP)?
01:41 πŸ”— arkhive nope
01:41 πŸ”— arkhive I added one though.
01:42 πŸ”— arkhive still stuck at the - Discovering urls (XML)
01:42 πŸ”— arkhive for the next user
01:42 πŸ”— DoubleJ The next user after you created the STOP file? Or the user that was already running?
01:43 πŸ”— arkhive the user before i created the stop file is still at 'discovering urls(xml)
01:43 πŸ”— arkhive even after i created the STOP file
01:43 πŸ”— DoubleJ That's fine. That user will go until it's complete.
01:44 πŸ”— DoubleJ The downloader only checks when a user is done.
01:44 πŸ”— DoubleJ The "discovering" step can take a while; it has to parse a (sometimes large) XML file, grab the URLs, sort them and remove duplicates. I had one user that took 12 hours on that step.
01:45 πŸ”— arkhive alright.
01:45 πŸ”— arkhive Ya, I'm at ~14 GB now
01:46 πŸ”— DoubleJ Yup. As long as you're not low on drive space just let it run. It'll finish eventually (or die trying).
01:48 πŸ”— arkhive 700 GB left
01:48 πŸ”— DoubleJ You'll be fine.
01:49 πŸ”— DoubleJ All right, gonna go zonk out. Later.
01:56 πŸ”— balrog- I have 3 machines running, 2 of them running seesaw
02:18 πŸ”— underscor http://forum.cultofmac.com/discussion/comment/144780/#Comment_144780
02:18 πŸ”— underscor LOVE THIS GUY
02:20 πŸ”— omf_ no one said apple users had brains
02:22 πŸ”— balrog- underscor: You have people like that everywhere :/
02:22 πŸ”— underscor yeah :(
02:24 πŸ”— omf_ has anyone ever challenged the legality of the project? I mean with fools like that guy who is suing the oatmeal
02:27 πŸ”— Coderjoe we have advertising?
02:28 πŸ”— aggro We have a Grandstand?
02:28 πŸ”— Coderjoe shit, why didn't anyone tell me? Where do I get my cut?
02:29 πŸ”— aggro As far as I know, there isn't much case law to go on concerning online archiving and online libraries.
02:30 πŸ”— omf_ the point that always sticks we me about this: If you view something online, then you have already downloaded it how is keeping a copy a bad thing?
02:30 πŸ”— Coderjoe *sigh* here we go again. :-\ If you wish to continue the discussion of legality, please move it to -bs
02:30 πŸ”— omf_ I just wondered if anyone tried to start shit. It is legal until the courts say it isn't.
02:31 πŸ”— omf_ damn the shareware rip I just did failed.
02:31 πŸ”— omf_ This drive is a constant problem
02:32 πŸ”— godane SketchCow: can you setup the ftp for me?
02:32 πŸ”— underscor I don't even get what we're advertising?
02:33 πŸ”— underscor It's not like we sell things
02:33 πŸ”— underscor Grandstanding for what?
02:33 πŸ”— underscor We do what we do regardless of who knows or whatever >:|
03:01 πŸ”— shaqfu Archive Team is a sting operation; archive.org actually pipes to /dev/null
03:42 πŸ”— underscor lol
03:55 πŸ”— godane found newer byte magazine pdfs: http://thepiratebay.se/torrent/7380688/BYTE_magazine_full-res_scans_PDF_JC1.0_20120622
03:56 πŸ”— godane you can all just download them here too: http://malus.exotica.org.uk/~buzz/byte/pdf/
05:34 πŸ”— omf_ thanks for those bytes
07:07 πŸ”— Lord_Nigh grr connection is going f***ing haywire
10:36 πŸ”— SketchCow https://www.youtube.com/watch?v=tJqZGRIwtxk&feature=plcp
10:54 πŸ”— omf_ I am watching your talk now
11:00 πŸ”— omf_ wow that is a large amount of shareware disks. Are they all available online?
11:02 πŸ”— Coderjoe a lot of them are at cd.textfiles.com and probably on archive.org by now
11:03 πŸ”— omf_ that is dope as hell. That is why I want to add stuff too. I collect video games and things surrounding it
11:24 πŸ”— ersi Coderjoe: yeah, AFAIK all of SketchCow's shareware disks from cd.textfiles.com have been ingested into IA, think there's a couple o blogposts about it~
11:29 πŸ”— Coderjoe RTTY art? wow
11:33 πŸ”— Coderjoe haha
11:33 πŸ”— Coderjoe nice use of the Tsukasa cellphone gif
13:25 πŸ”— fLoo yay
13:25 πŸ”— fLoo i just attached another 15 tb to my home esxi
13:25 πŸ”— fLoo :)
13:26 πŸ”— SmileyG :)
13:27 πŸ”— fLoo i love esata-external-raid-bays
13:27 πŸ”— fLoo no need to care about the cableing inside the server anymore
13:27 πŸ”— fLoo just attach and become happy
13:27 πŸ”— fLoo =)
13:30 πŸ”— SmileyG proper servers are fun? :)
13:30 πŸ”— SmileyG by that I mean proper backplanes. btw this should be -> #archiveteam-bs
13:30 πŸ”— fLoo what does bs mean ?
13:30 πŸ”— fLoo im new here, sorry
13:31 πŸ”— SmileyG erm, something that comes outta a cows bottom ;)
13:31 πŸ”— SmileyG This channel is strictly for archive-team discussion onjly
13:31 πŸ”— fLoo :D
13:31 πŸ”— fLoo ah bullshit
13:31 πŸ”— SmileyG everything offtopic goes in-> -bs :)
13:31 πŸ”— fLoo thanks :-)
16:12 πŸ”— swebb 80M unwound url-shortener urls from the twitter spritzer stream since Oct 2011: https://www.dropbox.com/s/xjle0ksvzeik8mf/urls.txt.bz2 [1.75GB]
16:24 πŸ”— SketchCow Grab it!!!!
16:24 πŸ”— swebb It's actually mine. I'll leave it there for a while.
16:26 πŸ”— BlueMax Nice grab swebb
16:27 πŸ”— BlueMax SketchCow, I'm watching the OSB keynote and just got to the ArchiveTeam Warrior part, was this based off the old ArchiveBox project?
16:28 πŸ”— Schbirid link?
16:28 πŸ”— swebb I've been pulling the spritzer stream since Oct. I'm now unwinding all of the urls as they come in.
16:28 πŸ”— BlueMax https://www.youtube.com/watch?v=tJqZGRIwtxk&feature=plcp < 26:30 ish
16:29 πŸ”— Schbirid thx
16:34 πŸ”— BlueMax I'm downloading the ArchiveTeam Warrior now
16:34 πŸ”— BlueMax Wasn't it me that came up with that idea?
16:34 πŸ”— BlueMax It was ages ago, sure
16:35 πŸ”— BlueMax might have been someone else
16:37 πŸ”— BlueMax Like we had half a team working on it but it kinda fell by the wayside
16:37 πŸ”— BlueMax And here's the Javascript MESS Project :D
16:38 πŸ”— SketchCow Yes, this is 2.0
16:39 πŸ”— BlueMax Was that my idea or not? I honestly don't remember, I remember doing a Piratepad/Etherpad on it writing down ideas though
16:39 πŸ”— ersi No, we were circle jerking and talking about what GUI we should ship with a VM *if* we'd actually make a VM
16:39 πŸ”— ersi then alard whipped together a VM with some scripts and stuff, now - that's AT Warrior. Doing in action
16:40 πŸ”— ersi Does it matter who's idea it was? :)
16:40 πŸ”— BlueMax lol, not at all, I swear I thought of something like that and told you all about it :P
16:41 πŸ”— godane SketchCow: added http://archive.org/details/cdrom-3d-world-142
16:41 πŸ”— BlueMax haha, Lucky Star reference at the end
16:41 πŸ”— godane i really need access to adding to software section
16:46 πŸ”— fLoo anyone got a good idea
16:46 πŸ”— fLoo :D
16:46 πŸ”— fLoo howto use my new 15 tb ?
16:47 πŸ”— BlueMax be right back
16:47 πŸ”— Famicoman wget -r google.com
16:47 πŸ”— fLoo kidding me ?
16:47 πŸ”— fLoo already done!!1
16:47 πŸ”— Famicoman ees a joke
16:47 πŸ”— fLoo orly ;)
16:49 πŸ”— underscor BlueMax: Yeah, I think you said the first thing
16:49 πŸ”— underscor like a year ago
16:49 πŸ”— underscor lol
16:50 πŸ”— BlueMaxim was it really only a year? Feels so much longer :P
16:50 πŸ”— BlueMaxim oi, BlueMax, get outta here
16:50 πŸ”— underscor My year-versary with archiveteam was February
16:51 πŸ”— SketchCow Hurrah
16:51 πŸ”— underscor so I couldn't have been too much longer than that
16:51 πŸ”— underscor s/I/it/
16:51 πŸ”— BlueMaxim I remember the day I joined was the day that Slashdot put up an article on the Geocities torrent
16:51 πŸ”— DFJustin "anniversary" already means year-versary :P
16:51 πŸ”— swebb underscor: Yea!
16:51 πŸ”— underscor DFJustin: :P fiiine
16:51 πŸ”— underscor :o SketchCow enters
16:52 πŸ”— underscor Everyone look busy
16:52 πŸ”— BlueMaxim I joined in October 2010 so I've been here longer than you underscor :P
16:52 πŸ”— BlueMaxim I just wish I was near as useful
16:52 πŸ”— swebb I started in 2008/2009 range and my first major project was GeoCities.
16:52 πŸ”— underscor I've been here since yahoo video
16:52 πŸ”— underscor which was before BlueMaxim joined, isn't it?
16:52 πŸ”— swebb but I'm not here every day.
16:52 πŸ”— BlueMaxim I swear I came in here when Slashdot put an article up on the Geocities torrent, and I googled it and it was in October 2010
16:53 πŸ”— godane been here since google videos back
16:53 πŸ”— Famicoman I think I registered on the wiki in January of 2009
16:53 πŸ”— Famicoman there were like 8 people in here
16:55 πŸ”— SketchCow We need more people!!
16:55 πŸ”— Schbirid public service announcement: IGN/Gamespy are a bunch of idiotic fuckwits
16:55 πŸ”— SketchCow MORE MORE
16:55 πŸ”— godane my big project right now is uploading all the 3d world isos i have found
16:55 πŸ”— BlueMaxim SketchCow if I had the ability I'd go on public television with a cry for members :)
16:56 πŸ”— underscor BlueMaxim: I swear you came after me :P
16:56 πŸ”— Famicoman that's a go idea
16:56 πŸ”— BlueMaxim underscor I would rephrase that sentence
16:56 πŸ”— BlueMaxim right goddamn now
16:56 πŸ”— underscor <3
16:56 πŸ”— underscor hahahahahahahha
16:56 πŸ”— Famicoman lets buy adspace on late night television
16:56 πŸ”— underscor Wow
16:56 πŸ”— Famicoman :P
16:56 πŸ”— underscor Fileplanet made all files not-downloadable now
16:56 πŸ”— Schbirid not that
16:57 πŸ”— Schbirid but they ruined our way
16:57 πŸ”— underscor er, yeah.
16:57 πŸ”— underscor they made it much more difficult
16:58 πŸ”— BlueMax Whatever happened to...Andrea, wasn't it?
16:58 πŸ”— BlueMax I think he/she was working on the QDB archival project
17:01 πŸ”— BlueMax Also I need to get the ArchiveMeme thing working again, it was fun when Jason had a beard
17:01 πŸ”— Schbirid lesson learned: never contact a host you are trying to save
17:02 πŸ”— frame_at SketchCow: do you need any direct donations for the last two days of mobile.me archiving?
17:02 πŸ”— frame_at other than helping to grab the data
17:03 πŸ”— balrog- Schbirid: so there's no way to archive fileplanet now? :(
17:05 πŸ”— Schbirid balrog-: we got the easy part done 99%. but the oldest/rarest files were not grabbed that way (i was simply incrementing an ID, not all files were accessible through that)
17:05 πŸ”— balrog- ugh.
17:05 πŸ”— Schbirid right now it looks like they completely stopped serving the old files
17:05 πŸ”— balrog- Schbirid: can you link me one of the old files?
17:05 πŸ”— balrog- or is there a list somewhere?
17:05 πŸ”— Schbirid http://archiveteam.org/index.php?title=Fileplanet/non-id-urls is our (very incomplete) dump
17:05 πŸ”— Schbirid i'm gone in a moment, bb tomorrow
17:05 πŸ”— balrog- ok.
17:05 πŸ”— balrog- how soon do we expect this to go away?
17:06 πŸ”— Schbirid was not expected soon at all (a year or so). but those files ARE "gone" now
17:06 πŸ”— balrog- yeah, 404 :(
17:06 πŸ”— Schbirid maybe, if i am super lucky, my contact still has a way to get them. we'll see
18:02 πŸ”— omf_ Is there anyone around working on the fileplanet thing? I think I found a way to *fix* all the urls. I posted it in #fireplanet 30 minutes ago and with no response I thought I would mention it here
18:12 πŸ”— SketchCow I just moved all of godane's CD-ROM images over.
18:12 πŸ”— SketchCow Godane, just keep uploading them, I can do bulk transfers.
18:16 πŸ”— patrickg SketchCow: I
18:16 πŸ”— patrickg SketchCow: I'm done with the OSS repo for now - disk crashed, but I think I uploaded all repos that are dead upstream
18:24 πŸ”— godane SketchCow: Why is this listed as text: http://archive.org/details/cdrom-3d-world-141
18:24 πŸ”— godane i know its in shareware cd archive but its a iso image not text file
18:24 πŸ”— SketchCow patrickg: Thank you.
18:25 πŸ”— SketchCow godane: It's not
18:25 πŸ”— SketchCow Reload.
18:25 πŸ”— SketchCow patrickg: So should I start trying to upload it to archive.org?
18:27 πŸ”— SketchCow I see a number of empty directories.
18:28 πŸ”— SketchCow Oh, I see....
18:28 πŸ”— godane there is empty folders in 3d world isos alot
18:29 πŸ”— patrickg SketchCow: ignore everything but packed-mirror
18:29 πŸ”— godane i think its mostly cause of the way it uses 3dw.exe
18:29 πŸ”— SketchCow Really?
18:29 πŸ”— SketchCow LEt's take this to a pm.
18:29 πŸ”— SketchCow Let's quickly work through it.
18:56 πŸ”— underscor alard: do you have a /56 aware google scraping script?
18:58 πŸ”— alard underscor: https://gist.github.com/2788197d2db2779cb7b0
18:58 πŸ”— underscor er, yeah, 58
18:58 πŸ”— underscor 48*
18:58 πŸ”— underscor thank
18:58 πŸ”— underscor thanks!
19:31 πŸ”— fLoo btw
19:31 πŸ”— fLoo i used google ipv6-"exploit" for so long now
19:31 πŸ”— fLoo need it for google maps requests
19:31 πŸ”— fLoo so i can do like unlimited per day without paying for it
19:33 πŸ”— omf_ fLoo, was openstreetmap not working for you?
19:34 πŸ”— fLoo well
19:34 πŸ”— fLoo i need several things which doesnt make osm an option
19:34 πŸ”— omf_ data
19:34 πŸ”— omf_ I got you
19:34 πŸ”— fLoo well basically its the geocoding
19:36 πŸ”— godane looks like there are dvd disk of 3d world magazines
19:37 πŸ”— godane was not sure if the dvd was special magazines or not
19:45 πŸ”— godane SketchCow: Add to shareware cd section: http://archive.org/details/cdrom-3d-world-139 and http://archive.org/details/cdrom-3d-world-140
19:45 πŸ”— SketchCow Shhh.
19:45 πŸ”— SketchCow You need not do this.
19:45 πŸ”— SketchCow Just upload, I'll do a bulk.
19:45 πŸ”— godane sorry
19:46 πŸ”— * Nemo_bis eager to see the next bunch of Italian shareware discs
19:48 πŸ”— SketchCow It'll be a while
19:48 πŸ”— SketchCow I'm only home for hours at a time this month and the next.
19:50 πŸ”— Nemo_bis I see
20:44 πŸ”— arkhive err. I keep timing out while archiving mobileme...
20:44 πŸ”— arkhive - Running wget --mirror (at least 4298 files)...NOTE: you should run 'diskperf -y' to enable the disk statistics
20:45 πŸ”— arkhive since 1:03 am Mountain time.
21:12 πŸ”— godane i must have uploaded 4.4gb of just 3d world isos so far
21:14 πŸ”— godane 109, 110, 116, and 125 are next iso images to do
21:14 πŸ”— godane i want to save 151 thur 157 for last
21:15 πŸ”— godane even though i got them completed
21:15 πŸ”— godane those came out this year so i don't want ia to dark archive them
irclogger-viewer