#archiveteam 2014-02-04,Tue

↑back Search

Time Nickname Message
00:44 🔗 SketchCow https://archive.org/details/computermagazines is coming along.
01:51 🔗 SketchCow https://archive.org/details/computermagazines is in 1.0.
01:51 🔗 SketchCow I'm now going to 1. Go see if there are subcollections or misfired magazines that need sorting
01:52 🔗 SketchCow 2. Maybe start looking at those "alternates" to see if it's just "Jason shoved in the same magazines again because holy shit that is a fuckball amount of computer magazines"
01:58 🔗 SketchCow DFJustin: I just shoved 300+ items, a combination of you and me mostly, into computer-magazine-rack
02:17 🔗 SketchCow I am POSITIVE there's a reason we don't have Computer Gaming World up on archive.org, and maybe that reason is I am stupid.
02:21 🔗 DFJustin there are a ton of gaming magazines that aren't up I think
02:21 🔗 DFJustin was gonna say gamepro but actually it's just orphaned apparently https://archive.org/details/gamepromagazine
02:26 🔗 godane i got way more gamepro stuff
02:27 🔗 godane my gamepro collection is cbz/cbr files
02:27 🔗 godane no pdfs i think
02:34 🔗 SketchCow I loved over gamepro
02:49 🔗 SketchCow If there's other, DFJustin - let me know
02:49 🔗 SketchCow I'll look too.
02:49 🔗 SketchCow This is a good time to swap shit over.
02:49 🔗 SketchCow I'll also be dealing with some backlog problems with my catalog.
03:53 🔗 SketchCow OK, I've been slamming down my back red-row catalog.
03:54 🔗 SketchCow Went from 890 red-row items to 85.
03:55 🔗 dashcloud whoa
03:59 🔗 SketchCow Is bugbug seriously a computer magazine?
04:02 🔗 SketchCow Now down to 47.
04:04 🔗 dashcloud I went to magazine rack, and the description sentence isn't terribly clear: ...that do not have a comprehensive and non-comprehensive collection available. Is that supposed to say "do not have a comprehensive collection", "have a non-comprehensive collection" or something else?
04:05 🔗 SketchCow Down to 27.
04:06 🔗 SketchCow We call that "filler text", sir.
04:06 🔗 SketchCow Now that my attention is in this direction, everything will get spiffed.
04:07 🔗 dashcloud okay- thanks!
04:08 🔗 SketchCow https://archive.org/search.php?query=collection%3Acomputer-magazine-rack&sort=-publicdate is MUCH bigger now.
04:10 🔗 dashcloud this is a hell of a solution to problem: https://archive.org/stream/Apple_2000_Vol_1_No._1_1986-08_BASUG_GB#page/n5/mode/2up (solution #3 on the left side)
04:15 🔗 SketchCow Ok, at 0 redrows
04:15 🔗 SketchCow But that could spike as high as 48 if something fails out.
04:22 🔗 SketchCow Just found another magazine, floating out in the wilderness.
04:22 🔗 SketchCow I'll be running a metamgr scan for them soon.
04:28 🔗 SketchCow Just found 32 collections of manuals floating in nowhere
04:30 🔗 SketchCow I show I have 219 text collections floating in the ether.
04:30 🔗 SketchCow Outside of the manuals I just mentioned.
04:30 🔗 SketchCow So yeah, shit's about to get real on archive.org.
04:32 🔗 xmc shit's *always* getting real at IA
05:08 🔗 DFJustin yes bugbug is a computer magazine https://archive.org/stream/bugbug-magazine-1995-06#page/n139/mode/2up
05:08 🔗 DFJustin I don't recommend flipping through most of it at work though
05:15 🔗 yipdw tentacle porn and modems, what could be better
05:19 🔗 DFJustin there are apparently interesting social reasons why the japanese pc scene in the 90s was much more dominated by shut-in nerds than it was elsewhere where you had a more mainstream home computer revolution
05:21 🔗 DFJustin re: other gaming magazines, I think there is a lot at http://www.retromags.com/ we don't have yet
18:43 🔗 SketchCow DFJustin: After I finish sorting out computermagazines and shoving in every orphan that I personally put in, we'll want to find runs where I basically put the same magazine set in two collections.
18:43 🔗 SketchCow And I'll dark all those out, which will clean things up. Also will move stuff to the spanish section because I'm being pretty liberal there, as well.
18:44 🔗 SketchCow And finally, I am really on the edge of us doing consolemagazines or videogamemagazines because those are actually plentiful enough now to deserve their own section.
19:06 🔗 arkiver SketchCow: just that you know that, the problem with the warc's is now corrected
19:06 🔗 arkiver some final tests are being done
19:07 🔗 arkiver and I'm testing with 54 accounts per minutes
19:07 🔗 arkiver I'm gonna make that 500 accounts tomorrow if everything goes fine
19:12 🔗 DFJustin yeah I'm in favour of gaming stuff being separate
19:13 🔗 DFJustin e.g. Amusement Life is about arcades in japan and has nothing to do with computers, even covers other attractions like roller coasters
19:18 🔗 Atluxity arkiver: does it look like myopera will be archived OK by you alone or how is that going?
19:19 🔗 arkiver hmm
19:19 🔗 arkiver right now it looks like it will go like that yes
19:20 🔗 arkiver I have a few friends who are offering me help
19:20 🔗 arkiver so I can have some more networks
19:20 🔗 arkiver I think it will be alright
19:20 🔗 Atluxity sweeeet
19:20 🔗 arkiver Just, Atluxity: Thank you so much for the accounts list!!!!!!!!!!!!! :)
19:20 🔗 arkiver btw
19:20 🔗 arkiver not 100% sure
19:21 🔗 arkiver doing last test
19:21 🔗 arkiver should be done withing 1-2 hours
19:21 🔗 arkiver after that I will really start doing everything
19:21 🔗 Atluxity ah, good to hear that it was helpfull :D
19:21 🔗 arkiver :D
19:21 🔗 Atluxity their lawyer took his time with giving that green light
19:23 🔗 arkiver Atluxity: YES! last test passed
19:23 🔗 arkiver looks like the warc's work 100%
19:24 🔗 arkiver example account:
19:24 🔗 arkiver http://web.archive.org/web/20140204174340/http://my.opera.com/Fjart/blog/
19:30 🔗 SketchCow DFJustin: What do you think.... gamemagazines?
19:30 🔗 SketchCow I think that's good.
19:30 🔗 SketchCow Arcade games, computer games, console games, etc.
20:00 🔗 DFJustin maybe throw a "video" in there so we can have d&d types elsewhere
20:01 🔗 SketchCow I'm going to keep it as this for now.
20:01 🔗 SketchCow And if we have to get a bunch of RPG stuff elsewhere, that's fine.
20:01 🔗 SketchCow But I suspect we'll be under 100-150, which is what's about good for this new system.
20:02 🔗 SadDM :'(
20:02 🔗 SketchCow I'm still going through the orphans and shoving them into computer magazines
20:02 🔗 SketchCow Although I should say these are MY orphans, not other runs of magazines that are floating out there.
20:03 🔗 SadDM I think the only RPG magazines in the rack went dark a while back
20:03 🔗 SketchCow They do tend to disappear.
20:03 🔗 SketchCow Those guys can live off those magazine issues for decades.
20:04 🔗 DFJustin yeah they don't go obsolete in the same way as computer stuff
20:04 🔗 SadDM I think a lot of the reason is that the content tends to be pretty evergreen
20:04 🔗 SketchCow Right
20:05 🔗 SadDM *sigh* so much of my hobby is locked up... that makes me SadderDM
20:08 🔗 Smiley arkiver: ooooo fun how close are we to going live?
20:10 🔗 SketchCow This is very, very boring work but the outcome will hopefully be very useful.
20:47 🔗 arkiver Smiley: you mean how many we still have to download?
20:47 🔗 arkiver almost everything
20:48 🔗 arkiver up to today was only still testing
20:48 🔗 Smiley yeah
20:48 🔗 Smiley but it seems to be working, right?
20:48 🔗 arkiver from tomorrow I will really go for it
20:48 🔗 arkiver yep!!!]
20:48 🔗 Smiley Can you dump it directly into a warrior, or does it need adaptation?
20:48 🔗 arkiver everything seems to work
20:48 🔗 arkiver ah no
20:48 🔗 arkiver warrior is too slow BTW
20:48 🔗 Smiley :O
20:48 🔗 Smiley Too slow for what?
20:49 🔗 arkiver well
20:49 🔗 arkiver it's first initializing or howver that is called
20:49 🔗 arkiver then downloading
20:49 🔗 arkiver then packing up
20:49 🔗 arkiver then sending
20:49 🔗 arkiver then waiting for new task
20:49 🔗 Smiley yes...
20:49 🔗 arkiver too many steps
20:49 🔗 Smiley o_O
20:49 🔗 arkiver and we need to do like 30000 accounts er hour
20:49 🔗 Smiley heh
20:49 🔗 Smiley challenge ACCEPTED
20:49 🔗 Smiley i think you'll find we can do that.
20:50 🔗 arkiver so tomorrow I'll try to get 30 to 40 crawlers runnig
20:50 🔗 arkiver and if that works, then we are in!
20:50 🔗 Smiley you know we break websites right?
20:50 🔗 arkiver yes
20:50 🔗 arkiver well
20:50 🔗 Smiley 30,000 an hour is far from impossible
20:50 🔗 midas hm i think we dit alot more than that with just 10 people
20:50 🔗 arkiver yep think so
20:50 🔗 arkiver can believe that
20:50 🔗 Smiley midas: you mean like yahoo videos?
20:50 🔗 Smiley that was over a weekend or something crazy?
20:50 🔗 midas nah different site
20:50 🔗 midas we did a site in a couple or hours
20:51 🔗 arkiver midas Smiley: I'll give you some update information tomorrow on how the crawl is going
20:51 🔗 midas running 150 concurrent
20:51 🔗 arkiver and if I can get 30 to 40 crawlers ot work
20:51 🔗 midas + grabs
20:51 🔗 Smiley cool :)
20:51 🔗 arkiver :)
20:51 🔗 arkiver ok
20:51 🔗 arkiver brb
20:51 🔗 Smiley if you can do 30-40, we have people who can do 10000's
20:52 🔗 midas ah yes, i remember, it was ptch.com
20:52 🔗 midas was done in 4 hours or so?
20:54 🔗 Smiley * Defaulting /etc/host.conf:multi to on
20:54 🔗 Smiley * In order to use glibc with USE=-suid, you must make sure that
20:54 🔗 Smiley * you have devpts mounted at /dev/pts with the gid=5 option.
20:54 🔗 arkiver midas: hmm
20:54 🔗 Smiley whoops
20:54 🔗 arkiver maybe a little more then 4 hours...
20:55 🔗 midas nah, Kenshin unloaded the shitload of machines on ptch
20:55 🔗 midas maybe it took 5 hours, not that much more
20:55 🔗 arkiver ey
20:56 🔗 arkiver where has Kenshin been lately?
20:56 🔗 yipdw 30,000 accounts/hour is not difficult for the Warrior
20:56 🔗 yipdw we did more than that on wretch
20:57 🔗 yipdw arkiver: I suspect you're under-selling why the Warrior does what it does
20:57 🔗 yipdw that or you haven't fully understood wit
20:58 🔗 SketchCow https://archive.org/details/gamemagazines
20:58 🔗 SketchCow it has begun
21:03 🔗 SadDM SketchCow: if you are putting rpg and bard games in there... https://archive.org/details/general_magazine https://archive.org/details/ares_magazine and https://archive.org/details/space-gamer
21:06 🔗 SketchCow This would be a bad time to start with that.
21:06 🔗 SketchCow But I will tap you later for this.
21:07 🔗 SadDM roger
21:21 🔗 SketchCow https://archive.org/details/computermagazines now has nothing but computer magazines.
21:21 🔗 SketchCow https://archive.org/details/gamemagazines now has game magazines.
21:21 🔗 SketchCow There are still about 100 magazines left to shove into one or another.
21:21 🔗 SketchCow I am not convinced this is 100% the best use of my time but it is very good to get it done.
21:24 🔗 ats SketchCow: Amiga Power is a games magazine (it was exclusively games, whereas Amiga Shopper was only non-games and Amiga Format was general)
21:24 🔗 ats also, thank you -- I can now point my students at the games section :)
21:31 🔗 SketchCow Yeah, I still have a bunch of move around.
21:31 🔗 SketchCow And many more to add, over 100 like I said.
21:32 🔗 SketchCow Then we can rope back and find more. For example, I haven't looked at magazines uploaded by others.
21:53 🔗 arkiver yipdw: I would like to write a script for the warrior, but I don't know how... :(
21:53 🔗 arkiver maybe someone (chfoo) can do that)
21:54 🔗 arkiver but ok
21:54 🔗 arkiver gotta sleep everyone
21:54 🔗 arkiver will keep pc on downloading
21:54 🔗 arkiver and see you all tomorrow!! :D
21:56 🔗 yipdw arkiver: read the existing scripts, check out the Dev/* pages on archiveteam.org
21:56 🔗 yipdw it's crazy to expect a small group of people to write warrior scripts for everything
22:01 🔗 arkiver ah I understand I'm sorry yipdw
22:01 🔗 arkiver I'll take a look at it tomorrow!
22:01 🔗 arkiver :D
22:01 🔗 arkiver hope I will understand how it works
22:01 🔗 arkiver and maybe I can great one! :D
22:15 🔗 * ersi removes arkiver's enter key
22:15 🔗 * ersi modifies it so it won't bounce around so much
22:16 🔗 * ersi puts it back on arkiver's keyboard
23:45 🔗 * HotSwap wires a 555 onto ersi's enter key running at 1hz

irclogger-viewer