[00:44] https://archive.org/details/computermagazines is coming along. [01:51] https://archive.org/details/computermagazines is in 1.0. [01:51] I'm now going to 1. Go see if there are subcollections or misfired magazines that need sorting [01:52] 2. Maybe start looking at those "alternates" to see if it's just "Jason shoved in the same magazines again because holy shit that is a fuckball amount of computer magazines" [01:58] DFJustin: I just shoved 300+ items, a combination of you and me mostly, into computer-magazine-rack [02:17] I am POSITIVE there's a reason we don't have Computer Gaming World up on archive.org, and maybe that reason is I am stupid. [02:21] there are a ton of gaming magazines that aren't up I think [02:21] was gonna say gamepro but actually it's just orphaned apparently https://archive.org/details/gamepromagazine [02:26] i got way more gamepro stuff [02:27] my gamepro collection is cbz/cbr files [02:27] no pdfs i think [02:34] I loved over gamepro [02:49] If there's other, DFJustin - let me know [02:49] I'll look too. [02:49] This is a good time to swap shit over. [02:49] I'll also be dealing with some backlog problems with my catalog. [03:53] OK, I've been slamming down my back red-row catalog. [03:54] Went from 890 red-row items to 85. [03:55] whoa [03:59] Is bugbug seriously a computer magazine? [04:02] Now down to 47. [04:04] I went to magazine rack, and the description sentence isn't terribly clear: ...that do not have a comprehensive and non-comprehensive collection available. Is that supposed to say "do not have a comprehensive collection", "have a non-comprehensive collection" or something else? [04:05] Down to 27. [04:06] We call that "filler text", sir. [04:06] Now that my attention is in this direction, everything will get spiffed. [04:07] okay- thanks! [04:08] https://archive.org/search.php?query=collection%3Acomputer-magazine-rack&sort=-publicdate is MUCH bigger now. [04:10] this is a hell of a solution to problem: https://archive.org/stream/Apple_2000_Vol_1_No._1_1986-08_BASUG_GB#page/n5/mode/2up (solution #3 on the left side) [04:15] Ok, at 0 redrows [04:15] But that could spike as high as 48 if something fails out. [04:22] Just found another magazine, floating out in the wilderness. [04:22] I'll be running a metamgr scan for them soon. [04:28] Just found 32 collections of manuals floating in nowhere [04:30] I show I have 219 text collections floating in the ether. [04:30] Outside of the manuals I just mentioned. [04:30] So yeah, shit's about to get real on archive.org. [04:32] shit's *always* getting real at IA [05:08] yes bugbug is a computer magazine https://archive.org/stream/bugbug-magazine-1995-06#page/n139/mode/2up [05:08] I don't recommend flipping through most of it at work though [05:15] tentacle porn and modems, what could be better [05:19] there are apparently interesting social reasons why the japanese pc scene in the 90s was much more dominated by shut-in nerds than it was elsewhere where you had a more mainstream home computer revolution [05:21] re: other gaming magazines, I think there is a lot at http://www.retromags.com/ we don't have yet [18:43] DFJustin: After I finish sorting out computermagazines and shoving in every orphan that I personally put in, we'll want to find runs where I basically put the same magazine set in two collections. [18:43] And I'll dark all those out, which will clean things up. Also will move stuff to the spanish section because I'm being pretty liberal there, as well. [18:44] And finally, I am really on the edge of us doing consolemagazines or videogamemagazines because those are actually plentiful enough now to deserve their own section. [19:06] SketchCow: just that you know that, the problem with the warc's is now corrected [19:06] some final tests are being done [19:07] and I'm testing with 54 accounts per minutes [19:07] I'm gonna make that 500 accounts tomorrow if everything goes fine [19:12] yeah I'm in favour of gaming stuff being separate [19:13] e.g. Amusement Life is about arcades in japan and has nothing to do with computers, even covers other attractions like roller coasters [19:18] arkiver: does it look like myopera will be archived OK by you alone or how is that going? [19:19] hmm [19:19] right now it looks like it will go like that yes [19:20] I have a few friends who are offering me help [19:20] so I can have some more networks [19:20] I think it will be alright [19:20] sweeeet [19:20] Just, Atluxity: Thank you so much for the accounts list!!!!!!!!!!!!! :) [19:20] btw [19:20] not 100% sure [19:21] doing last test [19:21] should be done withing 1-2 hours [19:21] after that I will really start doing everything [19:21] ah, good to hear that it was helpfull :D [19:21] :D [19:21] their lawyer took his time with giving that green light [19:23] Atluxity: YES! last test passed [19:23] looks like the warc's work 100% [19:24] example account: [19:24] http://web.archive.org/web/20140204174340/http://my.opera.com/Fjart/blog/ [19:30] DFJustin: What do you think.... gamemagazines? [19:30] I think that's good. [19:30] Arcade games, computer games, console games, etc. [20:00] maybe throw a "video" in there so we can have d&d types elsewhere [20:01] I'm going to keep it as this for now. [20:01] And if we have to get a bunch of RPG stuff elsewhere, that's fine. [20:01] But I suspect we'll be under 100-150, which is what's about good for this new system. [20:02] :'( [20:02] I'm still going through the orphans and shoving them into computer magazines [20:02] Although I should say these are MY orphans, not other runs of magazines that are floating out there. [20:03] I think the only RPG magazines in the rack went dark a while back [20:03] They do tend to disappear. [20:03] Those guys can live off those magazine issues for decades. [20:04] yeah they don't go obsolete in the same way as computer stuff [20:04] I think a lot of the reason is that the content tends to be pretty evergreen [20:04] Right [20:05] *sigh* so much of my hobby is locked up... that makes me SadderDM [20:08] arkiver: ooooo fun how close are we to going live? [20:10] This is very, very boring work but the outcome will hopefully be very useful. [20:47] Smiley: you mean how many we still have to download? [20:47] almost everything [20:48] up to today was only still testing [20:48] yeah [20:48] but it seems to be working, right? [20:48] from tomorrow I will really go for it [20:48] yep!!!] [20:48] Can you dump it directly into a warrior, or does it need adaptation? [20:48] everything seems to work [20:48] ah no [20:48] warrior is too slow BTW [20:48] :O [20:48] Too slow for what? [20:49] well [20:49] it's first initializing or howver that is called [20:49] then downloading [20:49] then packing up [20:49] then sending [20:49] then waiting for new task [20:49] yes... [20:49] too many steps [20:49] o_O [20:49] and we need to do like 30000 accounts er hour [20:49] heh [20:49] challenge ACCEPTED [20:49] i think you'll find we can do that. [20:50] so tomorrow I'll try to get 30 to 40 crawlers runnig [20:50] and if that works, then we are in! [20:50] you know we break websites right? [20:50] yes [20:50] well [20:50] 30,000 an hour is far from impossible [20:50] hm i think we dit alot more than that with just 10 people [20:50] yep think so [20:50] can believe that [20:50] midas: you mean like yahoo videos? [20:50] that was over a weekend or something crazy? [20:50] nah different site [20:50] we did a site in a couple or hours [20:51] midas Smiley: I'll give you some update information tomorrow on how the crawl is going [20:51] running 150 concurrent [20:51] and if I can get 30 to 40 crawlers ot work [20:51] + grabs [20:51] cool :) [20:51] :) [20:51] ok [20:51] brb [20:51] if you can do 30-40, we have people who can do 10000's [20:52] ah yes, i remember, it was ptch.com [20:52] was done in 4 hours or so? [20:54] * Defaulting /etc/host.conf:multi to on [20:54] * In order to use glibc with USE=-suid, you must make sure that [20:54] * you have devpts mounted at /dev/pts with the gid=5 option. [20:54] midas: hmm [20:54] whoops [20:54] maybe a little more then 4 hours... [20:55] nah, Kenshin unloaded the shitload of machines on ptch [20:55] maybe it took 5 hours, not that much more [20:55] ey [20:56] where has Kenshin been lately? [20:56] 30,000 accounts/hour is not difficult for the Warrior [20:56] we did more than that on wretch [20:57] arkiver: I suspect you're under-selling why the Warrior does what it does [20:57] that or you haven't fully understood wit [20:58] https://archive.org/details/gamemagazines [20:58] it has begun [21:03] SketchCow: if you are putting rpg and bard games in there... https://archive.org/details/general_magazine https://archive.org/details/ares_magazine and https://archive.org/details/space-gamer [21:06] This would be a bad time to start with that. [21:06] But I will tap you later for this. [21:07] roger [21:21] https://archive.org/details/computermagazines now has nothing but computer magazines. [21:21] https://archive.org/details/gamemagazines now has game magazines. [21:21] There are still about 100 magazines left to shove into one or another. [21:21] I am not convinced this is 100% the best use of my time but it is very good to get it done. [21:24] SketchCow: Amiga Power is a games magazine (it was exclusively games, whereas Amiga Shopper was only non-games and Amiga Format was general) [21:24] also, thank you -- I can now point my students at the games section :) [21:31] Yeah, I still have a bunch of move around. [21:31] And many more to add, over 100 like I said. [21:32] Then we can rope back and find more. For example, I haven't looked at magazines uploaded by others. [21:53] yipdw: I would like to write a script for the warrior, but I don't know how... :( [21:53] maybe someone (chfoo) can do that) [21:54] but ok [21:54] gotta sleep everyone [21:54] will keep pc on downloading [21:54] and see you all tomorrow!! :D [21:56] arkiver: read the existing scripts, check out the Dev/* pages on archiveteam.org [21:56] it's crazy to expect a small group of people to write warrior scripts for everything [22:01] ah I understand I'm sorry yipdw [22:01] I'll take a look at it tomorrow! [22:01] :D [22:01] hope I will understand how it works [22:01] and maybe I can great one! :D [22:15] * ersi removes arkiver's enter key [22:15] * ersi modifies it so it won't bounce around so much [22:16] * ersi puts it back on arkiver's keyboard [23:45] * HotSwap wires a 555 onto ersi's enter key running at 1hz