#archiveteam 2014-11-04,Tue

↑back Search

Time Nickname Message
00:31 🔗 db48x SketchCow: you mean composing a sprite sheet, and the style rules to match?
00:32 🔗 SketchCow Yes
00:33 🔗 db48x that's relatively easy, and easy to automate (presumably it needs to update when the list of available arcade machines is updated)
00:35 🔗 joepie91 [00:19] <xmc> we just temporarily misplace it
00:36 🔗 joepie91 temporarily misplaced, for a duration that may or may not exceed the lifespan of the known universe
00:36 🔗 joepie91 :)
01:45 🔗 joepie91 twitlonger being archived yet?
05:05 🔗 yipdw is there someone destroying fos' rsync or something
05:06 🔗 Elegance yipdw: #yolohalo is
05:06 🔗 Elegance It's on it's last breath
05:06 🔗 yipdw I'm turning that down, it's disrupting other projects
05:07 🔗 yipdw actually I don't think it's halo
05:07 🔗 yipdw that's at 100 req/min
05:08 🔗 Elegance We're probably seeing the side effects of that then
05:08 🔗 Elegance All my workers are halted waiting for rsync to FOS
05:08 🔗 Kenshin yipdw: it's halo likely
05:08 🔗 Kenshin they wiped 2tb in hours
05:08 🔗 yipdw that's obnoxious
05:09 🔗 Kenshin tell me about it, i was bitching already. lol
05:09 🔗 yipdw it's probably contributing to fos' 140-ish load average
05:09 🔗 Kenshin another multi-TB project
05:09 🔗 yipdw it's also blocking archivebot jobs
05:10 🔗 joepie91 Kenshin: wait, what?
05:10 🔗 Kenshin joepie91: halo, is another multi-TB project
05:11 🔗 joepie91 Kenshin: Halo?
05:11 🔗 joepie91 Bungie Halo?
05:11 🔗 trs80 I've got 5TB free if you need a target
05:12 🔗 garyrh joepie91, http://www.archiveteam.org/index.php?title=Halo
05:12 🔗 Kenshin yeah bungie halo
05:16 🔗 joepie91 how do they have so much data
05:16 🔗 joepie91 isn't it all text?
05:16 🔗 Elegance Screenshots, lots of them
05:18 🔗 joepie91 aha
05:23 🔗 yipdw also every stupid line uttered by 343 Guilty Spark
07:13 🔗 namespace If it makes you guys feel any better.
07:14 🔗 namespace I've actually used the photos from this site before in a webpage about my experience with Halo 3:
07:14 🔗 namespace softholmsyndrome.com/http://softholmsyndrome.com/2014-08-14-the-halo-mapmakers-guild.html
13:22 🔗 schbirid http://otakuworld.com/ "Also as of today, I have removed the need for subscriptions to download anything from OtakuWorld."
14:00 🔗 balrog uhm: http://techcrunch.com/2014/11/04/amazon-prime-members-newest-benefit-is-free-unlimited-photo-storage/
14:01 🔗 balrog schbirid: sounds like they're checking referers
14:01 🔗 balrog or maybe not yet
14:03 🔗 Smiley shame we can't get the halo videos
14:04 🔗 Smiley but afaik they are only accessable through games
14:05 🔗 Smiley or from those people who paid to export them to youtube.
14:30 🔗 db48x Smiley: do you have a copy of halo handy? you could sniff the traffic and see where they are hosted
14:32 🔗 Smiley they arent rendered videos afaik
14:38 🔗 Smiley nope not qany more :(
14:53 🔗 arkiver yipdw: so halo is using up all rsync connections?
15:19 🔗 arkiver I'm limiting halo
15:19 🔗 arkiver let's see if FOS connection go down
16:33 🔗 SketchCow I got a nice speedup on FOS by rewriting the "put the items into 25gb chunks" code to only check once every 500 items.
16:33 🔗 SketchCow (For ones where the average size is 1-2mb an item, like Swipnet)
16:34 🔗 SketchCow It was murdering it to check once every meg
16:42 🔗 db48x SketchCow: so how are you building the arcadeflow page?
16:45 🔗 Smiley SketchCow: hmmm can you not just have a counter counting upto 25000Mb and then run the megawarc function?
16:47 🔗 SketchCow There's multiple methods. I was just using the one alard left me, which was fine except in this edge case.
16:48 🔗 Smiley Fairy enuf :)
16:48 🔗 SketchCow The point is, it's made an enormous difference, and SWIPNET is now evacuating out MUCH faster and will be in the archive shortly.
16:48 🔗 Smiley sweeet :)
16:49 🔗 Smiley updated the github?
16:49 🔗 Smiley or maybe for this case it's not a good idea, as it is such a edge case.
16:53 🔗 SketchCow It's really just an edge case.
16:53 🔗 SketchCow We shouldn't be making my thing do this work, frankly
19:24 🔗 SadDM SketchCow: when you have a moment, can you please move the following items into the Archive Team collection: comeback_inn_forums-20140326, metamorphosisalpha.net_forums-20141022, starfrontiers.info_forum-20140324, pathfinderchronicler.net_grabs, fraternity_of_shadows_forum-20140325
19:48 🔗 SketchCow done. Going through me here is hit or miss, as others will tell you.
19:49 🔗 SketchCow In the future, I may just give you a subcollection to shove these all in yourself.
20:00 🔗 SadDM I don't do a lot of web items, so it's not really an issue. That said, I'd be happy to have a subcollection to throw them in.
20:01 🔗 SketchCow We'll see. This is, like, the easiest thing in the world and you guys have to wait for me to be available/in the mood
20:03 🔗 SadDM Pfft... I figure as long as they're up on archive.org, that's the main thing. If they eventually get into the wayback... that's even better.
20:03 🔗 SadDM besides, you've got bigger fish to fry :-)
20:04 🔗 SadDM maybe we should make a wiki page that's a queue of stuff for you to move. Then we can get it off of our plates, and you can deal with it at your leisure.
20:30 🔗 Smiley or give me access to do it D:
20:30 🔗 Smiley I guess that kinda access is an employee only thing

irclogger-viewer