[00:04] *** dashcloud has quit IRC (Remote host closed the connection) [00:39] codeplex is starting soon [00:39] anyone has an idea for a channel name? [00:41] *** j08nY has quit IRC (Quit: Leaving) [00:42] Sweet! I don't, but I'd be interested in learning how to set up projects. There are some other good candidates, e.g. CompuServe and the Wine.Woot forums. And it'd be good to distribute this knowledge in general. [00:45] Yes [00:52] The coding part shouldn't be too difficult. What I'm mostly unsure about is testing. Is there a way to throw a particular item at the pipeline.py script and have it execute everything exactly how it would if it received that item from the tracker? [01:09] *** Mateon1 has quit IRC (Read error: Operation timed out) [01:09] Let's go over creating a project soon [01:09] *** Mateon1 has joined #archiveteam-bs [01:36] For codeplex, is that going to be saving the website, or does that include all of the project downloads and repositories too? [01:38] The source code for projects, with its history, is probably more useful than just the site itself. [01:41] *** pizzaiolo has quit IRC (Remote host closed the connection) [02:21] *** username1 has joined #archiveteam-bs [02:25] *** schbirid2 has quit IRC (Read error: Operation timed out) [02:27] DrasticAc: the plan is to get all [02:28] codeplex will also create an archive like Google Code Archive after the shutdown [02:28] plan is to get codeplex before the shutdown and the codeplex archive after the shutdown too [02:28] godane: I'm assuming it's not possible to use the Easystore drives internally, correct? [02:28] Ahh, cool [02:28] Anyone know if IA employees have this week off? [02:33] the one with the power brick you can use internally i think [02:33] people have to talking about taking the drives out of there cases and putting them in computers [02:34] or at least there is talk of them see if its red drives or not [03:24] hook54321: yes. everyone in the US with a desk job has the weekend off. [03:35] *** Soni has quit IRC (Ping timeout: 264 seconds) [04:00] *** Soni has joined #archiveteam-bs [04:03] *** Pixi` has joined #archiveteam-bs [04:04] *** fie has quit IRC (Ping timeout: 633 seconds) [04:04] *** Pixi has quit IRC (Ping timeout: 255 seconds) [04:05] *** Pixi` has quit IRC (Client Quit) [04:09] *** fie has joined #archiveteam-bs [04:10] so i'm starting to upload more rush limbaugh radio show for 2007 [04:10] what i got for 2005 and 2006 is all uploaded [04:12] *** Pixi has joined #archiveteam-bs [04:32] *** fie has quit IRC (Ping timeout: 633 seconds) [04:34] *** Asparagir has joined #archiveteam-bs [04:34] *** svchfoo1 sets mode: +o Asparagir [04:37] *** qw3rty115 has joined #archiveteam-bs [04:42] *** qw3rty114 has quit IRC (Ping timeout: 600 seconds) [04:52] *** fie has joined #archiveteam-bs [05:14] *** ranav has quit IRC (Read error: Connection reset by peer) [05:14] *** ranav has joined #archiveteam-bs [05:15] *** RichardG has quit IRC (Read error: Connection reset by peer) [05:43] *** dcmorton has quit IRC (Quit: ZNC - http://znc.in) [05:49] *** dcmorton has joined #archiveteam-bs [06:17] *** Asparag-1 has joined #archiveteam-bs [06:18] *** Asparag-1 has quit IRC (Client Quit) [06:20] *** Asparagir has quit IRC (Read error: Operation timed out) [06:46] *** Asparagir has joined #archiveteam-bs [06:47] *** svchfoo1 sets mode: +o Asparagir [07:23] *** Asparagir has quit IRC (Asparagir) [07:31] *** w0rp_ has joined #archiveteam-bs [07:32] *** w0rp has quit IRC (Ping timeout: 248 seconds) [07:32] *** w0rp_ is now known as w0rp [07:47] *** w0rp_ has joined #archiveteam-bs [07:51] *** w0rp has quit IRC (Read error: Operation timed out) [07:51] *** w0rp_ is now known as w0rp [08:50] *** Darkstar has quit IRC (Ping timeout: 1212 seconds) [09:01] *** Darkstar has joined #archiveteam-bs [09:10] *** LordNigh2 has joined #archiveteam-bs [09:11] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [09:11] *** LordNigh2 is now known as Lord_Nigh [10:01] *** fie has quit IRC (Ping timeout: 248 seconds) [10:14] *** fie has joined #archiveteam-bs [10:23] *** icedice has joined #archiveteam-bs [10:47] *** j08nY has joined #archiveteam-bs [10:54] *** j08nY has quit IRC (Read error: Operation timed out) [10:56] *** Sk2d has joined #archiveteam-bs [10:59] *** pizzaiolo has joined #archiveteam-bs [11:03] *** Sk1d has quit IRC (se.hub irc.du.se) [11:03] *** Boppen has quit IRC (se.hub irc.du.se) [11:05] *** antomati_ has joined #archiveteam-bs [11:06] *** swebb sets mode: +o antomati_ [11:07] *** antomatic has quit IRC (Read error: Operation timed out) [11:18] *** Sk2d is now known as Sk1d [11:37] *** RichardG has joined #archiveteam-bs [12:43] *** Lord_Nigh has quit IRC (Ping timeout: 248 seconds) [12:51] *** Lord_Nigh has joined #archiveteam-bs [13:04] *** BlueMaxim has quit IRC (Quit: Leaving) [13:06] *** j08nY has joined #archiveteam-bs [13:22] godane: Does it matter if I buy the NESN or NEBB model? [13:22] *** Darkstar has quit IRC (Ping timeout: 247 seconds) [13:22] *** icedice has quit IRC (Quit: Leaving) [13:28] *** Darkstar has joined #archiveteam-bs [13:34] *** Dimtree has quit IRC (Max SendQ exceeded) [13:38] *** Dimtree has joined #archiveteam-bs [14:06] *** j08nY has quit IRC (Remote host closed the connection) [14:51] *** RichardG_ has joined #archiveteam-bs [14:52] *** RichardG has quit IRC (Ping timeout: 250 seconds) [14:55] *** fie has quit IRC (Ping timeout: 633 seconds) [15:01] *** fie has joined #archiveteam-bs [15:20] *** RichardG_ is now known as RichardG [15:34] *** Darkstar has quit IRC (Remote host closed the connection) [16:02] *** Darkstar has joined #archiveteam-bs [16:51] *** fie_ has joined #archiveteam-bs [16:57] *** fie has quit IRC (Ping timeout: 600 seconds) [18:06] Whoa. I just came across MassDNS... "Without special configuration, MassDNS is capable of resolving over 100,000,000 domains per hour with a Gigabit ethernet link using publicly available resolvers." [18:13] 27kilohertz [18:13] 27,000 /sec [18:13] is that different domains, or the same one that many times? [18:19] *** odemg has quit IRC (Ping timeout: 245 seconds) [18:32] *** odemg has joined #archiveteam-bs [19:04] Looking through that Miiverse archive Nintendo sent me now. [19:04] I need verification that it only includes posts, but no replies. [19:07] All of the post data is in JSON, and looking at the source I think it just loadings everything at startup into memory, which must suck if you have tens of thousands of posts. [19:07] It's going to load all that into memory. [19:19] I’m parsing our warcs right now. We should have access to more data than what Nintendo is sending in their archives. I should be able to replicate their archive with more data. [19:25] *** Asparagir has joined #archiveteam-bs [19:25] *** svchfoo1 sets mode: +o Asparagir [20:02] Smiley: I don't think it matters. It uses almost 1000 open recursive resolvers. [20:09] *** uberushax has joined #archiveteam-bs [20:09] Is Warrior tracker down? [20:10] Oop. there it goes it seems. [20:15] *** jschwart has joined #archiveteam-bs [20:23] *** j08nY has joined #archiveteam-bs [21:03] window 4 [22:21] *** jschwart has quit IRC (Konversation terminated!) [22:33] *** uberushax has quit IRC (Quit: leaving) [22:41] *** ola_norsk has joined #archiveteam-bs [22:42] Hi. Any advice on how to quicly mv/delete files that are duplicates from an older item i've done? [22:43] e.g i have two items, where the one of the items i made the mistake of uploading some of the other item's files [22:44] ola_norsk: Probably easiest with the ia tool from the internetarchive Python package. [22:44] yeah i've been doing that with a couple of them, but is there a way to automate it? [22:45] Well, I'm sure it's possible to write a script to do so. [22:45] its about 3 files, per "file" :/ [22:45] Meh. My ISP no longer has a usage monitor :/ [22:45] aye, i was just hoping i wouldn't have to be one that wrote that script :D [22:45] Hehe [22:46] My newsgrabber vm has about 500 gb transfers since reboot (3 days). I wonder how much I've pushed through with newsgrabber since I started. [22:46] JensRex: Be happy about it. Others are complaining that their ISP is now monitoring/capping the traffic (mainly in the US)... ;-) [22:46] My ISP used to have a 2 TB soft cap a long time ago. [22:47] im just going to try to not let it nag the back of my head, and "get to it when i get to it" [22:47] I fortunately never had crap like that. There's a "fair use" clause somewhere deep in the ToS, but I guess that's so they can kick people who constantly use the full bandwidth and cause issues for everyone else in the network. [22:52] Dammit, I want some of those $130 8TB drives... [22:52] Reading through their ToS, I can't find anything mentioning a data cap. [22:53] But they say they can terminate service for "port scanning". [22:53] LOL [23:02] sounds like their just basing it on the speed of connection attempts..i mean, what "ports" do you get your news at? [23:02] Huh, just checked my ISP's ToS again as well, and I can't find that "fair use" clause anymore. Looks like they removed it. :-) [23:02] :D [23:03] as far as i know, most news use HTTP(s) ports :D [23:04] I found a bullshit paragraph about violating "unwritten rules" on the internet. [23:04] Now writing flame mail. [23:08] a paragraph of unwritten rules.. [23:10] *** odemg has quit IRC (Read error: Operation timed out) [23:11] i can't wait for ISP's to realize ONCE AGAIN, that they can't afford to be dicks to customers [23:12] *** Mateon1 has quit IRC (Ping timeout: 260 seconds) [23:12] *** Mateon1 has joined #archiveteam-bs [23:14] "hey, what if we throttled certain port ranges?"..then "nah, didn't work out"..now "what if we throttle by domain names and DNS requestest?.. [23:16] *** BlueMaxim has joined #archiveteam-bs [23:25] *** odemg has joined #archiveteam-bs