#archiveteam-bs 2017-11-23,Thu

↑back Search

Time Nickname Message
00:04 🔗 dashcloud has quit IRC (Remote host closed the connection)
00:39 🔗 arkiver codeplex is starting soon
00:39 🔗 arkiver anyone has an idea for a channel name?
00:41 🔗 j08nY has quit IRC (Quit: Leaving)
00:42 🔗 JAA Sweet! I don't, but I'd be interested in learning how to set up projects. There are some other good candidates, e.g. CompuServe and the Wine.Woot forums. And it'd be good to distribute this knowledge in general.
00:45 🔗 arkiver Yes
00:52 🔗 JAA The coding part shouldn't be too difficult. What I'm mostly unsure about is testing. Is there a way to throw a particular item at the pipeline.py script and have it execute everything exactly how it would if it received that item from the tracker?
01:09 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
01:09 🔗 arkiver Let's go over creating a project soon
01:09 🔗 Mateon1 has joined #archiveteam-bs
01:36 🔗 DrasticAc For codeplex, is that going to be saving the website, or does that include all of the project downloads and repositories too?
01:38 🔗 DrasticAc The source code for projects, with its history, is probably more useful than just the site itself.
01:41 🔗 pizzaiolo has quit IRC (Remote host closed the connection)
02:21 🔗 username1 has joined #archiveteam-bs
02:25 🔗 schbirid2 has quit IRC (Read error: Operation timed out)
02:27 🔗 arkiver DrasticAc: the plan is to get all
02:28 🔗 arkiver codeplex will also create an archive like Google Code Archive after the shutdown
02:28 🔗 arkiver plan is to get codeplex before the shutdown and the codeplex archive after the shutdown too
02:28 🔗 hook54321 godane: I'm assuming it's not possible to use the Easystore drives internally, correct?
02:28 🔗 DrasticAc Ahh, cool
02:28 🔗 hook54321 Anyone know if IA employees have this week off?
02:33 🔗 godane the one with the power brick you can use internally i think
02:33 🔗 godane people have to talking about taking the drives out of there cases and putting them in computers
02:34 🔗 godane or at least there is talk of them see if its red drives or not
03:24 🔗 astrid hook54321: yes. everyone in the US with a desk job has the weekend off.
03:35 🔗 Soni has quit IRC (Ping timeout: 264 seconds)
04:00 🔗 Soni has joined #archiveteam-bs
04:03 🔗 Pixi` has joined #archiveteam-bs
04:04 🔗 fie has quit IRC (Ping timeout: 633 seconds)
04:04 🔗 Pixi has quit IRC (Ping timeout: 255 seconds)
04:05 🔗 Pixi` has quit IRC (Client Quit)
04:09 🔗 fie has joined #archiveteam-bs
04:10 🔗 godane so i'm starting to upload more rush limbaugh radio show for 2007
04:10 🔗 godane what i got for 2005 and 2006 is all uploaded
04:12 🔗 Pixi has joined #archiveteam-bs
04:32 🔗 fie has quit IRC (Ping timeout: 633 seconds)
04:34 🔗 Asparagir has joined #archiveteam-bs
04:34 🔗 svchfoo1 sets mode: +o Asparagir
04:37 🔗 qw3rty115 has joined #archiveteam-bs
04:42 🔗 qw3rty114 has quit IRC (Ping timeout: 600 seconds)
04:52 🔗 fie has joined #archiveteam-bs
05:14 🔗 ranav has quit IRC (Read error: Connection reset by peer)
05:14 🔗 ranav has joined #archiveteam-bs
05:15 🔗 RichardG has quit IRC (Read error: Connection reset by peer)
05:43 🔗 dcmorton has quit IRC (Quit: ZNC - http://znc.in)
05:49 🔗 dcmorton has joined #archiveteam-bs
06:17 🔗 Asparag-1 has joined #archiveteam-bs
06:18 🔗 Asparag-1 has quit IRC (Client Quit)
06:20 🔗 Asparagir has quit IRC (Read error: Operation timed out)
06:46 🔗 Asparagir has joined #archiveteam-bs
06:47 🔗 svchfoo1 sets mode: +o Asparagir
07:23 🔗 Asparagir has quit IRC (Asparagir)
07:31 🔗 w0rp_ has joined #archiveteam-bs
07:32 🔗 w0rp has quit IRC (Ping timeout: 248 seconds)
07:32 🔗 w0rp_ is now known as w0rp
07:47 🔗 w0rp_ has joined #archiveteam-bs
07:51 🔗 w0rp has quit IRC (Read error: Operation timed out)
07:51 🔗 w0rp_ is now known as w0rp
08:50 🔗 Darkstar has quit IRC (Ping timeout: 1212 seconds)
09:01 🔗 Darkstar has joined #archiveteam-bs
09:10 🔗 LordNigh2 has joined #archiveteam-bs
09:11 🔗 Lord_Nigh has quit IRC (Ping timeout: 250 seconds)
09:11 🔗 LordNigh2 is now known as Lord_Nigh
10:01 🔗 fie has quit IRC (Ping timeout: 248 seconds)
10:14 🔗 fie has joined #archiveteam-bs
10:23 🔗 icedice has joined #archiveteam-bs
10:47 🔗 j08nY has joined #archiveteam-bs
10:54 🔗 j08nY has quit IRC (Read error: Operation timed out)
10:56 🔗 Sk2d has joined #archiveteam-bs
10:59 🔗 pizzaiolo has joined #archiveteam-bs
11:03 🔗 Sk1d has quit IRC (se.hub irc.du.se)
11:03 🔗 Boppen has quit IRC (se.hub irc.du.se)
11:05 🔗 antomati_ has joined #archiveteam-bs
11:06 🔗 swebb sets mode: +o antomati_
11:07 🔗 antomatic has quit IRC (Read error: Operation timed out)
11:18 🔗 Sk2d is now known as Sk1d
11:37 🔗 RichardG has joined #archiveteam-bs
12:43 🔗 Lord_Nigh has quit IRC (Ping timeout: 248 seconds)
12:51 🔗 Lord_Nigh has joined #archiveteam-bs
13:04 🔗 BlueMaxim has quit IRC (Quit: Leaving)
13:06 🔗 j08nY has joined #archiveteam-bs
13:22 🔗 hook54321 godane: Does it matter if I buy the NESN or NEBB model?
13:22 🔗 Darkstar has quit IRC (Ping timeout: 247 seconds)
13:22 🔗 icedice has quit IRC (Quit: Leaving)
13:28 🔗 Darkstar has joined #archiveteam-bs
13:34 🔗 Dimtree has quit IRC (Max SendQ exceeded)
13:38 🔗 Dimtree has joined #archiveteam-bs
14:06 🔗 j08nY has quit IRC (Remote host closed the connection)
14:51 🔗 RichardG_ has joined #archiveteam-bs
14:52 🔗 RichardG has quit IRC (Ping timeout: 250 seconds)
14:55 🔗 fie has quit IRC (Ping timeout: 633 seconds)
15:01 🔗 fie has joined #archiveteam-bs
15:20 🔗 RichardG_ is now known as RichardG
15:34 🔗 Darkstar has quit IRC (Remote host closed the connection)
16:02 🔗 Darkstar has joined #archiveteam-bs
16:51 🔗 fie_ has joined #archiveteam-bs
16:57 🔗 fie has quit IRC (Ping timeout: 600 seconds)
18:06 🔗 JAA Whoa. I just came across MassDNS... "Without special configuration, MassDNS is capable of resolving over 100,000,000 domains per hour with a Gigabit ethernet link using publicly available resolvers."
18:13 🔗 Smiley 27kilohertz
18:13 🔗 Smiley 27,000 /sec
18:13 🔗 Smiley is that different domains, or the same one that many times?
18:19 🔗 odemg has quit IRC (Ping timeout: 245 seconds)
18:32 🔗 odemg has joined #archiveteam-bs
19:04 🔗 DrasticAc Looking through that Miiverse archive Nintendo sent me now.
19:04 🔗 DrasticAc I need verification that it only includes posts, but no replies.
19:07 🔗 DrasticAc All of the post data is in JSON, and looking at the source I think it just loadings everything at startup into memory, which must suck if you have tens of thousands of posts.
19:07 🔗 DrasticAc It's going to load all that into memory.
19:19 🔗 DrasticAc I’m parsing our warcs right now. We should have access to more data than what Nintendo is sending in their archives. I should be able to replicate their archive with more data.
19:25 🔗 Asparagir has joined #archiveteam-bs
19:25 🔗 svchfoo1 sets mode: +o Asparagir
20:02 🔗 JAA Smiley: I don't think it matters. It uses almost 1000 open recursive resolvers.
20:09 🔗 uberushax has joined #archiveteam-bs
20:09 🔗 uberushax Is Warrior tracker down?
20:10 🔗 uberushax Oop. there it goes it seems.
20:15 🔗 jschwart has joined #archiveteam-bs
20:23 🔗 j08nY has joined #archiveteam-bs
21:03 🔗 uberushax window 4
22:21 🔗 jschwart has quit IRC (Konversation terminated!)
22:33 🔗 uberushax has quit IRC (Quit: leaving)
22:41 🔗 ola_norsk has joined #archiveteam-bs
22:42 🔗 ola_norsk Hi. Any advice on how to quicly mv/delete files that are duplicates from an older item i've done?
22:43 🔗 ola_norsk e.g i have two items, where the one of the items i made the mistake of uploading some of the other item's files
22:44 🔗 JAA ola_norsk: Probably easiest with the ia tool from the internetarchive Python package.
22:44 🔗 ola_norsk yeah i've been doing that with a couple of them, but is there a way to automate it?
22:45 🔗 JAA Well, I'm sure it's possible to write a script to do so.
22:45 🔗 ola_norsk its about 3 files, per "file" :/
22:45 🔗 JensRex Meh. My ISP no longer has a usage monitor :/
22:45 🔗 ola_norsk aye, i was just hoping i wouldn't have to be one that wrote that script :D
22:45 🔗 JAA Hehe
22:46 🔗 JensRex My newsgrabber vm has about 500 gb transfers since reboot (3 days). I wonder how much I've pushed through with newsgrabber since I started.
22:46 🔗 JAA JensRex: Be happy about it. Others are complaining that their ISP is now monitoring/capping the traffic (mainly in the US)... ;-)
22:46 🔗 JensRex My ISP used to have a 2 TB soft cap a long time ago.
22:47 🔗 ola_norsk im just going to try to not let it nag the back of my head, and "get to it when i get to it"
22:47 🔗 JAA I fortunately never had crap like that. There's a "fair use" clause somewhere deep in the ToS, but I guess that's so they can kick people who constantly use the full bandwidth and cause issues for everyone else in the network.
22:52 🔗 JAA Dammit, I want some of those $130 8TB drives...
22:52 🔗 JensRex Reading through their ToS, I can't find anything mentioning a data cap.
22:53 🔗 JensRex But they say they can terminate service for "port scanning".
22:53 🔗 JensRex LOL
23:02 🔗 ola_norsk sounds like their just basing it on the speed of connection attempts..i mean, what "ports" do you get your news at?
23:02 🔗 JAA Huh, just checked my ISP's ToS again as well, and I can't find that "fair use" clause anymore. Looks like they removed it. :-)
23:02 🔗 ola_norsk :D
23:03 🔗 ola_norsk as far as i know, most news use HTTP(s) ports :D
23:04 🔗 JensRex I found a bullshit paragraph about violating "unwritten rules" on the internet.
23:04 🔗 JensRex Now writing flame mail.
23:08 🔗 ola_norsk a paragraph of unwritten rules..
23:10 🔗 odemg has quit IRC (Read error: Operation timed out)
23:11 🔗 ola_norsk i can't wait for ISP's to realize ONCE AGAIN, that they can't afford to be dicks to customers
23:12 🔗 Mateon1 has quit IRC (Ping timeout: 260 seconds)
23:12 🔗 Mateon1 has joined #archiveteam-bs
23:14 🔗 ola_norsk "hey, what if we throttled certain port ranges?"..then "nah, didn't work out"..now "what if we throttle by domain names and DNS requestest?..
23:16 🔗 BlueMaxim has joined #archiveteam-bs
23:25 🔗 odemg has joined #archiveteam-bs

irclogger-viewer