#archiveteam-bs 2017-11-23,Thu

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***dashcloud has quit IRC (Remote host closed the connection) [00:04]
........ (idle for 35mn)
arkivercodeplex is starting soon
anyone has an idea for a channel name?
[00:39]
***j08nY has quit IRC (Quit: Leaving) [00:41]
JAASweet! I don't, but I'd be interested in learning how to set up projects. There are some other good candidates, e.g. CompuServe and the Wine.Woot forums. And it'd be good to distribute this knowledge in general. [00:42]
arkiverYes [00:45]
JAAThe coding part shouldn't be too difficult. What I'm mostly unsure about is testing. Is there a way to throw a particular item at the pipeline.py script and have it execute everything exactly how it would if it received that item from the tracker? [00:52]
.... (idle for 17mn)
***Mateon1 has quit IRC (Read error: Operation timed out) [01:09]
arkiverLet's go over creating a project soon [01:09]
***Mateon1 has joined #archiveteam-bs [01:09]
...... (idle for 27mn)
DrasticAcFor codeplex, is that going to be saving the website, or does that include all of the project downloads and repositories too?
The source code for projects, with its history, is probably more useful than just the site itself.
[01:36]
***pizzaiolo has quit IRC (Remote host closed the connection) [01:41]
......... (idle for 40mn)
username1 has joined #archiveteam-bs
schbirid2 has quit IRC (Read error: Operation timed out)
[02:21]
arkiverDrasticAc: the plan is to get all
codeplex will also create an archive like Google Code Archive after the shutdown
plan is to get codeplex before the shutdown and the codeplex archive after the shutdown too
[02:27]
hook54321godane: I'm assuming it's not possible to use the Easystore drives internally, correct? [02:28]
DrasticAcAhh, cool [02:28]
hook54321Anyone know if IA employees have this week off? [02:28]
godanethe one with the power brick you can use internally i think
people have to talking about taking the drives out of there cases and putting them in computers
or at least there is talk of them see if its red drives or not
[02:33]
........... (idle for 50mn)
astridhook54321: yes. everyone in the US with a desk job has the weekend off. [03:24]
***Soni has quit IRC (Ping timeout: 264 seconds) [03:35]
...... (idle for 25mn)
Soni has joined #archiveteam-bs
Pixi` has joined #archiveteam-bs
fie has quit IRC (Ping timeout: 633 seconds)
Pixi has quit IRC (Ping timeout: 255 seconds)
Pixi` has quit IRC (Client Quit)
fie has joined #archiveteam-bs
[04:00]
godaneso i'm starting to upload more rush limbaugh radio show for 2007
what i got for 2005 and 2006 is all uploaded
[04:10]
***Pixi has joined #archiveteam-bs [04:12]
..... (idle for 20mn)
fie has quit IRC (Ping timeout: 633 seconds)
Asparagir has joined #archiveteam-bs
svchfoo1 sets mode: +o Asparagir
qw3rty115 has joined #archiveteam-bs
[04:32]
qw3rty114 has quit IRC (Ping timeout: 600 seconds) [04:42]
fie has joined #archiveteam-bs [04:52]
..... (idle for 22mn)
ranav has quit IRC (Read error: Connection reset by peer)
ranav has joined #archiveteam-bs
RichardG has quit IRC (Read error: Connection reset by peer)
[05:14]
...... (idle for 28mn)
dcmorton has quit IRC (Quit: ZNC - http://znc.in) [05:43]
dcmorton has joined #archiveteam-bs [05:49]
...... (idle for 28mn)
Asparag-1 has joined #archiveteam-bs
Asparag-1 has quit IRC (Client Quit)
Asparagir has quit IRC (Read error: Operation timed out)
[06:17]
...... (idle for 26mn)
Asparagir has joined #archiveteam-bs
svchfoo1 sets mode: +o Asparagir
[06:46]
........ (idle for 36mn)
Asparagir has quit IRC (Asparagir) [07:23]
w0rp_ has joined #archiveteam-bs
w0rp has quit IRC (Ping timeout: 248 seconds)
w0rp_ is now known as w0rp
[07:31]
.... (idle for 15mn)
w0rp_ has joined #archiveteam-bs
w0rp has quit IRC (Read error: Operation timed out)
w0rp_ is now known as w0rp
[07:47]
............ (idle for 59mn)
Darkstar has quit IRC (Ping timeout: 1212 seconds) [08:50]
Darkstar has joined #archiveteam-bs [09:01]
LordNigh2 has joined #archiveteam-bs
Lord_Nigh has quit IRC (Ping timeout: 250 seconds)
LordNigh2 is now known as Lord_Nigh
[09:10]
........... (idle for 50mn)
fie has quit IRC (Ping timeout: 248 seconds) [10:01]
fie has joined #archiveteam-bs [10:14]
icedice has joined #archiveteam-bs [10:23]
..... (idle for 24mn)
j08nY has joined #archiveteam-bs [10:47]
j08nY has quit IRC (Read error: Operation timed out)
Sk2d has joined #archiveteam-bs
pizzaiolo has joined #archiveteam-bs
Sk1d has quit IRC (se.hub irc.du.se)
Boppen has quit IRC (se.hub irc.du.se)
antomati_ has joined #archiveteam-bs
swebb sets mode: +o antomati_
antomatic has quit IRC (Read error: Operation timed out)
[10:54]
Sk2d is now known as Sk1d [11:18]
.... (idle for 19mn)
RichardG has joined #archiveteam-bs [11:37]
.............. (idle for 1h6mn)
Lord_Nigh has quit IRC (Ping timeout: 248 seconds) [12:43]
Lord_Nigh has joined #archiveteam-bs [12:51]
BlueMaxim has quit IRC (Quit: Leaving)
j08nY has joined #archiveteam-bs
[13:04]
.... (idle for 16mn)
hook54321godane: Does it matter if I buy the NESN or NEBB model? [13:22]
***Darkstar has quit IRC (Ping timeout: 247 seconds)
icedice has quit IRC (Quit: Leaving)
[13:22]
Darkstar has joined #archiveteam-bs [13:28]
Dimtree has quit IRC (Max SendQ exceeded)
Dimtree has joined #archiveteam-bs
[13:34]
...... (idle for 28mn)
j08nY has quit IRC (Remote host closed the connection) [14:06]
.......... (idle for 45mn)
RichardG_ has joined #archiveteam-bs
RichardG has quit IRC (Ping timeout: 250 seconds)
fie has quit IRC (Ping timeout: 633 seconds)
[14:51]
fie has joined #archiveteam-bs [15:01]
.... (idle for 19mn)
RichardG_ is now known as RichardG [15:20]
Darkstar has quit IRC (Remote host closed the connection) [15:34]
...... (idle for 28mn)
Darkstar has joined #archiveteam-bs [16:02]
.......... (idle for 49mn)
fie_ has joined #archiveteam-bs [16:51]
fie has quit IRC (Ping timeout: 600 seconds) [16:57]
.............. (idle for 1h9mn)
JAAWhoa. I just came across MassDNS... "Without special configuration, MassDNS is capable of resolving over 100,000,000 domains per hour with a Gigabit ethernet link using publicly available resolvers." [18:06]
Smiley27kilohertz
27,000 /sec
is that different domains, or the same one that many times?
[18:13]
***odemg has quit IRC (Ping timeout: 245 seconds) [18:19]
odemg has joined #archiveteam-bs [18:32]
....... (idle for 32mn)
DrasticAcLooking through that Miiverse archive Nintendo sent me now.
I need verification that it only includes posts, but no replies.
All of the post data is in JSON, and looking at the source I think it just loadings everything at startup into memory, which must suck if you have tens of thousands of posts.
It's going to load all that into memory.
[19:04]
I’m parsing our warcs right now. We should have access to more data than what Nintendo is sending in their archives. I should be able to replicate their archive with more data. [19:19]
***Asparagir has joined #archiveteam-bs
svchfoo1 sets mode: +o Asparagir
[19:25]
........ (idle for 37mn)
JAASmiley: I don't think it matters. It uses almost 1000 open recursive resolvers. [20:02]
***uberushax has joined #archiveteam-bs [20:09]
uberushaxIs Warrior tracker down?
Oop. there it goes it seems.
[20:09]
***jschwart has joined #archiveteam-bs [20:15]
j08nY has joined #archiveteam-bs [20:23]
......... (idle for 40mn)
uberushaxwindow 4 [21:03]
................ (idle for 1h18mn)
***jschwart has quit IRC (Konversation terminated!) [22:21]
uberushax has quit IRC (Quit: leaving) [22:33]
ola_norsk has joined #archiveteam-bs [22:41]
ola_norskHi. Any advice on how to quicly mv/delete files that are duplicates from an older item i've done?
e.g i have two items, where the one of the items i made the mistake of uploading some of the other item's files
[22:42]
JAAola_norsk: Probably easiest with the ia tool from the internetarchive Python package. [22:44]
ola_norskyeah i've been doing that with a couple of them, but is there a way to automate it? [22:44]
JAAWell, I'm sure it's possible to write a script to do so. [22:45]
ola_norskits about 3 files, per "file" :/ [22:45]
JensRexMeh. My ISP no longer has a usage monitor :/ [22:45]
ola_norskaye, i was just hoping i wouldn't have to be one that wrote that script :D [22:45]
JAAHehe [22:45]
JensRexMy newsgrabber vm has about 500 gb transfers since reboot (3 days). I wonder how much I've pushed through with newsgrabber since I started. [22:46]
JAAJensRex: Be happy about it. Others are complaining that their ISP is now monitoring/capping the traffic (mainly in the US)... ;-) [22:46]
JensRexMy ISP used to have a 2 TB soft cap a long time ago. [22:46]
ola_norskim just going to try to not let it nag the back of my head, and "get to it when i get to it" [22:47]
JAAI fortunately never had crap like that. There's a "fair use" clause somewhere deep in the ToS, but I guess that's so they can kick people who constantly use the full bandwidth and cause issues for everyone else in the network. [22:47]
Dammit, I want some of those $130 8TB drives... [22:52]
JensRexReading through their ToS, I can't find anything mentioning a data cap.
But they say they can terminate service for "port scanning".
LOL
[22:52]
ola_norsksounds like their just basing it on the speed of connection attempts..i mean, what "ports" do you get your news at? [23:02]
JAAHuh, just checked my ISP's ToS again as well, and I can't find that "fair use" clause anymore. Looks like they removed it. :-) [23:02]
ola_norsk:D
as far as i know, most news use HTTP(s) ports :D
[23:02]
JensRexI found a bullshit paragraph about violating "unwritten rules" on the internet.
Now writing flame mail.
[23:04]
ola_norska paragraph of unwritten rules.. [23:08]
***odemg has quit IRC (Read error: Operation timed out) [23:10]
ola_norski can't wait for ISP's to realize ONCE AGAIN, that they can't afford to be dicks to customers [23:11]
***Mateon1 has quit IRC (Ping timeout: 260 seconds)
Mateon1 has joined #archiveteam-bs
[23:12]
ola_norsk"hey, what if we throttled certain port ranges?"..then "nah, didn't work out"..now "what if we throttle by domain names and DNS requestest?.. [23:14]
***BlueMaxim has joined #archiveteam-bs [23:16]
odemg has joined #archiveteam-bs [23:25]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)