#newsgrabber 2017-12-26,Tue

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
Kazmy disco seems to be running
or not, it's waiting for jobs
[00:00]
HCross2Mine are still screwed
Igloo: can you check yours when you get a sec please?
[00:08]
jrwrHCross2: with that, no new WARCs have hit IA [00:20]
HCross2Gaaa [00:21]
jrwrAlso I need to setup proper, battle hardened IRC bots [00:21]
HCross2jrwr: I see stuff on there from yesterday [00:22]
jrwrI want to configure some eggdrops [00:22]
HCross2It's the 26th now here
Can you see https://catalogd.archive.org/history/archiveteam_newssites_20171225202651
[00:22]
jrwrOOPS
broke my IA API keys
here they come
its updating the database now
[00:23]
HCross2Thanks [00:25]
jrwrThanks for checking [00:25]
HCross2jrwr: bunnycdn turned off the fancy dashboard [00:25]
jrwroh?
did we break it
[00:25]
HCross2We didn't. But it broke Dejan's home internet as it's not fast enough for 20k request/sec [00:26]
jrwrwait what
that doesn't make sense
home internet !== 20k request/sec
[00:26]
HCross2The live feed of URLs being hit was over 15Mbps [00:27]
jrwrhahah [00:29]
HCross2It still makes my Vega 64 sit at 30% [00:30]
jrwrlol
I would like to see a Distributed hash table
we should move to that
[00:30]
HCross2We tried that [00:31]
jrwrI'm pretty sure it can keep up if every warrior has the client [00:31]
HCross2I've still got a couple of nodes [00:31]
jrwrDid we, Ya we was doing some testing, our has insert rate is still somewhat insane
hash*
[00:32]
HCross2Yeah [00:32]
jrwrSo
The backend is not too bad overall
maybe we could revist using the CDN ontop of IA
I love hosting the bird, but freshest data is best
[00:33]
HCross2Hm.. that is a good thought
Using the CDN to take the strain away
[00:36]
jrwrYa
hows the cost HCross
we are up a good bit
[00:36]
HCross2I turned off the most expensive zones [00:36]
jrwrthats good
you could about pile it onto the cheapest
[00:37]
HCross2it's not bad https://usercontent.irccloud-cdn.com/file/zPyoSyEw/Screenshot_20171226-003802.jpg [00:38]
jrwrout of all his clients I best this is the most active [00:42]
Kazuh
hm
ia keys, jrwr ?
[00:44]
jrwrIA S3 API keys [00:45]
Kazi think your keys are on all the vidme uploaders [00:45]
jrwrthey where
:)
[00:45]
HCross2jrwr: he's got porn/ad sites doing tons more [00:45]
Kazeh, looks things still work actually [00:45]
jrwrlol
I heard that as well
porn ads are big business
like you would think this podunk porn websites wouldn't get THAT much traffic
[00:45]
HCross2jrwr: https://bunnycdn.com/solutions/adult-content-delivery
You know the best thing...
[00:48]
jrwr? [00:49]
HCross2His wife does all the artwork [00:50]
jrwrits not bad
I though it was all stock icons
bet they are 10x cheaper then cloudfront
[00:50]
HCross2Definitely
It's all M24Seven.. who aren't amazing
[00:53]
jrwrlol [00:53]
I would still like to get a rsync box like FOS but a beefcake [01:01]
..... (idle for 21mn)
HCross2: https://www.archiveteam.org/index.php?title=User:Jrwr
I documented a little on what I did with the wiki
[01:22]
Kazhey look, it loads [01:25]
jrwrI fixed it
all by my self
on the oldest cpanel/linux/apache install every
fucking PHP5.3!
I had to do some black magic to get apache to see the 7.2.0 static binary I had
I don't think its very secure cig-bin wise I think
when I get into work, ill throw nessus at it
and see how it fairs
[01:31]
***tar-xvf has joined #newsgrabber
odemg_ has quit IRC (Read error: Operation timed out)
[01:39]
........................................................................................ (idle for 7h16mn)
odemg_ has joined #newsgrabber
tar-xvf has quit IRC (Read error: Operation timed out)
[08:59]
........... (idle for 52mn)
HCross2jrwr: I had a thought... I wonder how the IA are doing load balancing on the API [09:54]
Igloo: Can you give your discos a look over when you get a second please? Something happened on master yesterday which seems to have killed them [09:59]
..... (idle for 22mn)
***kimmer12 has joined #newsgrabber [10:21]
kimmer1 has quit IRC (Read error: Operation timed out) [10:27]
...... (idle for 25mn)
kimmer1 has joined #newsgrabber
kimmer13 has joined #newsgrabber
[10:52]
kimmer12 has quit IRC (Ping timeout: 633 seconds)
kimmer12 has joined #newsgrabber
kimmer1 has quit IRC (Ping timeout: 633 seconds)
kimmer13 has quit IRC (Ping timeout: 633 seconds)
[11:00]
kimmer1 has joined #newsgrabber
kimmer12 has quit IRC (Ping timeout: 633 seconds)
[11:16]
....... (idle for 32mn)
kimmer12 has joined #newsgrabber
kimmer1 has quit IRC (Ping timeout: 633 seconds)
kimmer1 has joined #newsgrabber
kimmer13 has joined #newsgrabber
kimmer12 has quit IRC (Ping timeout: 633 seconds)
BnAboyZ has quit IRC (Quit: The Lounge - https://thelounge.github.io)
[11:51]
IglooFixed HCross2 [12:06]
***kimmer1 has quit IRC (Ping timeout: 633 seconds) [12:06]
kimmer13 has quit IRC (Ping timeout: 633 seconds)
BnAboyZ has joined #newsgrabber
[12:11]
kimmer1 has joined #newsgrabber [12:18]
...... (idle for 28mn)
kimmer1 has quit IRC (Ping timeout: 633 seconds) [12:46]
kimmer1 has joined #newsgrabber [12:51]
kimmer12 has joined #newsgrabber
kimmer1 has quit IRC (Ping timeout: 632 seconds)
kimmer1 has joined #newsgrabber
kimmer12 has quit IRC (Read error: Operation timed out)
[12:59]
............ (idle for 58mn)
kimmer12 has joined #newsgrabber [14:04]
kimmer1 has quit IRC (Ping timeout: 633 seconds) [14:10]
kimmer1 has joined #newsgrabber [14:19]
kimmer13 has joined #newsgrabber
kimmer12 has quit IRC (Ping timeout: 633 seconds)
kimmer1 has quit IRC (Ping timeout: 633 seconds)
[14:24]
..... (idle for 22mn)
kimmer13 has quit IRC (Ping timeout: 633 seconds)
kimmer1 has joined #newsgrabber
[14:52]
kimmer12 has joined #newsgrabber [14:59]
kimmer1 has quit IRC (Ping timeout: 633 seconds)
kimmer1 has joined #newsgrabber
[15:05]
kimmer12 has quit IRC (Read error: Operation timed out) [15:15]
...... (idle for 27mn)
kimmer1 has quit IRC (Ping timeout: 633 seconds) [15:42]
kimmer1 has joined #newsgrabber [15:52]
........ (idle for 38mn)
kimmer12 has joined #newsgrabber [16:30]
kimmer1 has quit IRC (Ping timeout: 633 seconds) [16:36]
..... (idle for 21mn)
kimmer1 has joined #newsgrabber [16:57]
kimmer12 has quit IRC (Ping timeout: 633 seconds) [17:03]
...... (idle for 26mn)
kimmer12 has joined #newsgrabber [17:29]
kimmer13 has joined #newsgrabber
kimmer1 has quit IRC (Ping timeout: 633 seconds)
kimmer12 has quit IRC (Read error: Operation timed out)
[17:34]
.... (idle for 15mn)
kimmer1 has joined #newsgrabber [17:53]
kimmer13 has quit IRC (Ping timeout: 633 seconds) [18:02]
Kaz sets mode: +b kimmer*!*@*
kimmer1 was kicked by Kaz (fix your connection)
[18:10]
........... (idle for 50mn)
blitzed has joined #newsgrabber
blitzed has quit IRC (Remote host closed the connection)
blitzed has joined #newsgrabber
[19:00]
............................. (idle for 2h24mn)
dd0a13f37 has joined #newsgrabber [21:25]
.................. (idle for 1h25mn)
blitzed has quit IRC (Remote host closed the connection) [22:50]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)