#newsgrabber 2018-03-31,Sat

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
***arkiver has quit IRC (Read error: Operation timed out)
arkiver has joined #newsgrabber
[03:22]
qw3rty114 has joined #newsgrabber
tar-xvf has joined #newsgrabber
odemg_ has quit IRC (Read error: Operation timed out)
qw3rty113 has quit IRC (Read error: Operation timed out)
[03:32]
............................................... (idle for 3h54mn)
phirephlyjrwr, I'm experimenting with directing the dedupe request through squid, where it does matter [07:33]
...................................................................................................... (idle for 8h28mn)
jrwrGenerally the Dedupe requests are good for about 24 hours [16:01]
.......... (idle for 49mn)
***tar-xvf has quit IRC (Quit: Leaving) [16:50]
...................................... (idle for 3h6mn)
Atom has quit IRC (Read error: Operation timed out)
Igloo_ has joined #newsgrabber
phirephly has quit IRC (Read error: Operation timed out)
Igloo has quit IRC (Ping timeout: 360 seconds)
phirephly has joined #newsgrabber
MrRadar has quit IRC (Remote host closed the connection)
dxrt has quit IRC (Ping timeout: 360 seconds)
arkiver has quit IRC (Read error: Operation timed out)
luckcolor has quit IRC (Ping timeout: 360 seconds)
arkiver has joined #newsgrabber
svchost02 sets mode: +ov arkiver arkiver
svchost01 sets mode: +ov arkiver arkiver
luckcolor has joined #newsgrabber
[19:56]
luckcolor has quit IRC (Read error: Connection reset by peer)
luckcolor has joined #newsgrabber
dxrt has joined #newsgrabber
MrRadar has joined #newsgrabber
[20:09]
....... (idle for 34mn)
arkiverI have something new ready for testing soon
it's basically a decentralized web archiving program
We already have the warrior and archivebot, however those still have the problems that some jobs can very large and not easy to split up in items
This will be a network of servers, some with specific purposes like archving, managing or deduplication, that will share and manage URLs that are archived and discovered
multiple backups are kept of what is being archived and if one of the servers goes down the other server will continue with where it left off
[20:48]
........... (idle for 51mn)
Kazoh, nice
lmk if you need some testingf
[21:44]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)