| Time |
Nickname |
Message |
|
01:23
🔗
|
|
powerkitt has joined #archiveteam-ot |
|
01:50
🔗
|
|
icedice has quit IRC (Leaving) |
|
02:19
🔗
|
|
DogsRNice has quit IRC (Read error: Connection reset by peer) |
|
02:44
🔗
|
|
dashcloud has quit IRC (http://quassel-irc.org - Chat comfortably. Anywhere.) |
|
02:51
🔗
|
|
joepie91 has quit IRC (Read error: Operation timed out) |
|
02:51
🔗
|
|
Frogging has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
JAA has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
Frogging has joined #archiveteam-ot |
|
02:52
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
chungone has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
anarcat has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
chungone has joined #archiveteam-ot |
|
02:52
🔗
|
|
asdf0101 has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
markedL has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
fuzzy8021 has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
ats has quit IRC (Read error: Operation timed out) |
|
02:52
🔗
|
|
ats has joined #archiveteam-ot |
|
02:53
🔗
|
|
betamax_ has quit IRC (Read error: Operation timed out) |
|
02:53
🔗
|
|
jodizzle has quit IRC (Read error: Operation timed out) |
|
02:53
🔗
|
|
Fionera_ has quit IRC (Read error: Operation timed out) |
|
02:53
🔗
|
|
betamax has joined #archiveteam-ot |
|
02:53
🔗
|
|
jodizzle has joined #archiveteam-ot |
|
02:53
🔗
|
|
lunik1 has quit IRC (Read error: Operation timed out) |
|
02:53
🔗
|
|
simon816 has quit IRC (Ping timeout: 246 seconds) |
|
02:53
🔗
|
|
Fionera has joined #archiveteam-ot |
|
02:54
🔗
|
|
terry has quit IRC (Ping timeout: 246 seconds) |
|
02:54
🔗
|
|
swebb has quit IRC (Read error: Operation timed out) |
|
02:54
🔗
|
|
godane has quit IRC (Ping timeout: 246 seconds) |
|
02:55
🔗
|
|
swebb has joined #archiveteam-ot |
|
02:55
🔗
|
|
fuzzy8021 has joined #archiveteam-ot |
|
02:55
🔗
|
|
joepie91 has joined #archiveteam-ot |
|
02:55
🔗
|
|
Mateon1 has quit IRC (Read error: Operation timed out) |
|
02:56
🔗
|
|
Mateon1 has joined #archiveteam-ot |
|
02:57
🔗
|
|
wp494 has quit IRC (Ping timeout: 492 seconds) |
|
02:57
🔗
|
|
wp494 has joined #archiveteam-ot |
|
02:57
🔗
|
|
dashcloud has joined #archiveteam-ot |
|
03:07
🔗
|
|
anarcat has joined #archiveteam-ot |
|
03:10
🔗
|
|
godane has joined #archiveteam-ot |
|
03:23
🔗
|
|
terry has joined #archiveteam-ot |
|
03:47
🔗
|
|
odemg has quit IRC (Ping timeout: 265 seconds) |
|
03:53
🔗
|
|
simon816 has joined #archiveteam-ot |
|
03:54
🔗
|
|
cfarquhar has joined #archiveteam-ot |
|
03:54
🔗
|
|
lunik1 has joined #archiveteam-ot |
|
03:54
🔗
|
|
markedL has joined #archiveteam-ot |
|
03:54
🔗
|
|
asdf0101 has joined #archiveteam-ot |
|
03:56
🔗
|
|
JAA has joined #archiveteam-ot |
|
03:56
🔗
|
|
Fusl sets mode: +o JAA |
|
03:57
🔗
|
|
AlsoJAA sets mode: +o JAA |
|
03:59
🔗
|
|
powerkitt has quit IRC (Quit: WeeChat 2.2) |
|
03:59
🔗
|
|
odemg has joined #archiveteam-ot |
|
05:31
🔗
|
|
svchfoo3 has left |
|
05:31
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
05:32
🔗
|
|
cfarquhar has joined #archiveteam-ot |
|
05:39
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
05:42
🔗
|
|
cfarquhar has joined #archiveteam-ot |
|
05:58
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
05:58
🔗
|
|
cfarquhar has joined #archiveteam-ot |
|
06:53
🔗
|
|
nataraj has joined #archiveteam-ot |
|
07:03
🔗
|
|
benjins has quit IRC (Read error: Connection reset by peer) |
|
08:10
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
08:25
🔗
|
|
killsushi has quit IRC (Read error: Connection reset by peer) |
|
08:26
🔗
|
|
killsushi has joined #archiveteam-ot |
|
09:22
🔗
|
|
ColdIce has quit IRC (Remote host closed the connection) |
|
09:23
🔗
|
|
ColdIce has joined #archiveteam-ot |
|
09:25
🔗
|
Ctrl-S_ |
Regarding WARC and usability as a browable site: Could we just grab whatever logic that does the conversion from a raw site into a locally-browsable one (i.e. whatever wget or HTTrack etc. uses) and just swap it's input so it can eat WARC files and produce the same output it would if it was doing a real crawl? |
|
09:42
🔗
|
|
benjins has joined #archiveteam-ot |
|
11:20
🔗
|
|
benjins has quit IRC (Remote host closed the connection) |
|
11:22
🔗
|
|
dxrt- has joined #archiveteam-ot |
|
11:23
🔗
|
|
Flashfire has quit IRC (Ping timeout: 252 seconds) |
|
11:23
🔗
|
|
dxrt has quit IRC (Ping timeout: 252 seconds) |
|
11:23
🔗
|
|
dxrt- is now known as dxrt |
|
11:24
🔗
|
|
benjins has joined #archiveteam-ot |
|
11:24
🔗
|
|
dxrt_ sets mode: +o dxrt |
|
11:25
🔗
|
|
coderobe has quit IRC (Quit: Ping timeout (120 seconds)) |
|
11:25
🔗
|
|
jut has quit IRC (Ping timeout: 252 seconds) |
|
11:25
🔗
|
|
kiska has quit IRC (Read error: Connection reset by peer) |
|
11:26
🔗
|
|
ColdIce has quit IRC (Quit: Ping timeout (120 seconds)) |
|
11:28
🔗
|
|
coderobe has joined #archiveteam-ot |
|
11:29
🔗
|
|
ColdIce has joined #archiveteam-ot |
|
11:29
🔗
|
|
kiska has joined #archiveteam-ot |
|
11:30
🔗
|
|
jut has joined #archiveteam-ot |
|
11:30
🔗
|
|
Flashfire has joined #archiveteam-ot |
|
11:55
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
11:57
🔗
|
|
cfarquhar has joined #archiveteam-ot |
|
12:42
🔗
|
|
VerifiedJ has joined #archiveteam-ot |
|
12:44
🔗
|
JAA |
Ctrl-S_: Yes, that's exactly what I was hinting at with "using wpull's API". The relevant methods for link conversion should be public. Then you just need to shove the WARC contents (reading e.g. with warcio) into it. |
|
12:50
🔗
|
kiska |
lol I found this in my newsgrabber warrior: https://it-it.facebook.com/images/ufi/reactions/v7_DO_NOT_USE_DIRECTLY/20x20/anger.png |
|
12:50
🔗
|
kiska |
I wonder what else might be hiding in that folder\ |
|
12:51
🔗
|
JAA |
I like https://static.xx.fbcdn.net/rsrc.php/v3iu1j4/yy/l/de_DE/AdsImageUploaderDEPRECATED.js as well. |
|
12:51
🔗
|
kiska |
Hrm.... xD |
|
12:52
🔗
|
JAA |
Those DO_NOT_USE_DIRECTLY URLs started appearing in late May, by the way. |
|
12:52
🔗
|
kiska |
Wait... only recently :( |
|
12:52
🔗
|
JAA |
Yep |
|
12:52
🔗
|
JAA |
Well, at least I hadn't seen them before. |
|
12:53
🔗
|
kiska |
Another thing to block |
|
14:12
🔗
|
|
icedice has joined #archiveteam-ot |
|
15:12
🔗
|
|
Odd0002 has quit IRC (Read error: Operation timed out) |
|
15:14
🔗
|
|
Odd0002 has joined #archiveteam-ot |
|
15:56
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
|
16:01
🔗
|
|
phuz is now known as phuzion |
|
16:58
🔗
|
|
VoynichCr has left |
|
18:25
🔗
|
|
nyany has quit IRC (Excess Flood) |
|
18:25
🔗
|
|
nyany has joined #archiveteam-ot |
|
18:28
🔗
|
|
VerifiedJ has quit IRC (Remote host closed the connection) |
|
18:28
🔗
|
|
VerifiedJ has joined #archiveteam-ot |
|
19:23
🔗
|
ivan |
https://news.ycombinator.com/item?id=20205566 update your linuxes |
|
19:24
🔗
|
|
m007a83_ has joined #archiveteam-ot |
|
19:27
🔗
|
|
m007a83 has quit IRC (Ping timeout: 252 seconds) |
|
19:36
🔗
|
JAA |
Oof |
|
19:38
🔗
|
JAA |
I don't know enough about TCP, what's the impact of disabling SACK or rejecting connections with small MSS sizes, the two workarounds suggested in https://access.redhat.com/security/vulnerabilities/tcpsack ? |
|
19:46
🔗
|
JAA |
(Impact on say an ArchiveBot pipeline which can't be rebooted for weeks to months) |
|
20:44
🔗
|
|
svchfoo1 has joined #archiveteam-ot |
|
20:44
🔗
|
|
Fusl sets mode: +o svchfoo1 |
|
20:44
🔗
|
|
svchfoo3 has joined #archiveteam-ot |
|
20:44
🔗
|
|
Fusl sets mode: +o svchfoo3 |
|
20:50
🔗
|
JAA |
So svchfoo* disappeared from everywhere again. :-/ |
|
20:51
🔗
|
kiska |
:( |
|
20:51
🔗
|
|
JAA sets mode: +o kiska |
|
20:57
🔗
|
|
VerifiedJ has quit IRC (Quit: Leaving) |
|
21:49
🔗
|
|
ivan- has joined #archiveteam-ot |
|
21:49
🔗
|
|
Fusl sets mode: +o ivan- |
|
21:51
🔗
|
|
ivan has quit IRC (Read error: Operation timed out) |
|
21:54
🔗
|
|
nataraj has quit IRC (Read error: Connection reset by peer) |
|
21:55
🔗
|
|
nataraj has joined #archiveteam-ot |
|
22:00
🔗
|
|
nataraj has quit IRC (Read error: Operation timed out) |
|
22:01
🔗
|
|
nataraj has joined #archiveteam-ot |
|
22:04
🔗
|
|
erin has quit IRC (Quit: WeeChat 2.3) |
|
22:26
🔗
|
|
ColdIce has quit IRC (Remote host closed the connection) |
|
22:26
🔗
|
|
ColdIce has joined #archiveteam-ot |
|
22:41
🔗
|
|
kode54 has quit IRC (Quit: The Lounge - https://thelounge.chat) |
|
23:08
🔗
|
|
BlueMax has joined #archiveteam-ot |
|
23:09
🔗
|
|
nataraj has quit IRC (Read error: Operation timed out) |
|
23:19
🔗
|
|
kode54 has joined #archiveteam-ot |
|
23:29
🔗
|
|
Odd0002 has quit IRC (Ping timeout: 252 seconds) |
|
23:30
🔗
|
|
Odd0002 has joined #archiveteam-ot |
|
23:48
🔗
|
|
asdf0101 has quit IRC (The Lounge - https://thelounge.chat) |
|
23:48
🔗
|
|
markedL has quit IRC (The Lounge - https://thelounge.chat) |
|
23:57
🔗
|
|
icedice has quit IRC (Ping timeout: 600 seconds) |