Time |
Nickname |
Message |
00:15
🔗
|
|
DigiDigi has quit IRC (Remote host closed the connection) |
00:24
🔗
|
|
DigiDigi has joined #archiveteam-ot |
00:30
🔗
|
|
Stilettoo has joined #archiveteam-ot |
00:36
🔗
|
|
Stiletto has quit IRC (Read error: Operation timed out) |
00:49
🔗
|
|
Dj-Wawa has quit IRC (Quit: Connection closed for inactivity) |
01:51
🔗
|
JAA |
kiska: I discovered another bug in transfer.sh. Can we test a fix on your instance so I can file a PR instead of an issue? |
02:31
🔗
|
Kaz |
<kiska> Ok HE link is 40G, |
02:31
🔗
|
Kaz |
hate to say I told you so, but... |
02:35
🔗
|
|
Anthony1 has joined #archiveteam-ot |
04:04
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
04:43
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
04:44
🔗
|
|
wp494 has quit IRC (Quit: LOUD UNNECESSARY QUIT MESSAGES) |
04:47
🔗
|
|
dhyan_nat has joined #archiveteam-ot |
04:55
🔗
|
|
systwi has quit IRC (Read error: Operation timed out) |
04:58
🔗
|
|
wp494 has joined #archiveteam-ot |
05:28
🔗
|
|
BlueMax has joined #archiveteam-ot |
06:22
🔗
|
|
asdf0101 has quit IRC (Read error: Operation timed out) |
06:22
🔗
|
|
markedL has quit IRC (Read error: Operation timed out) |
06:26
🔗
|
Fusl |
i told you so |
06:26
🔗
|
Fusl |
there, i did it |
06:38
🔗
|
|
Anthony1 has quit IRC (Ping timeout: 260 seconds) |
06:41
🔗
|
kiska |
JAA: sure |
07:26
🔗
|
|
Raccoon has joined #archiveteam-ot |
07:47
🔗
|
|
godane has quit IRC (Read error: Connection reset by peer) |
07:50
🔗
|
|
godane has joined #archiveteam-ot |
09:36
🔗
|
|
systwi has joined #archiveteam-ot |
12:04
🔗
|
|
Raccoon has quit IRC (Ping timeout: 615 seconds) |
12:53
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
13:49
🔗
|
anarcat |
https://www.nytimes.com/2019/06/10/opinion/hacking-phone-privacy.html |
13:53
🔗
|
JAA |
kiska: s/QueryEscape/PathEscape/ in server/handlers.go |
13:58
🔗
|
|
wp494 has quit IRC (Read error: Operation timed out) |
14:01
🔗
|
|
wp494 has joined #archiveteam-ot |
14:09
🔗
|
kiska |
JAA: Everywhere that occurs? Sure |
14:09
🔗
|
kiska |
Modification running |
14:13
🔗
|
JAA |
The two places, yeah. |
14:13
🔗
|
kiska |
JAA: Your modification has been compiled and is now running |
14:13
🔗
|
JAA |
Cheers |
14:15
🔗
|
JAA |
PUT seems to be working, now to figure out how to test POST. |
14:18
🔗
|
JAA |
Yup, that works as well. I'll create the PR shortly. |
14:18
🔗
|
JAA |
The problem was that spaces in filenames were encoded as + instead of %20. |
14:20
🔗
|
JAA |
Also, POST uploads don't return deletion URLs. |
14:37
🔗
|
JAA |
And here's the PR: https://github.com/dutchcoders/transfer.sh/pull/236 |
14:45
🔗
|
anarcat |
it's like the WARC fiel format is designed for long term archival and fidelity, but then it's actually hard to extract content from there |
14:45
🔗
|
anarcat |
and we basically need other tools to do "real" crawls that generate static websites |
14:45
🔗
|
anarcat |
there must be a better way |
14:47
🔗
|
JAA |
wget/wpull with --convert-links and some other options should in principle do this. I just have no idea how well it works. |
14:49
🔗
|
anarcat |
fairly badly, in general :p |
14:50
🔗
|
anarcat |
but the point is you can't do that on an existing WARC file |
14:50
🔗
|
anarcat |
you need to recrawl the site |
14:50
🔗
|
anarcat |
see what i mean? |
14:51
🔗
|
JAA |
Yeah |
14:51
🔗
|
anarcat |
tell ya |
14:51
🔗
|
anarcat |
annoying. |
14:51
🔗
|
JAA |
It should be possible to write a tool for this using wpull's API. |
14:51
🔗
|
anarcat |
:) |
14:51
🔗
|
anarcat |
oh interesting |
14:51
🔗
|
anarcat |
i'm still iffy on wpull |
14:52
🔗
|
JAA |
wpull is iffy, too. :-) |
14:52
🔗
|
anarcat |
it seems like a movable target |
14:53
🔗
|
anarcat |
i barely mentioned it in my short review here https://anarc.at/blog/2018-10-04-archiving-web-sites/ |
14:53
🔗
|
anarcat |
focusing on wget for runs without WARC and crawl for WARC runs |
14:53
🔗
|
Igloo |
wpull sometimes forgets it's wpull |
14:53
🔗
|
JAA |
It needs a lot of work, and I'd love to spend more time on it, but this isn't my job, so... |
14:53
🔗
|
anarcat |
because crawl is so much simpler |
14:53
🔗
|
anarcat |
yeah |
14:53
🔗
|
Igloo |
and self checks into the insanity hospital. |
15:30
🔗
|
|
tuluu_ has quit IRC (Quit: No Ping reply in 180 seconds.) |
15:32
🔗
|
|
tuluu has joined #archiveteam-ot |
15:37
🔗
|
|
VerifiedJ has joined #archiveteam-ot |
15:52
🔗
|
|
Dj-Wawa has joined #archiveteam-ot |
16:04
🔗
|
|
Hani111 has joined #archiveteam-ot |
16:06
🔗
|
|
Hani111_ has joined #archiveteam-ot |
16:13
🔗
|
|
Hani has quit IRC (Ping timeout: 615 seconds) |
16:13
🔗
|
|
Hani111_ is now known as Hani |
16:15
🔗
|
|
Hani111 has quit IRC (Ping timeout: 615 seconds) |
16:40
🔗
|
|
dhyan_nat has quit IRC (Read error: Operation timed out) |
18:26
🔗
|
|
ranma has quit IRC (Ping timeout: 252 seconds) |
18:37
🔗
|
|
ranma has joined #archiveteam-ot |
18:57
🔗
|
|
VerifiedJ has quit IRC (Quit: Leaving) |
18:58
🔗
|
|
dhyan_nat has joined #archiveteam-ot |
19:16
🔗
|
|
dhyan_nat has quit IRC (Read error: Operation timed out) |
19:34
🔗
|
|
systwi_ has joined #archiveteam-ot |
19:42
🔗
|
|
systwi has quit IRC (Ping timeout: 600 seconds) |
19:48
🔗
|
|
systwi has joined #archiveteam-ot |
19:56
🔗
|
|
systwi_ has quit IRC (Ping timeout: 600 seconds) |
20:03
🔗
|
|
dhyan_nat has joined #archiveteam-ot |
20:08
🔗
|
|
Fusl has quit IRC (Quit: K-Lined) |
20:10
🔗
|
|
Fusl has joined #archiveteam-ot |
20:10
🔗
|
|
svchfoo3 sets mode: +o Fusl |
20:52
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
20:53
🔗
|
|
cfarquhar has joined #archiveteam-ot |
21:52
🔗
|
|
dhyan_nat has quit IRC (Read error: Operation timed out) |
22:54
🔗
|
|
icedice has joined #archiveteam-ot |
23:08
🔗
|
Flashfire |
School is already tracking my usage closely blocking a site just after I access it |
23:09
🔗
|
|
icedice2 has joined #archiveteam-ot |
23:15
🔗
|
|
icedice has quit IRC (Read error: Operation timed out) |
23:19
🔗
|
|
thuban has joined #archiveteam-ot |
23:31
🔗
|
|
Anthony1 has joined #archiveteam-ot |
23:39
🔗
|
|
icedice2 has quit IRC (Quit: Leaving) |
23:40
🔗
|
|
icedice has joined #archiveteam-ot |
23:40
🔗
|
|
benjinsmi has joined #archiveteam-ot |
23:42
🔗
|
|
benjins has quit IRC (Ping timeout: 252 seconds) |
23:43
🔗
|
|
Odd0002_ has joined #archiveteam-ot |
23:43
🔗
|
|
yano_ has joined #archiveteam-ot |
23:46
🔗
|
|
eythian_ has joined #archiveteam-ot |
23:46
🔗
|
|
Igloo_ has joined #archiveteam-ot |
23:47
🔗
|
|
betamax_ has joined #archiveteam-ot |
23:48
🔗
|
|
eientei9- has joined #archiveteam-ot |
23:48
🔗
|
|
tuluu_ has joined #archiveteam-ot |
23:49
🔗
|
|
bztoot has joined #archiveteam-ot |
23:50
🔗
|
|
phuz has joined #archiveteam-ot |
23:50
🔗
|
|
synm0nger has joined #archiveteam-ot |
23:50
🔗
|
|
nightpoo- has joined #archiveteam-ot |
23:50
🔗
|
anarcat |
https://www.nytimes.com/2019/06/11/magazine/universal-fire-master-recordings.html |
23:50
🔗
|
|
gandalf_ has joined #archiveteam-ot |
23:50
🔗
|
|
Jon^ has joined #archiveteam-ot |
23:50
🔗
|
|
Arkiver2 has joined #archiveteam-ot |
23:50
🔗
|
|
Fusl sets mode: +o Arkiver2 |
23:51
🔗
|
|
abstract^ has joined #archiveteam-ot |
23:51
🔗
|
|
Polylith_ has joined #archiveteam-ot |
23:52
🔗
|
|
joepie91 has joined #archiveteam-ot |
23:54
🔗
|
|
nyaomin has joined #archiveteam-ot |
23:57
🔗
|
|
Hani has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Dj-Wawa has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
tuluu has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
terorie has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
apache2 has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Odd0002 has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Jens has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
eythian has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
acridAxid has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Sanqui has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
kode54 has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Dimtree has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
nyaomi has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Igloo has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
yano has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
nightpool has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
GLaDOS has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
mr_archiv has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
eientei95 has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
phiresky has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
hook54321 has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Ctrl-S_ has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
ephemer0l has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
jeekl has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
xit_2 has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
horkermon has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
diggan has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
deathy has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
DrasticAc has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
xit has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
pnJay has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
MarcoS has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Verelic has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
revi has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
jmtd has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
smelly_ has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
phuzion has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
betamax has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
SynMonger has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
gandalf has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Polylith has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
N4Y has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
t2t2 has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
AlsoJAA has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
atbk has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
abstract has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Vito` has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
rellem has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Meroje has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Flashier has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
mgrytbak has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
HCross has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
amelia386 has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
joepie91_ has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
arkiver has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
kpcyrd has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Hecatz has quit IRC (se.hub efnet.port80.se) |
23:57
🔗
|
|
Muad-Dib has quit IRC (se.hub efnet.port80.se) |
23:58
🔗
|
|
N4Y_ has joined #archiveteam-ot |