[00:15] *** DigiDigi has quit IRC (Remote host closed the connection) [00:24] *** DigiDigi has joined #archiveteam-ot [00:30] *** Stilettoo has joined #archiveteam-ot [00:36] *** Stiletto has quit IRC (Read error: Operation timed out) [00:49] *** Dj-Wawa has quit IRC (Quit: Connection closed for inactivity) [01:51] kiska: I discovered another bug in transfer.sh. Can we test a fix on your instance so I can file a PR instead of an issue? [02:31] Ok HE link is 40G, [02:31] hate to say I told you so, but... [02:35] *** Anthony1 has joined #archiveteam-ot [04:04] *** killsushi has quit IRC (Quit: Leaving) [04:43] *** BlueMax has quit IRC (Quit: Leaving) [04:44] *** wp494 has quit IRC (Quit: LOUD UNNECESSARY QUIT MESSAGES) [04:47] *** dhyan_nat has joined #archiveteam-ot [04:55] *** systwi has quit IRC (Read error: Operation timed out) [04:58] *** wp494 has joined #archiveteam-ot [05:28] *** BlueMax has joined #archiveteam-ot [06:22] *** asdf0101 has quit IRC (Read error: Operation timed out) [06:22] *** markedL has quit IRC (Read error: Operation timed out) [06:26] i told you so [06:26] there, i did it [06:38] *** Anthony1 has quit IRC (Ping timeout: 260 seconds) [06:41] JAA: sure [07:26] *** Raccoon has joined #archiveteam-ot [07:47] *** godane has quit IRC (Read error: Connection reset by peer) [07:50] *** godane has joined #archiveteam-ot [09:36] *** systwi has joined #archiveteam-ot [12:04] *** Raccoon has quit IRC (Ping timeout: 615 seconds) [12:53] *** BlueMax has quit IRC (Quit: Leaving) [13:49] https://www.nytimes.com/2019/06/10/opinion/hacking-phone-privacy.html [13:53] kiska: s/QueryEscape/PathEscape/ in server/handlers.go [13:58] *** wp494 has quit IRC (Read error: Operation timed out) [14:01] *** wp494 has joined #archiveteam-ot [14:09] JAA: Everywhere that occurs? Sure [14:09] Modification running [14:13] The two places, yeah. [14:13] JAA: Your modification has been compiled and is now running [14:13] Cheers [14:15] PUT seems to be working, now to figure out how to test POST. [14:18] Yup, that works as well. I'll create the PR shortly. [14:18] The problem was that spaces in filenames were encoded as + instead of %20. [14:20] Also, POST uploads don't return deletion URLs. [14:37] And here's the PR: https://github.com/dutchcoders/transfer.sh/pull/236 [14:45] it's like the WARC fiel format is designed for long term archival and fidelity, but then it's actually hard to extract content from there [14:45] and we basically need other tools to do "real" crawls that generate static websites [14:45] there must be a better way [14:47] wget/wpull with --convert-links and some other options should in principle do this. I just have no idea how well it works. [14:49] fairly badly, in general :p [14:50] but the point is you can't do that on an existing WARC file [14:50] you need to recrawl the site [14:50] see what i mean? [14:51] Yeah [14:51] tell ya [14:51] annoying. [14:51] It should be possible to write a tool for this using wpull's API. [14:51] :) [14:51] oh interesting [14:51] i'm still iffy on wpull [14:52] wpull is iffy, too. :-) [14:52] it seems like a movable target [14:53] i barely mentioned it in my short review here https://anarc.at/blog/2018-10-04-archiving-web-sites/ [14:53] focusing on wget for runs without WARC and crawl for WARC runs [14:53] wpull sometimes forgets it's wpull [14:53] It needs a lot of work, and I'd love to spend more time on it, but this isn't my job, so... [14:53] because crawl is so much simpler [14:53] yeah [14:53] and self checks into the insanity hospital. [15:30] *** tuluu_ has quit IRC (Quit: No Ping reply in 180 seconds.) [15:32] *** tuluu has joined #archiveteam-ot [15:37] *** VerifiedJ has joined #archiveteam-ot [15:52] *** Dj-Wawa has joined #archiveteam-ot [16:04] *** Hani111 has joined #archiveteam-ot [16:06] *** Hani111_ has joined #archiveteam-ot [16:13] *** Hani has quit IRC (Ping timeout: 615 seconds) [16:13] *** Hani111_ is now known as Hani [16:15] *** Hani111 has quit IRC (Ping timeout: 615 seconds) [16:40] *** dhyan_nat has quit IRC (Read error: Operation timed out) [18:26] *** ranma has quit IRC (Ping timeout: 252 seconds) [18:37] *** ranma has joined #archiveteam-ot [18:57] *** VerifiedJ has quit IRC (Quit: Leaving) [18:58] *** dhyan_nat has joined #archiveteam-ot [19:16] *** dhyan_nat has quit IRC (Read error: Operation timed out) [19:34] *** systwi_ has joined #archiveteam-ot [19:42] *** systwi has quit IRC (Ping timeout: 600 seconds) [19:48] *** systwi has joined #archiveteam-ot [19:56] *** systwi_ has quit IRC (Ping timeout: 600 seconds) [20:03] *** dhyan_nat has joined #archiveteam-ot [20:08] *** Fusl has quit IRC (Quit: K-Lined) [20:10] *** Fusl has joined #archiveteam-ot [20:10] *** svchfoo3 sets mode: +o Fusl [20:52] *** cfarquhar has quit IRC (Read error: Operation timed out) [20:53] *** cfarquhar has joined #archiveteam-ot [21:52] *** dhyan_nat has quit IRC (Read error: Operation timed out) [22:54] *** icedice has joined #archiveteam-ot [23:08] School is already tracking my usage closely blocking a site just after I access it [23:09] *** icedice2 has joined #archiveteam-ot [23:15] *** icedice has quit IRC (Read error: Operation timed out) [23:19] *** thuban has joined #archiveteam-ot [23:31] *** Anthony1 has joined #archiveteam-ot [23:39] *** icedice2 has quit IRC (Quit: Leaving) [23:40] *** icedice has joined #archiveteam-ot [23:40] *** benjinsmi has joined #archiveteam-ot [23:42] *** benjins has quit IRC (Ping timeout: 252 seconds) [23:43] *** Odd0002_ has joined #archiveteam-ot [23:43] *** yano_ has joined #archiveteam-ot [23:46] *** eythian_ has joined #archiveteam-ot [23:46] *** Igloo_ has joined #archiveteam-ot [23:47] *** betamax_ has joined #archiveteam-ot [23:48] *** eientei9- has joined #archiveteam-ot [23:48] *** tuluu_ has joined #archiveteam-ot [23:49] *** bztoot has joined #archiveteam-ot [23:50] *** phuz has joined #archiveteam-ot [23:50] *** synm0nger has joined #archiveteam-ot [23:50] *** nightpoo- has joined #archiveteam-ot [23:50] https://www.nytimes.com/2019/06/11/magazine/universal-fire-master-recordings.html [23:50] *** gandalf_ has joined #archiveteam-ot [23:50] *** Jon^ has joined #archiveteam-ot [23:50] *** Arkiver2 has joined #archiveteam-ot [23:50] *** Fusl sets mode: +o Arkiver2 [23:51] *** abstract^ has joined #archiveteam-ot [23:51] *** Polylith_ has joined #archiveteam-ot [23:52] *** joepie91 has joined #archiveteam-ot [23:54] *** nyaomin has joined #archiveteam-ot [23:57] *** Hani has quit IRC (se.hub efnet.port80.se) [23:57] *** Dj-Wawa has quit IRC (se.hub efnet.port80.se) [23:57] *** tuluu has quit IRC (se.hub efnet.port80.se) [23:57] *** terorie has quit IRC (se.hub efnet.port80.se) [23:57] *** apache2 has quit IRC (se.hub efnet.port80.se) [23:57] *** Odd0002 has quit IRC (se.hub efnet.port80.se) [23:57] *** Jens has quit IRC (se.hub efnet.port80.se) [23:57] *** eythian has quit IRC (se.hub efnet.port80.se) [23:57] *** acridAxid has quit IRC (se.hub efnet.port80.se) [23:57] *** Sanqui has quit IRC (se.hub efnet.port80.se) [23:57] *** kode54 has quit IRC (se.hub efnet.port80.se) [23:57] *** Dimtree has quit IRC (se.hub efnet.port80.se) [23:57] *** nyaomi has quit IRC (se.hub efnet.port80.se) [23:57] *** Igloo has quit IRC (se.hub efnet.port80.se) [23:57] *** yano has quit IRC (se.hub efnet.port80.se) [23:57] *** nightpool has quit IRC (se.hub efnet.port80.se) [23:57] *** GLaDOS has quit IRC (se.hub efnet.port80.se) [23:57] *** mr_archiv has quit IRC (se.hub efnet.port80.se) [23:57] *** eientei95 has quit IRC (se.hub efnet.port80.se) [23:57] *** phiresky has quit IRC (se.hub efnet.port80.se) [23:57] *** hook54321 has quit IRC (se.hub efnet.port80.se) [23:57] *** Ctrl-S_ has quit IRC (se.hub efnet.port80.se) [23:57] *** ephemer0l has quit IRC (se.hub efnet.port80.se) [23:57] *** jeekl has quit IRC (se.hub efnet.port80.se) [23:57] *** xit_2 has quit IRC (se.hub efnet.port80.se) [23:57] *** horkermon has quit IRC (se.hub efnet.port80.se) [23:57] *** diggan has quit IRC (se.hub efnet.port80.se) [23:57] *** deathy has quit IRC (se.hub efnet.port80.se) [23:57] *** DrasticAc has quit IRC (se.hub efnet.port80.se) [23:57] *** xit has quit IRC (se.hub efnet.port80.se) [23:57] *** pnJay has quit IRC (se.hub efnet.port80.se) [23:57] *** MarcoS has quit IRC (se.hub efnet.port80.se) [23:57] *** Verelic has quit IRC (se.hub efnet.port80.se) [23:57] *** revi has quit IRC (se.hub efnet.port80.se) [23:57] *** jmtd has quit IRC (se.hub efnet.port80.se) [23:57] *** smelly_ has quit IRC (se.hub efnet.port80.se) [23:57] *** phuzion has quit IRC (se.hub efnet.port80.se) [23:57] *** betamax has quit IRC (se.hub efnet.port80.se) [23:57] *** SynMonger has quit IRC (se.hub efnet.port80.se) [23:57] *** gandalf has quit IRC (se.hub efnet.port80.se) [23:57] *** Polylith has quit IRC (se.hub efnet.port80.se) [23:57] *** N4Y has quit IRC (se.hub efnet.port80.se) [23:57] *** t2t2 has quit IRC (se.hub efnet.port80.se) [23:57] *** AlsoJAA has quit IRC (se.hub efnet.port80.se) [23:57] *** atbk has quit IRC (se.hub efnet.port80.se) [23:57] *** abstract has quit IRC (se.hub efnet.port80.se) [23:57] *** Vito` has quit IRC (se.hub efnet.port80.se) [23:57] *** rellem has quit IRC (se.hub efnet.port80.se) [23:57] *** Meroje has quit IRC (se.hub efnet.port80.se) [23:57] *** Flashier has quit IRC (se.hub efnet.port80.se) [23:57] *** mgrytbak has quit IRC (se.hub efnet.port80.se) [23:57] *** HCross has quit IRC (se.hub efnet.port80.se) [23:57] *** amelia386 has quit IRC (se.hub efnet.port80.se) [23:57] *** joepie91_ has quit IRC (se.hub efnet.port80.se) [23:57] *** arkiver has quit IRC (se.hub efnet.port80.se) [23:57] *** kpcyrd has quit IRC (se.hub efnet.port80.se) [23:57] *** Hecatz has quit IRC (se.hub efnet.port80.se) [23:57] *** Muad-Dib has quit IRC (se.hub efnet.port80.se) [23:58] *** N4Y_ has joined #archiveteam-ot