[00:17] *** diggan has quit IRC (Read error: Connection reset by peer) [00:18] *** picklefac has quit IRC (Read error: Connection reset by peer) [00:20] *** picklefac has joined #archiveteam-bs [00:20] *** diggan has joined #archiveteam-bs [00:20] *** Craigle has joined #archiveteam-bs [00:20] *** t3 has joined #archiveteam-bs [00:20] *** Ivy has joined #archiveteam-bs [00:24] *** horkermon has joined #archiveteam-bs [00:29] *** riking_ has joined #archiveteam-bs [00:32] *** amelia386 has joined #archiveteam-bs [00:33] *** jrwr has joined #archiveteam-bs [00:34] *** svchfoo1 sets mode: +o jrwr [00:34] *** svchfoo3 sets mode: +o jrwr [00:36] *** HCross has joined #archiveteam-bs [00:39] *** DFJustin has joined #archiveteam-bs [00:41] *** jrwr has quit IRC (Read error: Operation timed out) [00:50] *** riking_ has quit IRC (Ping timeout: 1230 seconds) [00:52] *** picklefac has quit IRC (Ping timeout: 1230 seconds) [00:52] *** diggan has quit IRC (Ping timeout: 1230 seconds) [00:53] *** Ivy has quit IRC (Ping timeout: 1230 seconds) [00:56] *** horkermon has quit IRC (Ping timeout: 1230 seconds) [01:03] *** Vito`_ has quit IRC (Read error: Connection reset by peer) [01:08] "RhythmOne is ceasing support and operation of two legacy products effective January 15, 2020: [1] Po.st Sharing Analytics (a.k.a. Social Sharing), and [2] Po.st Smart Links (a.k.a. Link Shortening)." [01:08] They also run tylt.it; don't know if that's just a different domain for the po.st shortener, or a separate product [01:09] Tylt.it is a one-product "shortening" service nominally run by a different company - looks to be unthreatened by this [01:10] *** octarine has quit IRC (Ping timeout: 1230 seconds) [01:14] *** jesse-s has quit IRC (Read error: Connection timed out) [01:17] Looks like there are 52^6 ≈ 56.8 billion possible URLs, distributed randomly as far as I can tell - not sure much can be done [01:18] *62 [01:25] *** JSharp__ has quit IRC (Read error: Connection timed out) [01:30] *** keith20 has joined #archiveteam-bs [01:31] *** keith20 has quit IRC (Client Quit) [01:31] *** BlueMax has quit IRC (Read error: Connection reset by peer) [01:32] *** BlueMax has joined #archiveteam-bs [01:33] *** keith20 has joined #archiveteam-bs [01:50] *** starlord has quit IRC (Read error: Connection reset by peer) [01:51] *** Ctrl-S_ has quit IRC (Read error: Connection reset by peer) [01:51] *** revi has quit IRC (Read error: Connection reset by peer) [01:51] *** Kaz has quit IRC (Read error: Connection reset by peer) [01:53] *** kiska has joined #archiveteam-bs [01:54] *** svchfoo1 sets mode: +o kiska [01:54] *** svchfoo3 sets mode: +o kiska [01:57] *** deathy_ has quit IRC (Ping timeout: 1230 seconds) [01:58] *** hook54321 has quit IRC (Ping timeout: 1230 seconds) [01:59] *** ThisAsYou has quit IRC (Read error: Connection reset by peer) [01:59] *** SJon has quit IRC (Read error: Connection reset by peer) [02:05] *** c0mpass has quit IRC (Read error: Connection reset by peer) [02:05] *** amelia386 has quit IRC (Read error: Connection reset by peer) [02:05] *** lenary has quit IRC (Read error: Connection reset by peer) [02:05] *** fallenoak has quit IRC (Read error: Connection reset by peer) [02:05] *** kyledrake has quit IRC (Read error: Connection reset by peer) [02:07] *** keith20 has quit IRC (byeee) [02:12] *** tchaypo has quit IRC (Read error: Connection reset by peer) [02:12] *** keith20 has joined #archiveteam-bs [02:12] *** HCross has quit IRC (Read error: Connection reset by peer) [02:12] *** t3 has quit IRC (Read error: Connection reset by peer) [02:17] *** keith20 has quit IRC (Remote host closed the connection) [02:18] *** keith20 has joined #archiveteam-bs [02:20] *** DiscantX has joined #archiveteam-bs [02:55] *** keith20 has quit IRC (byeee) [02:55] *** keith20 has joined #archiveteam-bs [02:55] *** keith20 has quit IRC (Client Quit) [02:58] *** SJon has joined #archiveteam-bs [03:02] *** SJon has quit IRC (Read error: Connection reset by peer) [03:08] *** keith20 has joined #archiveteam-bs [03:08] *** BlueMax has quit IRC (Read error: Connection reset by peer) [03:08] *** BlueMax has joined #archiveteam-bs [03:09] so what's going on with efnet vs hackint? is archiveteam "moving" or not? [03:10] I'm in both and it seems like efnet is still the most active [03:17] *** riking_ has joined #archiveteam-bs [03:21] I'm in both. I'd prefer to see all activity move to EFNet simply based on more reliable connections. JAA also likes the extra services available over there too. [03:22] *** keith20 has quit IRC (byeee) [03:22] recent projects have been spun up there instead of here [03:22] *** keith20 has joined #archiveteam-bs [03:23] more reliable connections on efnet? [03:29] *** jesse-s has joined #archiveteam-bs [03:33] *** keith20 has quit IRC (byeee) [03:34] *** keith20 has joined #archiveteam-bs [03:38] *** Stilett0 has joined #archiveteam-bs [03:39] *** nicolas17 has quit IRC (Read error: Operation timed out) [03:40] yes. some of us (me included) regularly see EFNet servers drop out, and/or netsplits happen. [03:40] *** keith20 has quit IRC (byeee) [03:41] *** keith20 has joined #archiveteam-bs [03:41] *** SJon has joined #archiveteam-bs [03:41] *** keith20 has quit IRC (Client Quit) [03:42] *** Stiletto has quit IRC (Ping timeout: 360 seconds) [03:43] *** keith20 has joined #archiveteam-bs [03:44] *** keith20 has quit IRC (Client Quit) [03:47] atphoenix: I think you typoed the wrong name [03:48] afaik, we are *gradually* moving to hackint, but rather gradually [03:49] Somebody2, oh yes, that is a typo. Move *away* from EFNet *to* hackint [03:50] that's what happens when there is a netsplit between brain and keyboard [03:51] *** SJon has quit IRC (Read error: Connection reset by peer) [03:52] :-P [03:54] *** keith20 has joined #archiveteam-bs [03:56] *** keith20 has quit IRC (Client Quit) [03:56] *** jesse-s has quit IRC (Read error: Connection timed out) [03:58] *** keith20 has joined #archiveteam-bs [04:01] *** jesse-s has joined #archiveteam-bs [04:03] *** qw3rty_ has joined #archiveteam-bs [04:10] *** qw3rty has quit IRC (Read error: Operation timed out) [04:13] *** keith20 has quit IRC (byeee) [04:25] *** keith20 has joined #archiveteam-bs [04:25] *** keith20 has quit IRC (Client Quit) [04:31] *** jesse-s has quit IRC (Read error: Connection reset by peer) [04:40] *** keith20 has joined #archiveteam-bs [04:40] *** AeonG has joined #archiveteam-bs [04:41] *** kyledrake has joined #archiveteam-bs [04:43] *** odemgi has joined #archiveteam-bs [04:44] *** odemgi_ has quit IRC (Read error: Operation timed out) [04:46] *** keith20 has quit IRC (byeee) [04:47] *** keith20 has joined #archiveteam-bs [04:51] *** odemg has quit IRC (Ping timeout: 745 seconds) [04:55] *** odemg has joined #archiveteam-bs [04:57] *** kyledrake has quit IRC (Read error: Operation timed out) [05:00] *** kyledrake has joined #archiveteam-bs [05:15] *** kyledrake has quit IRC (Read error: Connection reset by peer) [05:18] *** DiscantX has quit IRC (Remote host closed the connection) [05:37] *** riking_ has quit IRC (Read error: Connection timed out) [05:44] *** tuluu_ has left [05:44] *** DiscantX has joined #archiveteam-bs [05:45] *** Dimtree has quit IRC () [05:48] *** riking_ has joined #archiveteam-bs [06:01] *** wabu has quit IRC (Read error: Operation timed out) [06:02] *** wabu has joined #archiveteam-bs [06:02] *** JAA has quit IRC (Read error: Operation timed out) [06:02] *** dxrt- has quit IRC (Read error: Operation timed out) [06:03] *** hata has quit IRC (Read error: Operation timed out) [06:03] *** svchfoo1 has quit IRC (Read error: Operation timed out) [06:03] *** luckcolor has quit IRC (Read error: Operation timed out) [06:03] *** Fionera has quit IRC (Read error: Operation timed out) [06:03] *** Fionera has joined #archiveteam-bs [06:03] *** Larsenv has quit IRC (Ping timeout: 246 seconds) [06:03] *** simon816 has quit IRC (Ping timeout: 246 seconds) [06:04] *** kiska18 has quit IRC (Read error: Operation timed out) [06:04] *** Yurume has quit IRC (Ping timeout: 246 seconds) [06:04] *** DiscantX_ has joined #archiveteam-bs [06:04] *** Larsenv has joined #archiveteam-bs [06:05] *** luckcolor has joined #archiveteam-bs [06:07] *** DiscantX has quit IRC (Ping timeout: 492 seconds) [06:10] *** Yurume has joined #archiveteam-bs [06:24] *** riking_ has quit IRC (Read error: Connection reset by peer) [06:48] *** JSharp__ has joined #archiveteam-bs [06:48] *** riking_ has joined #archiveteam-bs [06:49] *** Ivy has joined #archiveteam-bs [06:49] *** t3 has joined #archiveteam-bs [06:49] *** ThisAsYou has joined #archiveteam-bs [06:51] *** starlord has joined #archiveteam-bs [06:51] *** DrasticAc has joined #archiveteam-bs [06:51] *** SJon has joined #archiveteam-bs [06:51] *** pnJay has joined #archiveteam-bs [06:52] *** deathy_ has joined #archiveteam-bs [06:52] *** Kaz has joined #archiveteam-bs [06:53] *** revi has joined #archiveteam-bs [06:54] *** diggan has joined #archiveteam-bs [06:55] *** jrwr has joined #archiveteam-bs [06:55] *** svchfoo3 sets mode: +o jrwr [06:57] *** hook54321 has joined #archiveteam-bs [06:57] *** horkermon has joined #archiveteam-bs [07:01] *** jesse-s has joined #archiveteam-bs [07:02] *** HCross has joined #archiveteam-bs [07:02] *** simon816 has joined #archiveteam-bs [07:02] *** Ctrl-S_ has joined #archiveteam-bs [07:02] *** kiska18 has joined #archiveteam-bs [07:03] *** hata has joined #archiveteam-bs [07:03] *** svchfoo1 has joined #archiveteam-bs [07:03] *** hook54321 has quit IRC (Quit: Updating details, brb) [07:03] *** svchfoo3 sets mode: +o kiska18 [07:04] *** svchfoo3 sets mode: +o svchfoo1 [07:04] *** Vito`_ has joined #archiveteam-bs [07:05] *** dxrt has joined #archiveteam-bs [07:05] *** ats has quit IRC (Read error: Operation timed out) [07:05] *** Tenebrae has quit IRC (Read error: Operation timed out) [07:06] *** c0mpass has joined #archiveteam-bs [07:06] *** JAA has joined #archiveteam-bs [07:06] *** AlsoJAA sets mode: +o JAA [07:06] *** svchfoo3 sets mode: +o dxrt [07:06] *** MrRadar2 has quit IRC (Read error: Operation timed out) [07:06] *** svchfoo1 sets mode: +o dxrt [07:06] *** MrRadar2 has joined #archiveteam-bs [07:06] *** fallenoak has joined #archiveteam-bs [07:07] *** Tenebrae has joined #archiveteam-bs [07:08] *** hook54321 has joined #archiveteam-bs [07:08] *** amelia386 has joined #archiveteam-bs [07:09] *** octarine has joined #archiveteam-bs [07:13] *** tchaypo has joined #archiveteam-bs [07:13] *** lenary has joined #archiveteam-bs [07:15] *** ats has joined #archiveteam-bs [07:17] *** MrRadar2 has quit IRC (Read error: Operation timed out) [07:17] *** picklefac has joined #archiveteam-bs [07:18] *** OrIdow6 has quit IRC (Quit: Leaving.) [07:20] *** PurpleSym has quit IRC (Read error: Connection reset by peer) [07:21] *** PurpleSym has joined #archiveteam-bs [07:21] *** svchfoo1 sets mode: +o PurpleSym [07:21] *** svchfoo3 sets mode: +o PurpleSym [07:24] *** marked1 has joined #archiveteam-bs [07:24] *** MrRadar2 has joined #archiveteam-bs [07:25] *** kyledrake has joined #archiveteam-bs [07:33] *** mgrytbak has joined #archiveteam-bs [07:35] *** OrIdow6 has joined #archiveteam-bs [08:01] *** kiska18 has quit IRC (Read error: Operation timed out) [08:03] *** kiska18 has joined #archiveteam-bs [08:03] *** svchfoo1 sets mode: +o kiska18 [08:03] *** svchfoo3 sets mode: +o kiska18 [08:11] *** Raccoon` has joined #archiveteam-bs [08:11] *** Raccoon` has quit IRC (Handshake flooding) [08:11] *** Raccoon` has joined #archiveteam-bs [08:12] *** Raccoon has quit IRC (Ping timeout: 360 seconds) [08:12] *** Raccoon` is now known as Raccoon [08:34] *** DiscantX_ has quit IRC (Remote host closed the connection) [08:51] *** DiscantX has joined #archiveteam-bs [09:07] *** MrRadar2 has quit IRC (Read error: Operation timed out) [09:07] *** DiscantX has quit IRC (Remote host closed the connection) [09:08] *** Tenebrae has quit IRC (Read error: Operation timed out) [09:10] *** Tenebrae has joined #archiveteam-bs [09:11] *** BlueMaxim has joined #archiveteam-bs [09:14] *** MrRadar2 has joined #archiveteam-bs [09:18] *** DiscantX has joined #archiveteam-bs [09:21] *** BlueMax has quit IRC (Ping timeout: 745 seconds) [09:21] *** MrRadar2 has quit IRC (Read error: Operation timed out) [09:25] *** Raccoon` has joined #archiveteam-bs [09:27] *** Tenebrae has quit IRC (Read error: Operation timed out) [09:27] *** Tenebrae has joined #archiveteam-bs [09:28] *** Raccoon has quit IRC (Read error: Connection reset by peer) [09:28] *** Raccoon` is now known as Raccoon [09:28] *** MrRadar2 has joined #archiveteam-bs [09:46] *** sHATNER has quit IRC (Read error: Operation timed out) [09:46] *** sHATNER has joined #archiveteam-bs [09:47] *** PurpleSym has quit IRC (Read error: Operation timed out) [09:48] *** brayden_ has quit IRC (Read error: Operation timed out) [09:48] *** MrRadar2 has quit IRC (Remote host closed the connection) [09:49] *** PurpleSym has joined #archiveteam-bs [09:49] *** brayden has joined #archiveteam-bs [09:50] *** svchfoo1 sets mode: +o PurpleSym [09:50] *** svchfoo3 sets mode: +o PurpleSym [09:53] *** MrRadar2 has joined #archiveteam-bs [09:56] *** Raccoon` has joined #archiveteam-bs [09:59] *** DLoader_ has joined #archiveteam-bs [10:01] *** Raccoon has quit IRC (Ping timeout: 745 seconds) [10:01] *** Raccoon` is now known as Raccoon [10:10] *** DLoader has quit IRC (Ping timeout: 745 seconds) [10:11] *** DLoader_ is now known as DLoader [10:13] *** af10b3e5e has quit IRC (Quit: https://i.imgur.com/xacQ09F.mp4) [10:28] *** DiscantX has quit IRC (Remote host closed the connection) [10:41] *** d5f4a3622 has joined #archiveteam-bs [10:55] *** OrIdow6 has quit IRC (Quit: Leaving.) [10:58] *** BlueMaxim has quit IRC (Quit: Leaving) [11:26] *** Tenebrae has quit IRC (Read error: Connection reset by peer) [11:27] *** PurpleSym has quit IRC (Read error: Operation timed out) [11:31] *** MrRadar2 has quit IRC (Read error: Operation timed out) [11:35] *** MrRadar2 has joined #archiveteam-bs [11:35] *** PurpleSym has joined #archiveteam-bs [11:35] *** Tenebrae has joined #archiveteam-bs [11:36] *** svchfoo1 sets mode: +o PurpleSym [11:36] *** svchfoo3 sets mode: +o PurpleSym [11:37] *** brayden_ has joined #archiveteam-bs [11:37] *** brayden has quit IRC (Read error: Connection reset by peer) [12:37] *** icedice has quit IRC (Leaving) [13:58] *** JAA sets mode: +o hook54321 [15:06] *** tech234a has joined #archiveteam-bs [15:23] *** anarcat has joined #archiveteam-bs [15:23] i'm thinking of shoving linksunten.archive.indymedia.org at archivebot [15:24] but they also provide the entire site as three zip files... https://linksunten.archive.indymedia.org/linksunten-html.zip https://linksunten.archive.indymedia.org/linksunten-media.zip https://linksunten.archive.indymedia.org/linksunten-json.zip [15:24] how should we play this? just let archivebot find those links and download them like everything else? [15:25] *** schbirid has joined #archiveteam-bs [16:34] *** arkiver has quit IRC (Quit: ZNC - http://znc.in) [16:34] *** joepie91 has quit IRC (Quit: ZNC - http://znc.in) [16:38] *** RichardG_ is now known as RichardG [16:42] anarcat: Ooh, neat, I wasn't aware of that. Yes please, throw the entire thing into AB! [16:42] With --concurrency 1 at the beginning until it's past those ZIPs. [16:43] so !a --concurrency 1 https://linksunten.archive.indymedia.org/ ? [16:44] Yes, although I think the option has to come after the URL, but not sure. [16:46] got it, let's see [16:48] *** step has quit IRC (Ping timeout: 745 seconds) [16:50] *** step has joined #archiveteam-bs [17:08] *** DiscantX has joined #archiveteam-bs [17:12] *** step has quit IRC (Ping timeout: 745 seconds) [17:14] *** step has joined #archiveteam-bs [17:30] *** DiscantX has quit IRC (Remote host closed the connection) [17:40] JAA: how will i know it has passed those zips? [17:40] i mean i got the dashboard open but (a) i opened it too late so i might have missed stuff and (b) it's heating up my CPU :p [17:43] looks like https://linksunten.archive.indymedia.org/linksunten-html.zip (1GB) has passez [17:43] passed [17:51] anarcat: Yeah, it's downloading -media.zip now. Should be fine to increase the concurrency after. [17:52] cool [17:52] *** step has quit IRC (Ping timeout: 745 seconds) [17:52] Well, I hope it manages to grab the media ZIP within the timeout limit. [17:54] *** godane has joined #archiveteam-bs [17:55] *** step has joined #archiveteam-bs [17:56] Doesn't look like it will. [17:57] It's only at 5.7 GB of 90.4 after an hour. [17:57] ouch [17:57] that's one huge zip file [17:58] Yep, and the download is slow. [18:04] is the time out meant to prevent stuck jobs or slow jobs? [18:06] Yes, and streams etc. which would never finish. [18:06] can it be tweaked somehow? or what's the strategy here? [18:11] *** icedice has joined #archiveteam-bs [18:11] *** kiska has quit IRC (Remote host closed the connection) [18:11] Nope, it's hardcoded. An option to change it on a per-job basis is asked about regularly for years. [18:11] *** kiska has joined #archiveteam-bs [18:12] *** Flashfire has joined #archiveteam-bs [18:12] So the strategy is to grab it separately with something that has a higher limit. [18:12] *** svchfoo1 sets mode: +o kiska [18:12] *** svchfoo3 sets mode: +o kiska [18:12] I can do that, but let's see first if it somehow succeeds anyway. [18:12] ack, thanks! [18:12] will that crash the entire job? [18:21] *** step has quit IRC (Ping timeout: 745 seconds) [18:22] *** step has joined #archiveteam-bs [18:34] another 7 computer magazines scanned : https://www.patreon.com/posts/digitize-for-01-33205723 [19:14] *** AeonG has quit IRC (Read error: Connection reset by peer) [19:15] *** wyatt8740 has joined #archiveteam-bs [19:30] *** alex73 has joined #archiveteam-bs [19:31] *** dashcloud has quit IRC (Read error: Connection reset by peer) [19:31] *** dashcloud has joined #archiveteam-bs [19:47] *** VADemon_ has joined #archiveteam-bs [19:48] *** VADemon has quit IRC (Read error: Operation timed out) [19:53] *** X-Scale has quit IRC (Read error: Operation timed out) [20:01] *** X-Scale has joined #archiveteam-bs [20:08] *** BlueMax has joined #archiveteam-bs [20:21] *** DogsRNice has joined #archiveteam-bs [20:51] *** schbirid has quit IRC (Quit: Leaving) [21:32] *** BlueMax has quit IRC (Quit: Leaving) [22:49] *** OrIdow6 has joined #archiveteam-bs [23:08] anarcat: No, just an error. [23:08] And it did time out. [23:27] Looks like Singstar is ~0.5 tebibytes or so [23:36] *** LowLevelM has quit IRC (Read error: Operation timed out) [23:36] *** LowLevelM has joined #archiveteam-bs [23:40] *** Jens has quit IRC (Remote host closed the connection) [23:41] *** Jens has joined #archiveteam-bs [23:46] *** arkhive has joined #archiveteam-bs