[00:05] *** silas has joined #archiveteam-ot [00:07] Hey, just a quick question. What's the recommended way to download an FTP server? I'm planning on uploading it to IA, so would it be better to download it to a WARC or is just downloading the files good enough? [00:10] warc would be best I'd imagine [00:13] *** odemg has quit IRC (Ping timeout: 265 seconds) [00:17] *** odemg has joined #archiveteam-ot [00:33] WARC is best [00:33] Silas WARC is defs best [00:35] Alright, I figured. Thank you! [00:48] *** voltagex has joined #archiveteam-ot [00:50] *** trvz has quit IRC (Quit: Connection closed for inactivity) [01:27] *** Dj-Wawa has quit IRC (Quit: Connection closed for inactivity) [01:27] *** marked has joined #archiveteam-ot [01:28] *** wp494 has quit IRC (Ping timeout: 268 seconds) [01:29] *** wp494 has joined #archiveteam-ot [01:29] *** svchfoo1 sets mode: +o wp494 [04:58] *** odemg has quit IRC (Ping timeout: 265 seconds) [05:11] *** odemg has joined #archiveteam-ot [06:38] *** wp494 has quit IRC (Quit: LOUD UNNECESSARY QUIT MESSAGES) [08:07] *** wp494 has joined #archiveteam-ot [08:08] *** svchfoo1 sets mode: +o wp494 [08:23] *** wp494 has quit IRC (Ping timeout: 268 seconds) [08:30] *** wp494 has joined #archiveteam-ot [08:30] *** svchfoo1 sets mode: +o wp494 [08:40] *** ivan` is now known as ivan_ [09:35] i was wondering why i did not get remotely 100mbit/s from my vpn, realised openvpn was maxing out the poor cpu. lol [09:35] is wireguard less cpu intense? [09:44] yes [10:02] *** Sian1468 has joined #archiveteam-ot [10:06] Does https://www.bestgore.com/beheading/24-year-old-danish-female-backpacker-morocco-final-trek-beheading/ fall under the category of archive or do not archive [10:07] Everyone has been ordered to take it down but bestgore is known for saying fuck you censorship [10:07] <_niklas> well it falls under the category of no way am I clicking that [10:11] *** adinbied has quit IRC (Read error: Connection reset by peer) [10:13] *** adinbied has joined #archiveteam-ot [10:24] Flashfire: it falls under the category of common decency of not enjoying vile [10:24] also fuck yuo for even bringing such links here [10:27] My apologies for posting that here. schbirid I only brought it up as I had seen it in the news multiple times [10:40] I mean, I watched it, but I worked for ROTTEN.COM so I'm a specific person [10:41] I agree, don't dump links like that in IRC channels because the nature of the thing (even with such a clear URL name) isn't always obvious to people who are just copy-pasting everything because being discussed [10:45] Alright sorry sketchcow. Is it something we want saved though? [10:46] If so I should be able to get an un watermarked copu [10:47] Nah [10:47] Like, that'll save itself [10:47] At some point, somewhere in the future, there'll be some hard drive of horrible [10:49] Alright then [10:53] *** Sian1468 has quit IRC (Quit: Leaving) [11:19] *** Sian1468 has joined #archiveteam-ot [11:21] *** Dj-Wawa has joined #archiveteam-ot [11:27] *** Sian1468 has quit IRC (Leaving) [11:40] *** Sian1468 has joined #archiveteam-ot [11:45] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [11:54] I put snscrape in nixpkgs [15:03] *** trvz has joined #archiveteam-ot [15:05] *** trvz has quit IRC (Client Quit) [15:06] *** BlueMax has quit IRC (Quit: Leaving) [15:06] *** Sian1468 has quit IRC (Quit: Leaving) [15:42] *** apache2_ has quit IRC (Remote host closed the connection) [15:42] *** apache2 has joined #archiveteam-ot [16:42] *** silas has quit IRC (Leaving) [16:53] *** VerfiedJ has joined #archiveteam-ot [17:39] *** wp494 has quit IRC (Read error: Operation timed out) [17:41] *** wp494 has joined #archiveteam-ot [17:41] *** svchfoo1 sets mode: +o wp494 [18:43] So now that I'm getting a machine with 16 IP addresses, how do I tell Docker which IP address to use for a task [18:49] -p x.x.x.x:800X [18:51] oh it's literally just ip:hostport:containerport [18:51] easy peasy [18:51] Err [18:51] Oh [18:52] But does that actually make the containers use a different IP [18:52] because that's just port binding [18:52] I don't know to be honest [18:53] I feel like you're better off running the script if you're doing high concurrency [18:53] It's right on the front page of the github how to change the IP it uses [18:54] I mean, for Tumblr projects, high concurrency per IP is the last thing you want [18:55] Yes, i meant machine concurrency [18:55] One machine with multiple public interfaces [18:56] Seeing as their throttling is per IP and not actually load dependent [18:56] Ah [18:57] If you've got debian or Ubuntu, I've got a bashfile that should get what you need for the warrior script [18:58] *** Mateon1 has quit IRC (Read error: Operation timed out) [18:58] *** Mateon1 has joined #archiveteam-ot [18:58] botcrusher.xyz/files/ConfigureTumbledown.sh [18:58] I do [19:00] In that same folder there's also scripts to Update and run it, not that I'd use the run180.sh script anymore [19:00] So that means starting 16 instances of tmux? [19:00] (Assuming I *just* run Tumblr scripts) [19:00] The linked script only sets up the environment to run it [19:01] Yeah I get that, but for eventually running it [19:01] The runX.sh scripts have your username and concurrency levels [19:01] You may want to change it from "botcrusher" unless you like feeding my uploads on the tracker [19:02] lol [19:03] You can adapt the run180.sh script to have runs of 3 threads per IP [19:04] Using --context-value bind_address=x.x.x.x [19:05] Running 180 with the current throttling would obviously be suicide [19:57] edisded: You can make the font smaller. [20:12] *** Odd0002 has quit IRC (Ping timeout: 1212 seconds) [20:42] And yet, I feel like there should be an easier way to run multiple warriors using different IPs (+ docker would be ideal) [20:44] that sounds like a docker problem rather than a warrior problem [20:46] all the warrior can see is the interface docker creates/the IP docker assigns it [20:48] hm [20:49] then the question becomes "can i bind a bridge network to a specific IP" [21:10] *** BlueMax has joined #archiveteam-ot [21:40] *** bithippo has joined #archiveteam-ot [21:46] *** bithippo has quit IRC (Textual IRC Client: www.textualapp.com) [21:57] *** Stiletto has joined #archiveteam-ot [22:00] *** Stilett0 has quit IRC (Read error: Operation timed out) [23:23] *** marked has quit IRC (Remote host closed the connection)