| Time |
Nickname |
Message |
|
00:05
🔗
|
|
silas has joined #archiveteam-ot |
|
00:07
🔗
|
silas |
Hey, just a quick question. What's the recommended way to download an FTP server? I'm planning on uploading it to IA, so would it be better to download it to a WARC or is just downloading the files good enough? |
|
00:10
🔗
|
Kaz |
warc would be best I'd imagine |
|
00:13
🔗
|
|
odemg has quit IRC (Ping timeout: 265 seconds) |
|
00:17
🔗
|
|
odemg has joined #archiveteam-ot |
|
00:33
🔗
|
Flashfire |
WARC is best |
|
00:33
🔗
|
Flashfire |
Silas WARC is defs best |
|
00:35
🔗
|
silas |
Alright, I figured. Thank you! |
|
00:48
🔗
|
|
voltagex has joined #archiveteam-ot |
|
00:50
🔗
|
|
trvz has quit IRC (Quit: Connection closed for inactivity) |
|
01:27
🔗
|
|
Dj-Wawa has quit IRC (Quit: Connection closed for inactivity) |
|
01:27
🔗
|
|
marked has joined #archiveteam-ot |
|
01:28
🔗
|
|
wp494 has quit IRC (Ping timeout: 268 seconds) |
|
01:29
🔗
|
|
wp494 has joined #archiveteam-ot |
|
01:29
🔗
|
|
svchfoo1 sets mode: +o wp494 |
|
04:58
🔗
|
|
odemg has quit IRC (Ping timeout: 265 seconds) |
|
05:11
🔗
|
|
odemg has joined #archiveteam-ot |
|
06:38
🔗
|
|
wp494 has quit IRC (Quit: LOUD UNNECESSARY QUIT MESSAGES) |
|
08:07
🔗
|
|
wp494 has joined #archiveteam-ot |
|
08:08
🔗
|
|
svchfoo1 sets mode: +o wp494 |
|
08:23
🔗
|
|
wp494 has quit IRC (Ping timeout: 268 seconds) |
|
08:30
🔗
|
|
wp494 has joined #archiveteam-ot |
|
08:30
🔗
|
|
svchfoo1 sets mode: +o wp494 |
|
08:40
🔗
|
|
ivan` is now known as ivan_ |
|
09:35
🔗
|
schbirid |
i was wondering why i did not get remotely 100mbit/s from my vpn, realised openvpn was maxing out the poor cpu. lol |
|
09:35
🔗
|
schbirid |
is wireguard less cpu intense? |
|
09:44
🔗
|
HCross |
yes |
|
10:02
🔗
|
|
Sian1468 has joined #archiveteam-ot |
|
10:06
🔗
|
Flashfire |
Does https://www.bestgore.com/beheading/24-year-old-danish-female-backpacker-morocco-final-trek-beheading/ fall under the category of archive or do not archive |
|
10:07
🔗
|
Flashfire |
Everyone has been ordered to take it down but bestgore is known for saying fuck you censorship |
|
10:07
🔗
|
_niklas |
well it falls under the category of no way am I clicking that |
|
10:11
🔗
|
|
adinbied has quit IRC (Read error: Connection reset by peer) |
|
10:13
🔗
|
|
adinbied has joined #archiveteam-ot |
|
10:24
🔗
|
schbirid |
Flashfire: it falls under the category of common decency of not enjoying vile |
|
10:24
🔗
|
schbirid |
also fuck yuo for even bringing such links here |
|
10:27
🔗
|
Flashfire |
My apologies for posting that here. schbirid I only brought it up as I had seen it in the news multiple times |
|
10:40
🔗
|
SketchCow |
I mean, I watched it, but I worked for ROTTEN.COM so I'm a specific person |
|
10:41
🔗
|
SketchCow |
I agree, don't dump links like that in IRC channels because the nature of the thing (even with such a clear URL name) isn't always obvious to people who are just copy-pasting everything because being discussed |
|
10:45
🔗
|
Flashfire |
Alright sorry sketchcow. Is it something we want saved though? |
|
10:46
🔗
|
Flashfire |
If so I should be able to get an un watermarked copu |
|
10:47
🔗
|
SketchCow |
Nah |
|
10:47
🔗
|
SketchCow |
Like, that'll save itself |
|
10:47
🔗
|
SketchCow |
At some point, somewhere in the future, there'll be some hard drive of horrible |
|
10:49
🔗
|
Flashfire |
Alright then |
|
10:53
🔗
|
|
Sian1468 has quit IRC (Quit: Leaving) |
|
11:19
🔗
|
|
Sian1468 has joined #archiveteam-ot |
|
11:21
🔗
|
|
Dj-Wawa has joined #archiveteam-ot |
|
11:27
🔗
|
|
Sian1468 has quit IRC (Leaving) |
|
11:40
🔗
|
|
Sian1468 has joined #archiveteam-ot |
|
11:45
🔗
|
|
m007a83 has quit IRC (Ping timeout: 252 seconds) |
|
11:54
🔗
|
ivan_ |
I put snscrape in nixpkgs |
|
15:03
🔗
|
|
trvz has joined #archiveteam-ot |
|
15:05
🔗
|
|
trvz has quit IRC (Client Quit) |
|
15:06
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
15:06
🔗
|
|
Sian1468 has quit IRC (Quit: Leaving) |
|
15:42
🔗
|
|
apache2_ has quit IRC (Remote host closed the connection) |
|
15:42
🔗
|
|
apache2 has joined #archiveteam-ot |
|
16:42
🔗
|
|
silas has quit IRC (Leaving) |
|
16:53
🔗
|
|
VerfiedJ has joined #archiveteam-ot |
|
17:39
🔗
|
|
wp494 has quit IRC (Read error: Operation timed out) |
|
17:41
🔗
|
|
wp494 has joined #archiveteam-ot |
|
17:41
🔗
|
|
svchfoo1 sets mode: +o wp494 |
|
18:43
🔗
|
psi |
So now that I'm getting a machine with 16 IP addresses, how do I tell Docker which IP address to use for a task |
|
18:49
🔗
|
edisded |
-p x.x.x.x:800X |
|
18:51
🔗
|
psi |
oh it's literally just ip:hostport:containerport |
|
18:51
🔗
|
psi |
easy peasy |
|
18:51
🔗
|
edisded |
Err |
|
18:51
🔗
|
edisded |
Oh |
|
18:52
🔗
|
psi |
But does that actually make the containers use a different IP |
|
18:52
🔗
|
psi |
because that's just port binding |
|
18:52
🔗
|
edisded |
I don't know to be honest |
|
18:53
🔗
|
edisded |
I feel like you're better off running the script if you're doing high concurrency |
|
18:53
🔗
|
edisded |
It's right on the front page of the github how to change the IP it uses |
|
18:54
🔗
|
psi |
I mean, for Tumblr projects, high concurrency per IP is the last thing you want |
|
18:55
🔗
|
edisded |
Yes, i meant machine concurrency |
|
18:55
🔗
|
edisded |
One machine with multiple public interfaces |
|
18:56
🔗
|
edisded |
Seeing as their throttling is per IP and not actually load dependent |
|
18:56
🔗
|
psi |
Ah |
|
18:57
🔗
|
edisded |
If you've got debian or Ubuntu, I've got a bashfile that should get what you need for the warrior script |
|
18:58
🔗
|
|
Mateon1 has quit IRC (Read error: Operation timed out) |
|
18:58
🔗
|
|
Mateon1 has joined #archiveteam-ot |
|
18:58
🔗
|
edisded |
botcrusher.xyz/files/ConfigureTumbledown.sh |
|
18:58
🔗
|
psi |
I do |
|
19:00
🔗
|
edisded |
In that same folder there's also scripts to Update and run it, not that I'd use the run180.sh script anymore |
|
19:00
🔗
|
psi |
So that means starting 16 instances of tmux? |
|
19:00
🔗
|
psi |
(Assuming I *just* run Tumblr scripts) |
|
19:00
🔗
|
edisded |
The linked script only sets up the environment to run it |
|
19:01
🔗
|
psi |
Yeah I get that, but for eventually running it |
|
19:01
🔗
|
edisded |
The runX.sh scripts have your username and concurrency levels |
|
19:01
🔗
|
edisded |
You may want to change it from "botcrusher" unless you like feeding my uploads on the tracker |
|
19:02
🔗
|
psi |
lol |
|
19:03
🔗
|
edisded |
You can adapt the run180.sh script to have runs of 3 threads per IP |
|
19:04
🔗
|
edisded |
Using --context-value bind_address=x.x.x.x |
|
19:05
🔗
|
edisded |
Running 180 with the current throttling would obviously be suicide |
|
19:57
🔗
|
t3 |
edisded: You can make the font smaller. |
|
20:12
🔗
|
|
Odd0002 has quit IRC (Ping timeout: 1212 seconds) |
|
20:42
🔗
|
psi |
And yet, I feel like there should be an easier way to run multiple warriors using different IPs (+ docker would be ideal) |
|
20:44
🔗
|
Kaz |
that sounds like a docker problem rather than a warrior problem |
|
20:46
🔗
|
Kaz |
all the warrior can see is the interface docker creates/the IP docker assigns it |
|
20:48
🔗
|
psi |
hm |
|
20:49
🔗
|
psi |
then the question becomes "can i bind a bridge network to a specific IP" |
|
21:10
🔗
|
|
BlueMax has joined #archiveteam-ot |
|
21:40
🔗
|
|
bithippo has joined #archiveteam-ot |
|
21:46
🔗
|
|
bithippo has quit IRC (Textual IRC Client: www.textualapp.com) |
|
21:57
🔗
|
|
Stiletto has joined #archiveteam-ot |
|
22:00
🔗
|
|
Stilett0 has quit IRC (Read error: Operation timed out) |
|
23:23
🔗
|
|
marked has quit IRC (Remote host closed the connection) |