#archiveteam-ot 2018-12-10,Mon

↑back Search

Time Nickname Message
00:30 πŸ”— Mateon1 has quit IRC (Ping timeout: 255 seconds)
00:34 πŸ”— Mateon1 has joined #archiveteam-ot
00:48 πŸ”— vitzli has joined #archiveteam-ot
02:03 πŸ”— godane has quit IRC (Ping timeout: 265 seconds)
02:14 πŸ”— vitzli has quit IRC (Quit: Leaving)
02:17 πŸ”— godane has joined #archiveteam-ot
02:56 πŸ”— Mateon1 has quit IRC (Read error: Operation timed out)
02:56 πŸ”— Mateon1 has joined #archiveteam-ot
03:07 πŸ”— benjinsmi has joined #archiveteam-ot
03:11 πŸ”— benjins has quit IRC (Read error: Operation timed out)
04:02 πŸ”— benjinss has joined #archiveteam-ot
04:05 πŸ”— benjinsmi has quit IRC (Read error: Operation timed out)
04:17 πŸ”— odemg has quit IRC (Ping timeout: 265 seconds)
04:29 πŸ”— wp494 has quit IRC (Ping timeout: 492 seconds)
04:29 πŸ”— wp494 has joined #archiveteam-ot
04:30 πŸ”— svchfoo3 sets mode: +o wp494
05:55 πŸ”— dashcloud has quit IRC (No Ping reply in 180 seconds.)
05:56 πŸ”— DorianhaB has joined #archiveteam-ot
05:57 πŸ”— dashcloud has joined #archiveteam-ot
06:09 πŸ”— dashcloud has quit IRC (No Ping reply in 180 seconds.)
06:10 πŸ”— dashcloud has joined #archiveteam-ot
06:19 πŸ”— dashcloud has quit IRC (No Ping reply in 180 seconds.)
06:20 πŸ”— dashcloud has joined #archiveteam-ot
06:43 πŸ”— hiroi has left Be back later...
07:14 πŸ”— GLolol has joined #archiveteam-ot
07:58 πŸ”— BlueMax has quit IRC (Remote host closed the connection)
07:58 πŸ”— BlueMax has joined #archiveteam-ot
08:08 πŸ”— hook54321 Mozilla planning on removing FTP support in Firefox eventually: https://bugzilla.mozilla.org/show_bug.cgi?id=85464#c34
08:31 πŸ”— wmvhater has quit IRC (Ping timeout (120 seconds))
08:31 πŸ”— wmvhater has joined #archiveteam-ot
08:35 πŸ”— odemg has joined #archiveteam-ot
08:36 πŸ”— odemg DarkWorld, yes and yes
08:41 πŸ”— BlueMax has quit IRC (Remote host closed the connection)
08:42 πŸ”— BlueMax has joined #archiveteam-ot
08:54 πŸ”— GLolol has quit IRC (Ping timeout: 252 seconds)
09:15 πŸ”— DorianhaB has quit IRC (DorianhaB)
09:28 πŸ”— BlueMax has quit IRC (Read error: Connection reset by peer)
09:32 πŸ”— BlueMax has joined #archiveteam-ot
09:41 πŸ”— DarkWorld @odemg: So IΒ΄ve figured out the first part (google cloud services provide $420 credit to use when you signup) but it would be great if you can send me a copy of the scene game dumps (HTML pages, not actual games)
09:41 πŸ”— DarkWorld and so IΔΊl be using wget to download into a vm then use rclone to clone it to gdrive
09:48 πŸ”— Soulflare has joined #archiveteam-ot
09:59 πŸ”— odemg why though, just give me your rclone conf for your google account and I'll push it straight over to you
10:00 πŸ”— odemg bare in mind I stopped checking size after 8TB
10:06 πŸ”— ivan https://github.com/peterk/munin-indexer
10:15 πŸ”— DarkWorld @odemg IΒ΄m talking about the actual web pages but if you have the games that be even better ;)
10:15 πŸ”— DarkWorld but yeah gimme a sec
10:15 πŸ”— DarkWorld how many files is it?
10:16 πŸ”— DarkWorld I canΒ΄t go over 400k files
10:58 πŸ”— odemg then ya fucked, I don't fucks with team drives, waste of time. The pages are linked in a reddit thread if you just want those, r/piracy or r/roms I forget which, some dude downloaded them all and used python webserver module to spin up a fast site to browse it all
11:00 πŸ”— BlueMax has quit IRC (Read error: Connection reset by peer)
11:17 πŸ”— DarkWorld I mean like
11:17 πŸ”— DarkWorld I doubt there are over 400k of rar files
11:18 πŸ”— DarkWorld also
11:18 πŸ”— DarkWorld not scene games
11:19 πŸ”— DarkWorld *the dumps are gog games
11:19 πŸ”— DarkWorld on /r/piracy
11:20 πŸ”— DarkWorld Lets say on average there are 6-7 rar files per game
11:20 πŸ”— DarkWorld there are currently 2075 GOG games hosted on GOD
11:20 πŸ”— DarkWorld thatΒ΄s around 15225 files for GOG
11:26 πŸ”— DarkWorld if we say average of 21 files for each game
11:26 πŸ”— odemg ahh
11:26 πŸ”— DarkWorld thatΒ΄s 45675 files
11:26 πŸ”— odemg pm me, i'll get at you later
11:27 πŸ”— DarkWorld BTW I was the one who hosted hosted the GOG dumps on netlify
11:27 πŸ”— DarkWorld ;)
11:27 πŸ”— DarkWorld yeah IΒ΄ll pm you
13:16 πŸ”— benjinss has quit IRC (Leaving)
13:17 πŸ”— benjins has joined #archiveteam-ot
13:24 πŸ”— wp494 has quit IRC (Ping timeout: 265 seconds)
13:25 πŸ”— wp494 has joined #archiveteam-ot
13:25 πŸ”— svchfoo3 sets mode: +o wp494
13:52 πŸ”— odemg has quit IRC (Ping timeout: 265 seconds)
13:56 πŸ”— odemg has joined #archiveteam-ot
14:05 πŸ”— godane has quit IRC (Ping timeout: 260 seconds)
14:22 πŸ”— godane has joined #archiveteam-ot
15:59 πŸ”— odemg has quit IRC (Ping timeout: 265 seconds)
16:01 πŸ”— odemg has joined #archiveteam-ot
18:21 πŸ”— schbirid has joined #archiveteam-ot
18:41 πŸ”— JAA transfer.sh just responded with this on a ~2 GB upload: "Due to abuse we've limited max upload size. Thank the pirates!"
18:41 πŸ”— JAA "Up to 10 GB" my ass
18:48 πŸ”— Raccoon all your fault!
18:49 πŸ”— hook54321 has quit IRC (Quit: Connection closed for inactivity)
19:04 πŸ”— teej_ Why do we use transfer.sh?
19:04 πŸ”— anarcat has quit IRC (Read error: Connection reset by peer)
19:04 πŸ”— jeekl has quit IRC (Remote host closed the connection)
19:04 πŸ”— anarcat has joined #archiveteam-ot
19:16 πŸ”— schbirid JAA: been that way for ages already :(
19:30 πŸ”— schbirid has quit IRC (Remote host closed the connection)
19:34 πŸ”— godane has quit IRC (Ping timeout: 260 seconds)
19:38 πŸ”— jeekl has joined #archiveteam-ot
19:42 πŸ”— ola_norsk has joined #archiveteam-ot
19:43 πŸ”— ola_norsk would anyone happen to know if when tubeup fails with e.g "broken pip", if it throws an exit status larger than 0?
19:44 πŸ”— ola_norsk "broken pipe"
19:46 πŸ”— ola_norsk i'm using a shell script that does tubeup, and seems like when ia had some technical difficulties, quite a few uploads became partial. So looking for solution, without touching the actual tubeup python code (https://bash.cyberciti.biz/guide/The_exit_status_of_a_command)
19:48 πŸ”— Stiletto has joined #archiveteam-ot
19:49 πŸ”— hook54321 has joined #archiveteam-ot
19:53 πŸ”— ola_norsk not sure how to go about properly testing wether it does so or not, upon possible exception throws
20:06 πŸ”— odemg has quit IRC (Ping timeout: 265 seconds)
20:10 πŸ”— odemg has joined #archiveteam-ot
20:16 πŸ”— schbirid has joined #archiveteam-ot
20:39 πŸ”— caff has joined #archiveteam-ot
21:24 πŸ”— ephemer0l has joined #archiveteam-ot
21:25 πŸ”— ephemer0l howdy
21:53 πŸ”— Despatche has joined #archiveteam-ot
21:54 πŸ”— Despatche has quit IRC (Client Quit)
21:58 πŸ”— ola_norsk hoi
22:00 πŸ”— ola_norsk ephemer0l: would you happen to have a bit of knowledge regarding python script and exit codes?
22:01 πŸ”— ephemer0l ola_norsk: I'm not much of a coder, really. what are you hung up on? 0 succeeded 1 didnt.
22:01 πŸ”— ola_norsk (e.g does _any_ exeption thrown by a python script throw higher than 0?)
22:01 πŸ”— ola_norsk aye
22:02 πŸ”— ephemer0l some can during tests https://docs.pytest.org/en/latest/usage.html
22:02 πŸ”— ola_norsk you're a godsend
22:02 πŸ”— ephemer0l gl
22:06 πŸ”— JAA ola_norsk: As far as I know, exceptions in Python should cause an exit status != 0. (Technically, there's an exception (heh) to that, which is the SystemExit exception, but that's really an implementation detail.)
22:07 πŸ”— ola_norsk JAA: ah ok. Thanks! i'm not familiar with tubeups code, so was hoping that would be the case.
22:07 πŸ”— BlueMax has joined #archiveteam-ot
22:07 πŸ”— schbirid has quit IRC (Remote host closed the connection)
22:08 πŸ”— JAA I'm not familiar with tubeup either, but if it's an exception that bubbles all the way up, then the exit status should be != 0 (1, I think).
22:08 πŸ”— JAA If tubeup catches the exception and then does some weird stuff around it, that might not be the case though.
22:10 πŸ”— ola_norsk i use a shell script that does 'tubeup <url>' per url in a textfile, and then adds any 'done' links to a list..seems i didn't account for the possibilty of it failing and still recording the urls as 'done'
22:11 πŸ”— ola_norsk anyway, thanks again ephemer0l and JAA
22:11 πŸ”— ola_norsk has quit IRC (leaving)
22:14 πŸ”— odemg has quit IRC (Ping timeout: 265 seconds)
22:16 πŸ”— odemg has joined #archiveteam-ot
22:19 πŸ”— Flashfire Does anyone want to SNScrape a bunch of sponsored instagram accounts? I have been sending some to kiska but I think he is a bit busy
22:25 πŸ”— wp494 has quit IRC (Ping timeout: 255 seconds)
22:26 πŸ”— wp494 has joined #archiveteam-ot
22:26 πŸ”— svchfoo3 sets mode: +o wp494
22:45 πŸ”— ola_norsk has joined #archiveteam-ot
22:45 πŸ”— ola_norsk here's the script i (now) use to queue tubeup btw, in case someone might find it useful http://paste.ubuntu.com/p/4BQMTNXrPS/
22:53 πŸ”— ola_norsk has quit IRC (leaving)
23:19 πŸ”— godane has joined #archiveteam-ot
irclogger-viewer