[00:30] *** Mateon1 has quit IRC (Ping timeout: 255 seconds) [00:34] *** Mateon1 has joined #archiveteam-ot [00:48] *** vitzli has joined #archiveteam-ot [02:03] *** godane has quit IRC (Ping timeout: 265 seconds) [02:14] *** vitzli has quit IRC (Quit: Leaving) [02:17] *** godane has joined #archiveteam-ot [02:56] *** Mateon1 has quit IRC (Read error: Operation timed out) [02:56] *** Mateon1 has joined #archiveteam-ot [03:07] *** benjinsmi has joined #archiveteam-ot [03:11] *** benjins has quit IRC (Read error: Operation timed out) [04:02] *** benjinss has joined #archiveteam-ot [04:05] *** benjinsmi has quit IRC (Read error: Operation timed out) [04:17] *** odemg has quit IRC (Ping timeout: 265 seconds) [04:29] *** wp494 has quit IRC (Ping timeout: 492 seconds) [04:29] *** wp494 has joined #archiveteam-ot [04:30] *** svchfoo3 sets mode: +o wp494 [05:55] *** dashcloud has quit IRC (No Ping reply in 180 seconds.) [05:56] *** DorianhaB has joined #archiveteam-ot [05:57] *** dashcloud has joined #archiveteam-ot [06:09] *** dashcloud has quit IRC (No Ping reply in 180 seconds.) [06:10] *** dashcloud has joined #archiveteam-ot [06:19] *** dashcloud has quit IRC (No Ping reply in 180 seconds.) [06:20] *** dashcloud has joined #archiveteam-ot [06:43] *** hiroi has left Be back later... [07:14] *** GLolol has joined #archiveteam-ot [07:58] *** BlueMax has quit IRC (Remote host closed the connection) [07:58] *** BlueMax has joined #archiveteam-ot [08:08] Mozilla planning on removing FTP support in Firefox eventually: https://bugzilla.mozilla.org/show_bug.cgi?id=85464#c34 [08:31] *** wmvhater has quit IRC (Ping timeout (120 seconds)) [08:31] *** wmvhater has joined #archiveteam-ot [08:35] *** odemg has joined #archiveteam-ot [08:36] DarkWorld, yes and yes [08:41] *** BlueMax has quit IRC (Remote host closed the connection) [08:42] *** BlueMax has joined #archiveteam-ot [08:54] *** GLolol has quit IRC (Ping timeout: 252 seconds) [09:15] *** DorianhaB has quit IRC (DorianhaB) [09:28] *** BlueMax has quit IRC (Read error: Connection reset by peer) [09:32] *** BlueMax has joined #archiveteam-ot [09:41] @odemg: So I´ve figured out the first part (google cloud services provide $420 credit to use when you signup) but it would be great if you can send me a copy of the scene game dumps (HTML pages, not actual games) [09:41] and so Iĺl be using wget to download into a vm then use rclone to clone it to gdrive [09:48] *** Soulflare has joined #archiveteam-ot [09:59] why though, just give me your rclone conf for your google account and I'll push it straight over to you [10:00] bare in mind I stopped checking size after 8TB [10:06] https://github.com/peterk/munin-indexer [10:15] @odemg I´m talking about the actual web pages but if you have the games that be even better ;) [10:15] but yeah gimme a sec [10:15] how many files is it? [10:16] I can´t go over 400k files [10:58] then ya fucked, I don't fucks with team drives, waste of time. The pages are linked in a reddit thread if you just want those, r/piracy or r/roms I forget which, some dude downloaded them all and used python webserver module to spin up a fast site to browse it all [11:00] *** BlueMax has quit IRC (Read error: Connection reset by peer) [11:17] I mean like [11:17] I doubt there are over 400k of rar files [11:18] also [11:18] not scene games [11:19] *the dumps are gog games [11:19] on /r/piracy [11:20] Lets say on average there are 6-7 rar files per game [11:20] there are currently 2075 GOG games hosted on GOD [11:20] that´s around 15225 files for GOG [11:26] if we say average of 21 files for each game [11:26] ahh [11:26] that´s 45675 files [11:26] pm me, i'll get at you later [11:27] BTW I was the one who hosted hosted the GOG dumps on netlify [11:27] ;) [11:27] yeah I´ll pm you [13:16] *** benjinss has quit IRC (Leaving) [13:17] *** benjins has joined #archiveteam-ot [13:24] *** wp494 has quit IRC (Ping timeout: 265 seconds) [13:25] *** wp494 has joined #archiveteam-ot [13:25] *** svchfoo3 sets mode: +o wp494 [13:52] *** odemg has quit IRC (Ping timeout: 265 seconds) [13:56] *** odemg has joined #archiveteam-ot [14:05] *** godane has quit IRC (Ping timeout: 260 seconds) [14:22] *** godane has joined #archiveteam-ot [15:59] *** odemg has quit IRC (Ping timeout: 265 seconds) [16:01] *** odemg has joined #archiveteam-ot [18:21] *** schbirid has joined #archiveteam-ot [18:41] transfer.sh just responded with this on a ~2 GB upload: "Due to abuse we've limited max upload size. Thank the pirates!" [18:41] "Up to 10 GB" my ass [18:48] all your fault! [18:49] *** hook54321 has quit IRC (Quit: Connection closed for inactivity) [19:04] Why do we use transfer.sh? [19:04] *** anarcat has quit IRC (Read error: Connection reset by peer) [19:04] *** jeekl has quit IRC (Remote host closed the connection) [19:04] *** anarcat has joined #archiveteam-ot [19:16] JAA: been that way for ages already :( [19:30] *** schbirid has quit IRC (Remote host closed the connection) [19:34] *** godane has quit IRC (Ping timeout: 260 seconds) [19:38] *** jeekl has joined #archiveteam-ot [19:42] *** ola_norsk has joined #archiveteam-ot [19:43] would anyone happen to know if when tubeup fails with e.g "broken pip", if it throws an exit status larger than 0? [19:44] "broken pipe" [19:46] i'm using a shell script that does tubeup, and seems like when ia had some technical difficulties, quite a few uploads became partial. So looking for solution, without touching the actual tubeup python code (https://bash.cyberciti.biz/guide/The_exit_status_of_a_command) [19:48] *** Stiletto has joined #archiveteam-ot [19:49] *** hook54321 has joined #archiveteam-ot [19:53] not sure how to go about properly testing wether it does so or not, upon possible exception throws [20:06] *** odemg has quit IRC (Ping timeout: 265 seconds) [20:10] *** odemg has joined #archiveteam-ot [20:16] *** schbirid has joined #archiveteam-ot [20:39] *** caff has joined #archiveteam-ot [21:24] *** ephemer0l has joined #archiveteam-ot [21:25] howdy [21:53] *** Despatche has joined #archiveteam-ot [21:54] *** Despatche has quit IRC (Client Quit) [21:58] hoi [22:00] ephemer0l: would you happen to have a bit of knowledge regarding python script and exit codes? [22:01] ola_norsk: I'm not much of a coder, really. what are you hung up on? 0 succeeded 1 didnt. [22:01] (e.g does _any_ exeption thrown by a python script throw higher than 0?) [22:01] aye [22:02] some can during tests https://docs.pytest.org/en/latest/usage.html [22:02] you're a godsend [22:02] gl [22:06] ola_norsk: As far as I know, exceptions in Python should cause an exit status != 0. (Technically, there's an exception (heh) to that, which is the SystemExit exception, but that's really an implementation detail.) [22:07] JAA: ah ok. Thanks! i'm not familiar with tubeups code, so was hoping that would be the case. [22:07] *** BlueMax has joined #archiveteam-ot [22:07] *** schbirid has quit IRC (Remote host closed the connection) [22:08] I'm not familiar with tubeup either, but if it's an exception that bubbles all the way up, then the exit status should be != 0 (1, I think). [22:08] If tubeup catches the exception and then does some weird stuff around it, that might not be the case though. [22:10] i use a shell script that does 'tubeup ' per url in a textfile, and then adds any 'done' links to a list..seems i didn't account for the possibilty of it failing and still recording the urls as 'done' [22:11] anyway, thanks again ephemer0l and JAA [22:11] *** ola_norsk has quit IRC (leaving) [22:14] *** odemg has quit IRC (Ping timeout: 265 seconds) [22:16] *** odemg has joined #archiveteam-ot [22:19] Does anyone want to SNScrape a bunch of sponsored instagram accounts? I have been sending some to kiska but I think he is a bit busy [22:25] *** wp494 has quit IRC (Ping timeout: 255 seconds) [22:26] *** wp494 has joined #archiveteam-ot [22:26] *** svchfoo3 sets mode: +o wp494 [22:45] *** ola_norsk has joined #archiveteam-ot [22:45] here's the script i (now) use to queue tubeup btw, in case someone might find it useful http://paste.ubuntu.com/p/4BQMTNXrPS/ [22:53] *** ola_norsk has quit IRC (leaving) [23:19] *** godane has joined #archiveteam-ot