[00:07] *** enowaldo has quit IRC (Ping timeout: 268 seconds) [00:19] *** Odd0002_ has joined #archiveteam-bs [00:20] *** IanQ has quit IRC (Ping timeout: 604 seconds) [00:26] *** Odd0002 has quit IRC (Ping timeout: 615 seconds) [00:26] *** Odd0002_ is now known as Odd0002 [00:48] *** bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…) [00:51] *** enowaldo has joined #archiveteam-bs [00:59] *** sec^nd has quit IRC (Remote host closed the connection) [01:02] *** killsushi has joined #archiveteam-bs [01:25] *** icedice has joined #archiveteam-bs [01:27] *** enowaldo has quit IRC (Read error: Operation timed out) [01:32] *** monika has quit IRC (Remote host closed the connection) [01:53] *** enowaldo has joined #archiveteam-bs [02:06] *** enowaldo has quit IRC (Read error: Operation timed out) [03:09] *** VADemon has quit IRC (Read error: Connection reset by peer) [03:11] *** second has joined #archiveteam-bs [03:14] *** second is now known as sec^nd [03:20] *** enowaldo has joined #archiveteam-bs [03:27] SketchCow: i'm uploading retronauts episodes from 2009 to 2013 [03:28] luckly the first 100 episode was upload but doesn't stuff past 2010 from what i can tell: https://archive.org/details/Retronauts1-100 [03:28] *** odemg has quit IRC (Ping timeout: 615 seconds) [03:34] *** enowaldo has quit IRC (Ping timeout: 252 seconds) [03:35] *** dhyan_nat has joined #archiveteam-bs [03:36] *** qw3rty115 has joined #archiveteam-bs [03:41] *** qw3rty114 has quit IRC (Read error: Operation timed out) [03:52] *** glmd has joined #archiveteam-bs [03:52] So what's the plan with Facepunch? [03:56] ^ As previously mentioned on #archivebot: Some people have mentioned that the forum https://forum.facepunch.com/ is endangered (see https://www.reddit.com/r/Archiveteam/comments/b7avru/facepunch_studios_garrys_mod_rust_forums_are_very/). I'm not sure if it is too large for ArchiveBot though - the site claims "433,628 registered users have made 32,593,609 posts in 756,985 threads." [03:56] I know some people interested in working on this project. What is the proposal process? [03:58] What are we gling to do about it? [04:03] *** Despatche has joined #archiveteam-bs [04:06] *** enowaldo has joined #archiveteam-bs [04:10] I see, 49k threads averaging 23 posts per thread [04:11] wait, where are your numbers from? [04:11] So, what are we planning to do about it? [04:12] my fault, I was in a sub forum [04:12] marked, I presume that reddit post. [04:16] *** enowaldo has quit IRC (Read error: Operation timed out) [04:17] the two hardest parts of the process are choosing a channel name and someone needs to write the grab script [04:17] Heh. Fusl set up a grab site I think. [04:18] yeah its not grabbing much more than the archivebot jobs though [04:18] I propose # faceplant [04:19] So where do we start on making a Warrior? [04:19] #faceplant [04:19] #facepalm ? [04:19] whatever it will be ill be there [04:20] facepalm sounds nice. [04:20] So is this a thing that's going to happen? [04:21] well i am in for making it happen unless arkiver wants to hop in and write lua [04:22] Fusl: #whoisthis4chan [04:22] arkiver is already in the middle of reddit [04:23] Really? That's where you're going? [04:23] glmd: just ignore marked [04:24] marked: reddit is not on fire, fp forums is [04:24] I am unfortunately I coughing up blood, so I am unable to create the necessary scripts [04:24] I'll be back in about 2-3 hours [04:25] * kiska is unwell, brb [04:25] fp would be half done by the time he logs in tomorrow morning [04:26] @Fusl: I was respknding to kiska actually. [04:28] Kiska For Fucks sake your health comes first [04:29] psa: coughing up blood I believe is ER level symptom [04:30] May want to get that looked at. [04:37] *** glmd has quit IRC (Ping timeout: 262 seconds) [04:40] *** glmd has joined #archiveteam-bs [04:41] can start a project for facepunch probably this weekend, looks doable [04:42] Fusl: arkiver has stepped in. [04:43] *** IanQ has joined #archiveteam-bs [05:06] *** ndiddy has quit IRC () [05:31] *** icedice has quit IRC (Quit: Leaving) [06:04] quorum has formed in #faceplant , direct future comments there [06:37] *** tsp_ has quit IRC (Remote host closed the connection) [06:37] *** tsp_ has joined #archiveteam-bs [06:38] *** killsushi has quit IRC (Quit: Leaving) [07:02] *** PhrackD has quit IRC (Read error: Operation timed out) [07:03] *** PhrackD has joined #archiveteam-bs [07:24] *** Exairnous has quit IRC (Ping timeout: 615 seconds) [07:34] *** godane has quit IRC (Ping timeout: 265 seconds) [07:34] *** dhyan_nat has quit IRC (Read error: Connection reset by peer) [07:34] *** dhyan_nat has joined #archiveteam-bs [07:45] *** dhyan_nat has quit IRC (Quit: Konversation terminated!) [07:45] *** dhyan_nat has joined #archiveteam-bs [07:49] *** dhyan_nat has quit IRC (Client Quit) [09:04] *** Sian1468 has joined #archiveteam-bs [09:12] *** Sian1468 has quit IRC (Read error: Connection reset by peer) [09:20] *** icedice has joined #archiveteam-bs [09:34] *** schbirid has joined #archiveteam-bs [09:42] *** tech234a has quit IRC (Quit: Connection closed for inactivity) [09:58] *** IanR has joined #archiveteam-bs [09:58] *** IanQ has quit IRC (Read error: Connection reset by peer) [10:03] *** Verified_ has quit IRC (Ping timeout: 252 seconds) [10:06] *** Verified_ has joined #archiveteam-bs [10:07] *** VerifiedJ has joined #archiveteam-bs [10:08] *** BlueMax has quit IRC (Quit: Leaving) [10:11] *** Verified_ has quit IRC (Ping timeout: 252 seconds) [10:18] *** fredgido_ has quit IRC (Read error: Operation timed out) [11:10] *** bitBaron has joined #archiveteam-bs [11:21] *** enowaldo has joined #archiveteam-bs [11:46] *** enowaldo has quit IRC (Read error: Operation timed out) [11:54] *** Smiley has joined #archiveteam-bs [11:54] *** bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…) [12:02] *** SmileyG has quit IRC (Ping timeout: 615 seconds) [12:16] *** enowaldo has joined #archiveteam-bs [12:35] *** enowaldo has quit IRC (Read error: Operation timed out) [13:08] *** glmd has quit IRC (Quit: Page closed) [13:17] *** enowaldo has joined #archiveteam-bs [13:19] *** IanR has quit IRC (Read error: Operation timed out) [13:29] *** VADemon has joined #archiveteam-bs [13:34] *** netsound has quit IRC (Quit: Leaving) [14:10] *** Zerote has joined #archiveteam-bs [14:53] Soo, my sola.ai scrape is done, and this thing is larger than expected. [14:53] I generated a list of 2.8 million URLs for user profiles, posts, and some other things. [14:54] I'm not sure ArchiveBot will be able to grab that in time. [14:54] (Shutdown date is the 10th.) [15:04] Split them into different parts? [15:04] 100k per list? [15:04] JAA: Or I can spin up a hetzner cloud instance for this grab? [15:14] s/a/multiple [16:24] *** enowaldo has quit IRC (Ping timeout: 265 seconds) [16:43] *** VerifiedJ has quit IRC (Ping timeout: 252 seconds) [16:46] *** Stilett0 has joined #archiveteam-bs [16:49] *** Stiletto has quit IRC (Read error: Operation timed out) [16:54] *** Stilett0 has quit IRC (Read error: Operation timed out) [17:00] *** Stiletto has joined #archiveteam-bs [17:02] kiska: Just grabbing those users wouldn't be a problem. But the list is almost certainly incomplete, so my plan was to do an !a < job. That can't be split up, and it would most certainly get bigger. [17:03] I gave you access to 2 servers should be sufficient... [17:03] Cool, thanks. I'll think about how to do this. [17:04] *** tech234a has joined #archiveteam-bs [17:04] How many more servers do we require? I can get more hetzner instances running [17:08] The issue is more the coordination between servers, since it basically has to be a recursive crawl. [17:11] *** enowaldo has joined #archiveteam-bs [17:11] Well I'll leave it up to you, however the sooner we can get the grab started the more content we can grab [17:14] Yeah [17:14] Maybe it's finally time for my distributed version of wpull. [17:15] Well 4 servers have been delivered, so do what you will with them, but I will be terminating them after the 10th.(Shutdown date) [17:16] Yep, thanks a lot! [17:16] *** enowaldo has quit IRC (Read error: Operation timed out) [17:16] I'll terminate them early if they exceed 20TB of hetzner cloud [17:51] JAA: we lost about 300GiB in a Raid 0 failure and 30TiB when a server that was given to us was terminated [17:52] So there should be 1.36PiB once all of it is at IA [17:54] The first paragraph of the "HISTORY IS OUR FUTURE" blurb on the main page abruptly switches from third- to first-person point of view. I would like to recommend some changes for the main wiki page (https://www.archiveteam.org/index.php?title=Main_Page). [17:55] kiska: didnt we realise what was lost on LDN [17:55] and re get it? [17:59] yeah I'm pretty sure some of that was the final batch [18:04] Yeah last batch so I have no clue how much of the last batch did finish since we got the login page and stuff [18:06] *** Hani has quit IRC (Ping timeout: 252 seconds) [18:16] *** enowaldo has joined #archiveteam-bs [18:36] *** Hani has joined #archiveteam-bs [18:38] *** ndiddy has joined #archiveteam-bs [18:46] *** Hani111 has joined #archiveteam-bs [18:46] *** Hani has quit IRC (Ping timeout: 246 seconds) [18:46] *** Hani111 is now known as Hani [18:53] *** Odd0002_ has joined #archiveteam-bs [18:54] *** Odd0002 has quit IRC (Ping timeout: 252 seconds) [18:54] *** Odd0002_ is now known as Odd0002 [19:01] *** enowaldo has quit IRC (Read error: Operation timed out) [19:05] *** enowaldo has joined #archiveteam-bs [19:31] *** Gfy has quit IRC (Read error: Connection reset by peer) [19:39] *** Gfy has joined #archiveteam-bs [19:46] *** Hani111 has joined #archiveteam-bs [19:46] *** Hani has quit IRC (Ping timeout: 259 seconds) [19:46] *** Hani111 is now known as Hani [20:21] *** bitBaron has joined #archiveteam-bs [20:28] *** bitBaron has quit IRC (Read error: Connection reset by peer) [20:28] *** bitBaron has joined #archiveteam-bs [20:45] *** Verified_ has joined #archiveteam-bs [20:52] *** eientei95 has quit IRC (Remote host closed the connection) [20:53] *** eientei95 has joined #archiveteam-bs [20:53] *** svchfoo1 sets mode: +o eientei95 [20:53] *** svchfoo3 sets mode: +o eientei95 [20:54] JAA: Wanna write a warrior project for sola.ai? If you can't get your distributed thing up in time [21:02] *** Hani111 has joined #archiveteam-bs [21:02] *** Hani has quit IRC (Read error: Operation timed out) [21:02] *** Hani111 is now known as Hani [21:14] kiska: Won't have time for that unfortunately. I have to delay the wpull setup until tomorrow morning as well. But if you or someone else wants to do it, absolutely. [21:16] On that note, I'll be mostly gone for the next week. [21:18] *** Verified_ has quit IRC (Ping timeout: 252 seconds) [21:21] *** Verified_ has joined #archiveteam-bs [21:22] *** LowLevelM has joined #archiveteam-bs [21:23] What’s new? [21:36] *** Stiletto has quit IRC (Ping timeout: 246 seconds) [21:37] *** Stiletto has joined #archiveteam-bs [21:48] people are trying to do: facepunch, reddit, and sola.ai [21:51] I started working on 3 things; thingiverse-grab, WarriorBox, and an archive team newsletter idea. [21:56] *** enowaldo has quit IRC (Read error: Operation timed out) [22:08] *** BlueMax has joined #archiveteam-bs [22:19] *** LowLevelM has quit IRC (Remote host closed the connection) [22:29] *** enowaldo has joined #archiveteam-bs [22:39] *** enowaldo has quit IRC (Ping timeout: 268 seconds) [22:47] *** kode54 has quit IRC (Quit: ZNC 1.7.2 - https://znc.in) [22:47] *** fredgido has joined #archiveteam-bs [23:04] *** Sgeo__ has joined #archiveteam-bs [23:05] *** Sgeo_ has quit IRC (Read error: Operation timed out) [23:42] *** bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…) [23:49] *** ndiddy has quit IRC () [23:58] *** godane has joined #archiveteam-bs