#archiveteam-bs 2019-04-06,Sat

↑back Search

Time Nickname Message
00:07 πŸ”— enowaldo has quit IRC (Ping timeout: 268 seconds)
00:19 πŸ”— Odd0002_ has joined #archiveteam-bs
00:20 πŸ”— IanQ has quit IRC (Ping timeout: 604 seconds)
00:26 πŸ”— Odd0002 has quit IRC (Ping timeout: 615 seconds)
00:26 πŸ”— Odd0002_ is now known as Odd0002
00:48 πŸ”— bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴πŸ˜ͺZZZzzz…)
00:51 πŸ”— enowaldo has joined #archiveteam-bs
00:59 πŸ”— sec^nd has quit IRC (Remote host closed the connection)
01:02 πŸ”— killsushi has joined #archiveteam-bs
01:25 πŸ”— icedice has joined #archiveteam-bs
01:27 πŸ”— enowaldo has quit IRC (Read error: Operation timed out)
01:32 πŸ”— monika has quit IRC (Remote host closed the connection)
01:53 πŸ”— enowaldo has joined #archiveteam-bs
02:06 πŸ”— enowaldo has quit IRC (Read error: Operation timed out)
03:09 πŸ”— VADemon has quit IRC (Read error: Connection reset by peer)
03:11 πŸ”— second has joined #archiveteam-bs
03:14 πŸ”— second is now known as sec^nd
03:20 πŸ”— enowaldo has joined #archiveteam-bs
03:27 πŸ”— godane SketchCow: i'm uploading retronauts episodes from 2009 to 2013
03:28 πŸ”— godane luckly the first 100 episode was upload but doesn't stuff past 2010 from what i can tell: https://archive.org/details/Retronauts1-100
03:28 πŸ”— odemg has quit IRC (Ping timeout: 615 seconds)
03:34 πŸ”— enowaldo has quit IRC (Ping timeout: 252 seconds)
03:35 πŸ”— dhyan_nat has joined #archiveteam-bs
03:36 πŸ”— qw3rty115 has joined #archiveteam-bs
03:41 πŸ”— qw3rty114 has quit IRC (Read error: Operation timed out)
03:52 πŸ”— glmd has joined #archiveteam-bs
03:52 πŸ”— glmd So what's the plan with Facepunch?
03:56 πŸ”— tech234a ^ As previously mentioned on #archivebot: Some people have mentioned that the forum https://forum.facepunch.com/ is endangered (see https://www.reddit.com/r/Archiveteam/comments/b7avru/facepunch_studios_garrys_mod_rust_forums_are_very/). I'm not sure if it is too large for ArchiveBot though - the site claims "433,628 registered users have made 32,593,609 posts in 756,985 threads."
03:56 πŸ”— tech234a I know some people interested in working on this project. What is the proposal process?
03:58 πŸ”— glmd What are we gling to do about it?
04:03 πŸ”— Despatche has joined #archiveteam-bs
04:06 πŸ”— enowaldo has joined #archiveteam-bs
04:10 πŸ”— marked I see, 49k threads averaging 23 posts per thread
04:11 πŸ”— marked wait, where are your numbers from?
04:11 πŸ”— glmd So, what are we planning to do about it?
04:12 πŸ”— marked my fault, I was in a sub forum
04:12 πŸ”— glmd marked, I presume that reddit post.
04:16 πŸ”— enowaldo has quit IRC (Read error: Operation timed out)
04:17 πŸ”— marked the two hardest parts of the process are choosing a channel name and someone needs to write the grab script
04:17 πŸ”— glmd Heh. Fusl set up a grab site I think.
04:18 πŸ”— Fusl yeah its not grabbing much more than the archivebot jobs though
04:18 πŸ”— tech234a I propose # faceplant
04:19 πŸ”— glmd So where do we start on making a Warrior?
04:19 πŸ”— Fusl #faceplant
04:19 πŸ”— kiska #facepalm ?
04:19 πŸ”— Fusl whatever it will be ill be there
04:20 πŸ”— glmd facepalm sounds nice.
04:20 πŸ”— glmd So is this a thing that's going to happen?
04:21 πŸ”— Fusl well i am in for making it happen unless arkiver wants to hop in and write lua
04:22 πŸ”— kiska Fusl: #whoisthis4chan
04:22 πŸ”— marked arkiver is already in the middle of reddit
04:23 πŸ”— glmd Really? That's where you're going?
04:23 πŸ”— Fusl glmd: just ignore marked
04:24 πŸ”— Fusl marked: reddit is not on fire, fp forums is
04:24 πŸ”— kiska I am unfortunately I coughing up blood, so I am unable to create the necessary scripts
04:24 πŸ”— kiska I'll be back in about 2-3 hours
04:25 πŸ”— * kiska is unwell, brb
04:25 πŸ”— marked fp would be half done by the time he logs in tomorrow morning
04:26 πŸ”— glmd @Fusl: I was respknding to kiska actually.
04:28 πŸ”— Flashfire Kiska For Fucks sake your health comes first
04:29 πŸ”— marked psa: coughing up blood I believe is ER level symptom
04:30 πŸ”— glmd May want to get that looked at.
04:37 πŸ”— glmd has quit IRC (Ping timeout: 262 seconds)
04:40 πŸ”— glmd has joined #archiveteam-bs
04:41 πŸ”— arkiver can start a project for facepunch probably this weekend, looks doable
04:42 πŸ”— glmd Fusl: arkiver has stepped in.
04:43 πŸ”— IanQ has joined #archiveteam-bs
05:06 πŸ”— ndiddy has quit IRC ()
05:31 πŸ”— icedice has quit IRC (Quit: Leaving)
06:04 πŸ”— marked quorum has formed in #faceplant , direct future comments there
06:37 πŸ”— tsp_ has quit IRC (Remote host closed the connection)
06:37 πŸ”— tsp_ has joined #archiveteam-bs
06:38 πŸ”— killsushi has quit IRC (Quit: Leaving)
07:02 πŸ”— PhrackD has quit IRC (Read error: Operation timed out)
07:03 πŸ”— PhrackD has joined #archiveteam-bs
07:24 πŸ”— Exairnous has quit IRC (Ping timeout: 615 seconds)
07:34 πŸ”— godane has quit IRC (Ping timeout: 265 seconds)
07:34 πŸ”— dhyan_nat has quit IRC (Read error: Connection reset by peer)
07:34 πŸ”— dhyan_nat has joined #archiveteam-bs
07:45 πŸ”— dhyan_nat has quit IRC (Quit: Konversation terminated!)
07:45 πŸ”— dhyan_nat has joined #archiveteam-bs
07:49 πŸ”— dhyan_nat has quit IRC (Client Quit)
09:04 πŸ”— Sian1468 has joined #archiveteam-bs
09:12 πŸ”— Sian1468 has quit IRC (Read error: Connection reset by peer)
09:20 πŸ”— icedice has joined #archiveteam-bs
09:34 πŸ”— schbirid has joined #archiveteam-bs
09:42 πŸ”— tech234a has quit IRC (Quit: Connection closed for inactivity)
09:58 πŸ”— IanR has joined #archiveteam-bs
09:58 πŸ”— IanQ has quit IRC (Read error: Connection reset by peer)
10:03 πŸ”— Verified_ has quit IRC (Ping timeout: 252 seconds)
10:06 πŸ”— Verified_ has joined #archiveteam-bs
10:07 πŸ”— VerifiedJ has joined #archiveteam-bs
10:08 πŸ”— BlueMax has quit IRC (Quit: Leaving)
10:11 πŸ”— Verified_ has quit IRC (Ping timeout: 252 seconds)
10:18 πŸ”— fredgido_ has quit IRC (Read error: Operation timed out)
11:10 πŸ”— bitBaron has joined #archiveteam-bs
11:21 πŸ”— enowaldo has joined #archiveteam-bs
11:46 πŸ”— enowaldo has quit IRC (Read error: Operation timed out)
11:54 πŸ”— Smiley has joined #archiveteam-bs
11:54 πŸ”— bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴πŸ˜ͺZZZzzz…)
12:02 πŸ”— SmileyG has quit IRC (Ping timeout: 615 seconds)
12:16 πŸ”— enowaldo has joined #archiveteam-bs
12:35 πŸ”— enowaldo has quit IRC (Read error: Operation timed out)
13:08 πŸ”— glmd has quit IRC (Quit: Page closed)
13:17 πŸ”— enowaldo has joined #archiveteam-bs
13:19 πŸ”— IanR has quit IRC (Read error: Operation timed out)
13:29 πŸ”— VADemon has joined #archiveteam-bs
13:34 πŸ”— netsound has quit IRC (Quit: Leaving)
14:10 πŸ”— Zerote has joined #archiveteam-bs
14:53 πŸ”— JAA Soo, my sola.ai scrape is done, and this thing is larger than expected.
14:53 πŸ”— JAA I generated a list of 2.8 million URLs for user profiles, posts, and some other things.
14:54 πŸ”— JAA I'm not sure ArchiveBot will be able to grab that in time.
14:54 πŸ”— JAA (Shutdown date is the 10th.)
15:04 πŸ”— kiska Split them into different parts?
15:04 πŸ”— kiska 100k per list?
15:04 πŸ”— kiska JAA: Or I can spin up a hetzner cloud instance for this grab?
15:14 πŸ”— kiska s/a/multiple
16:24 πŸ”— enowaldo has quit IRC (Ping timeout: 265 seconds)
16:43 πŸ”— VerifiedJ has quit IRC (Ping timeout: 252 seconds)
16:46 πŸ”— Stilett0 has joined #archiveteam-bs
16:49 πŸ”— Stiletto has quit IRC (Read error: Operation timed out)
16:54 πŸ”— Stilett0 has quit IRC (Read error: Operation timed out)
17:00 πŸ”— Stiletto has joined #archiveteam-bs
17:02 πŸ”— JAA kiska: Just grabbing those users wouldn't be a problem. But the list is almost certainly incomplete, so my plan was to do an !a < job. That can't be split up, and it would most certainly get bigger.
17:03 πŸ”— kiska I gave you access to 2 servers should be sufficient...
17:03 πŸ”— JAA Cool, thanks. I'll think about how to do this.
17:04 πŸ”— tech234a has joined #archiveteam-bs
17:04 πŸ”— kiska How many more servers do we require? I can get more hetzner instances running
17:08 πŸ”— JAA The issue is more the coordination between servers, since it basically has to be a recursive crawl.
17:11 πŸ”— enowaldo has joined #archiveteam-bs
17:11 πŸ”— kiska Well I'll leave it up to you, however the sooner we can get the grab started the more content we can grab
17:14 πŸ”— JAA Yeah
17:14 πŸ”— JAA Maybe it's finally time for my distributed version of wpull.
17:15 πŸ”— kiska Well 4 servers have been delivered, so do what you will with them, but I will be terminating them after the 10th.(Shutdown date)
17:16 πŸ”— JAA Yep, thanks a lot!
17:16 πŸ”— enowaldo has quit IRC (Read error: Operation timed out)
17:16 πŸ”— kiska I'll terminate them early if they exceed 20TB of hetzner cloud
17:51 πŸ”— kiska JAA: we lost about 300GiB in a Raid 0 failure and 30TiB when a server that was given to us was terminated
17:52 πŸ”— kiska So there should be 1.36PiB once all of it is at IA
17:54 πŸ”— t3 The first paragraph of the "HISTORY IS OUR FUTURE" blurb on the main page abruptly switches from third- to first-person point of view. I would like to recommend some changes for the main wiki page (https://www.archiveteam.org/index.php?title=Main_Page).
17:55 πŸ”— HCross kiska: didnt we realise what was lost on LDN
17:55 πŸ”— HCross and re get it?
17:59 πŸ”— Kaz yeah I'm pretty sure some of that was the final batch
18:04 πŸ”— kiska Yeah last batch so I have no clue how much of the last batch did finish since we got the login page and stuff
18:06 πŸ”— Hani has quit IRC (Ping timeout: 252 seconds)
18:16 πŸ”— enowaldo has joined #archiveteam-bs
18:36 πŸ”— Hani has joined #archiveteam-bs
18:38 πŸ”— ndiddy has joined #archiveteam-bs
18:46 πŸ”— Hani111 has joined #archiveteam-bs
18:46 πŸ”— Hani has quit IRC (Ping timeout: 246 seconds)
18:46 πŸ”— Hani111 is now known as Hani
18:53 πŸ”— Odd0002_ has joined #archiveteam-bs
18:54 πŸ”— Odd0002 has quit IRC (Ping timeout: 252 seconds)
18:54 πŸ”— Odd0002_ is now known as Odd0002
19:01 πŸ”— enowaldo has quit IRC (Read error: Operation timed out)
19:05 πŸ”— enowaldo has joined #archiveteam-bs
19:31 πŸ”— Gfy has quit IRC (Read error: Connection reset by peer)
19:39 πŸ”— Gfy has joined #archiveteam-bs
19:46 πŸ”— Hani111 has joined #archiveteam-bs
19:46 πŸ”— Hani has quit IRC (Ping timeout: 259 seconds)
19:46 πŸ”— Hani111 is now known as Hani
20:21 πŸ”— bitBaron has joined #archiveteam-bs
20:28 πŸ”— bitBaron has quit IRC (Read error: Connection reset by peer)
20:28 πŸ”— bitBaron has joined #archiveteam-bs
20:45 πŸ”— Verified_ has joined #archiveteam-bs
20:52 πŸ”— eientei95 has quit IRC (Remote host closed the connection)
20:53 πŸ”— eientei95 has joined #archiveteam-bs
20:53 πŸ”— svchfoo1 sets mode: +o eientei95
20:53 πŸ”— svchfoo3 sets mode: +o eientei95
20:54 πŸ”— kiska JAA: Wanna write a warrior project for sola.ai? If you can't get your distributed thing up in time
21:02 πŸ”— Hani111 has joined #archiveteam-bs
21:02 πŸ”— Hani has quit IRC (Read error: Operation timed out)
21:02 πŸ”— Hani111 is now known as Hani
21:14 πŸ”— JAA kiska: Won't have time for that unfortunately. I have to delay the wpull setup until tomorrow morning as well. But if you or someone else wants to do it, absolutely.
21:16 πŸ”— JAA On that note, I'll be mostly gone for the next week.
21:18 πŸ”— Verified_ has quit IRC (Ping timeout: 252 seconds)
21:21 πŸ”— Verified_ has joined #archiveteam-bs
21:22 πŸ”— LowLevelM has joined #archiveteam-bs
21:23 πŸ”— LowLevelM What’s new?
21:36 πŸ”— Stiletto has quit IRC (Ping timeout: 246 seconds)
21:37 πŸ”— Stiletto has joined #archiveteam-bs
21:48 πŸ”— marked people are trying to do: facepunch, reddit, and sola.ai
21:51 πŸ”— LowLevelM I started working on 3 things; thingiverse-grab, WarriorBox, and an archive team newsletter idea.
21:56 πŸ”— enowaldo has quit IRC (Read error: Operation timed out)
22:08 πŸ”— BlueMax has joined #archiveteam-bs
22:19 πŸ”— LowLevelM has quit IRC (Remote host closed the connection)
22:29 πŸ”— enowaldo has joined #archiveteam-bs
22:39 πŸ”— enowaldo has quit IRC (Ping timeout: 268 seconds)
22:47 πŸ”— kode54 has quit IRC (Quit: ZNC 1.7.2 - https://znc.in)
22:47 πŸ”— fredgido has joined #archiveteam-bs
23:04 πŸ”— Sgeo__ has joined #archiveteam-bs
23:05 πŸ”— Sgeo_ has quit IRC (Read error: Operation timed out)
23:42 πŸ”— bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴πŸ˜ͺZZZzzz…)
23:49 πŸ”— ndiddy has quit IRC ()
23:58 πŸ”— godane has joined #archiveteam-bs

irclogger-viewer