| Time |
Nickname |
Message |
|
00:07
🔗
|
|
enowaldo has quit IRC (Ping timeout: 268 seconds) |
|
00:19
🔗
|
|
Odd0002_ has joined #archiveteam-bs |
|
00:20
🔗
|
|
IanQ has quit IRC (Ping timeout: 604 seconds) |
|
00:26
🔗
|
|
Odd0002 has quit IRC (Ping timeout: 615 seconds) |
|
00:26
🔗
|
|
Odd0002_ is now known as Odd0002 |
|
00:48
🔗
|
|
bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…) |
|
00:51
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
00:59
🔗
|
|
sec^nd has quit IRC (Remote host closed the connection) |
|
01:02
🔗
|
|
killsushi has joined #archiveteam-bs |
|
01:25
🔗
|
|
icedice has joined #archiveteam-bs |
|
01:27
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
01:32
🔗
|
|
monika has quit IRC (Remote host closed the connection) |
|
01:53
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
02:06
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
03:09
🔗
|
|
VADemon has quit IRC (Read error: Connection reset by peer) |
|
03:11
🔗
|
|
second has joined #archiveteam-bs |
|
03:14
🔗
|
|
second is now known as sec^nd |
|
03:20
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
03:27
🔗
|
godane |
SketchCow: i'm uploading retronauts episodes from 2009 to 2013 |
|
03:28
🔗
|
godane |
luckly the first 100 episode was upload but doesn't stuff past 2010 from what i can tell: https://archive.org/details/Retronauts1-100 |
|
03:28
🔗
|
|
odemg has quit IRC (Ping timeout: 615 seconds) |
|
03:34
🔗
|
|
enowaldo has quit IRC (Ping timeout: 252 seconds) |
|
03:35
🔗
|
|
dhyan_nat has joined #archiveteam-bs |
|
03:36
🔗
|
|
qw3rty115 has joined #archiveteam-bs |
|
03:41
🔗
|
|
qw3rty114 has quit IRC (Read error: Operation timed out) |
|
03:52
🔗
|
|
glmd has joined #archiveteam-bs |
|
03:52
🔗
|
glmd |
So what's the plan with Facepunch? |
|
03:56
🔗
|
tech234a |
^ As previously mentioned on #archivebot: Some people have mentioned that the forum https://forum.facepunch.com/ is endangered (see https://www.reddit.com/r/Archiveteam/comments/b7avru/facepunch_studios_garrys_mod_rust_forums_are_very/). I'm not sure if it is too large for ArchiveBot though - the site claims "433,628 registered users have made 32,593,609 posts in 756,985 threads." |
|
03:56
🔗
|
tech234a |
I know some people interested in working on this project. What is the proposal process? |
|
03:58
🔗
|
glmd |
What are we gling to do about it? |
|
04:03
🔗
|
|
Despatche has joined #archiveteam-bs |
|
04:06
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
04:10
🔗
|
marked |
I see, 49k threads averaging 23 posts per thread |
|
04:11
🔗
|
marked |
wait, where are your numbers from? |
|
04:11
🔗
|
glmd |
So, what are we planning to do about it? |
|
04:12
🔗
|
marked |
my fault, I was in a sub forum |
|
04:12
🔗
|
glmd |
marked, I presume that reddit post. |
|
04:16
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
04:17
🔗
|
marked |
the two hardest parts of the process are choosing a channel name and someone needs to write the grab script |
|
04:17
🔗
|
glmd |
Heh. Fusl set up a grab site I think. |
|
04:18
🔗
|
Fusl |
yeah its not grabbing much more than the archivebot jobs though |
|
04:18
🔗
|
tech234a |
I propose # faceplant |
|
04:19
🔗
|
glmd |
So where do we start on making a Warrior? |
|
04:19
🔗
|
Fusl |
#faceplant |
|
04:19
🔗
|
kiska |
#facepalm ? |
|
04:19
🔗
|
Fusl |
whatever it will be ill be there |
|
04:20
🔗
|
glmd |
facepalm sounds nice. |
|
04:20
🔗
|
glmd |
So is this a thing that's going to happen? |
|
04:21
🔗
|
Fusl |
well i am in for making it happen unless arkiver wants to hop in and write lua |
|
04:22
🔗
|
kiska |
Fusl: #whoisthis4chan |
|
04:22
🔗
|
marked |
arkiver is already in the middle of reddit |
|
04:23
🔗
|
glmd |
Really? That's where you're going? |
|
04:23
🔗
|
Fusl |
glmd: just ignore marked |
|
04:24
🔗
|
Fusl |
marked: reddit is not on fire, fp forums is |
|
04:24
🔗
|
kiska |
I am unfortunately I coughing up blood, so I am unable to create the necessary scripts |
|
04:24
🔗
|
kiska |
I'll be back in about 2-3 hours |
|
04:25
🔗
|
* |
kiska is unwell, brb |
|
04:25
🔗
|
marked |
fp would be half done by the time he logs in tomorrow morning |
|
04:26
🔗
|
glmd |
@Fusl: I was respknding to kiska actually. |
|
04:28
🔗
|
Flashfire |
Kiska For Fucks sake your health comes first |
|
04:29
🔗
|
marked |
psa: coughing up blood I believe is ER level symptom |
|
04:30
🔗
|
glmd |
May want to get that looked at. |
|
04:37
🔗
|
|
glmd has quit IRC (Ping timeout: 262 seconds) |
|
04:40
🔗
|
|
glmd has joined #archiveteam-bs |
|
04:41
🔗
|
arkiver |
can start a project for facepunch probably this weekend, looks doable |
|
04:42
🔗
|
glmd |
Fusl: arkiver has stepped in. |
|
04:43
🔗
|
|
IanQ has joined #archiveteam-bs |
|
05:06
🔗
|
|
ndiddy has quit IRC () |
|
05:31
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
06:04
🔗
|
marked |
quorum has formed in #faceplant , direct future comments there |
|
06:37
🔗
|
|
tsp_ has quit IRC (Remote host closed the connection) |
|
06:37
🔗
|
|
tsp_ has joined #archiveteam-bs |
|
06:38
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
|
07:02
🔗
|
|
PhrackD has quit IRC (Read error: Operation timed out) |
|
07:03
🔗
|
|
PhrackD has joined #archiveteam-bs |
|
07:24
🔗
|
|
Exairnous has quit IRC (Ping timeout: 615 seconds) |
|
07:34
🔗
|
|
godane has quit IRC (Ping timeout: 265 seconds) |
|
07:34
🔗
|
|
dhyan_nat has quit IRC (Read error: Connection reset by peer) |
|
07:34
🔗
|
|
dhyan_nat has joined #archiveteam-bs |
|
07:45
🔗
|
|
dhyan_nat has quit IRC (Quit: Konversation terminated!) |
|
07:45
🔗
|
|
dhyan_nat has joined #archiveteam-bs |
|
07:49
🔗
|
|
dhyan_nat has quit IRC (Client Quit) |
|
09:04
🔗
|
|
Sian1468 has joined #archiveteam-bs |
|
09:12
🔗
|
|
Sian1468 has quit IRC (Read error: Connection reset by peer) |
|
09:20
🔗
|
|
icedice has joined #archiveteam-bs |
|
09:34
🔗
|
|
schbirid has joined #archiveteam-bs |
|
09:42
🔗
|
|
tech234a has quit IRC (Quit: Connection closed for inactivity) |
|
09:58
🔗
|
|
IanR has joined #archiveteam-bs |
|
09:58
🔗
|
|
IanQ has quit IRC (Read error: Connection reset by peer) |
|
10:03
🔗
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
|
10:06
🔗
|
|
Verified_ has joined #archiveteam-bs |
|
10:07
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
10:08
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
10:11
🔗
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
|
10:18
🔗
|
|
fredgido_ has quit IRC (Read error: Operation timed out) |
|
11:10
🔗
|
|
bitBaron has joined #archiveteam-bs |
|
11:21
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
11:46
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
11:54
🔗
|
|
Smiley has joined #archiveteam-bs |
|
11:54
🔗
|
|
bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…) |
|
12:02
🔗
|
|
SmileyG has quit IRC (Ping timeout: 615 seconds) |
|
12:16
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
12:35
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
13:08
🔗
|
|
glmd has quit IRC (Quit: Page closed) |
|
13:17
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
13:19
🔗
|
|
IanR has quit IRC (Read error: Operation timed out) |
|
13:29
🔗
|
|
VADemon has joined #archiveteam-bs |
|
13:34
🔗
|
|
netsound has quit IRC (Quit: Leaving) |
|
14:10
🔗
|
|
Zerote has joined #archiveteam-bs |
|
14:53
🔗
|
JAA |
Soo, my sola.ai scrape is done, and this thing is larger than expected. |
|
14:53
🔗
|
JAA |
I generated a list of 2.8 million URLs for user profiles, posts, and some other things. |
|
14:54
🔗
|
JAA |
I'm not sure ArchiveBot will be able to grab that in time. |
|
14:54
🔗
|
JAA |
(Shutdown date is the 10th.) |
|
15:04
🔗
|
kiska |
Split them into different parts? |
|
15:04
🔗
|
kiska |
100k per list? |
|
15:04
🔗
|
kiska |
JAA: Or I can spin up a hetzner cloud instance for this grab? |
|
15:14
🔗
|
kiska |
s/a/multiple |
|
16:24
🔗
|
|
enowaldo has quit IRC (Ping timeout: 265 seconds) |
|
16:43
🔗
|
|
VerifiedJ has quit IRC (Ping timeout: 252 seconds) |
|
16:46
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
16:49
🔗
|
|
Stiletto has quit IRC (Read error: Operation timed out) |
|
16:54
🔗
|
|
Stilett0 has quit IRC (Read error: Operation timed out) |
|
17:00
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
17:02
🔗
|
JAA |
kiska: Just grabbing those users wouldn't be a problem. But the list is almost certainly incomplete, so my plan was to do an !a < job. That can't be split up, and it would most certainly get bigger. |
|
17:03
🔗
|
kiska |
I gave you access to 2 servers should be sufficient... |
|
17:03
🔗
|
JAA |
Cool, thanks. I'll think about how to do this. |
|
17:04
🔗
|
|
tech234a has joined #archiveteam-bs |
|
17:04
🔗
|
kiska |
How many more servers do we require? I can get more hetzner instances running |
|
17:08
🔗
|
JAA |
The issue is more the coordination between servers, since it basically has to be a recursive crawl. |
|
17:11
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
17:11
🔗
|
kiska |
Well I'll leave it up to you, however the sooner we can get the grab started the more content we can grab |
|
17:14
🔗
|
JAA |
Yeah |
|
17:14
🔗
|
JAA |
Maybe it's finally time for my distributed version of wpull. |
|
17:15
🔗
|
kiska |
Well 4 servers have been delivered, so do what you will with them, but I will be terminating them after the 10th.(Shutdown date) |
|
17:16
🔗
|
JAA |
Yep, thanks a lot! |
|
17:16
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
17:16
🔗
|
kiska |
I'll terminate them early if they exceed 20TB of hetzner cloud |
|
17:51
🔗
|
kiska |
JAA: we lost about 300GiB in a Raid 0 failure and 30TiB when a server that was given to us was terminated |
|
17:52
🔗
|
kiska |
So there should be 1.36PiB once all of it is at IA |
|
17:54
🔗
|
t3 |
The first paragraph of the "HISTORY IS OUR FUTURE" blurb on the main page abruptly switches from third- to first-person point of view. I would like to recommend some changes for the main wiki page (https://www.archiveteam.org/index.php?title=Main_Page). |
|
17:55
🔗
|
HCross |
kiska: didnt we realise what was lost on LDN |
|
17:55
🔗
|
HCross |
and re get it? |
|
17:59
🔗
|
Kaz |
yeah I'm pretty sure some of that was the final batch |
|
18:04
🔗
|
kiska |
Yeah last batch so I have no clue how much of the last batch did finish since we got the login page and stuff |
|
18:06
🔗
|
|
Hani has quit IRC (Ping timeout: 252 seconds) |
|
18:16
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
18:36
🔗
|
|
Hani has joined #archiveteam-bs |
|
18:38
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
18:46
🔗
|
|
Hani111 has joined #archiveteam-bs |
|
18:46
🔗
|
|
Hani has quit IRC (Ping timeout: 246 seconds) |
|
18:46
🔗
|
|
Hani111 is now known as Hani |
|
18:53
🔗
|
|
Odd0002_ has joined #archiveteam-bs |
|
18:54
🔗
|
|
Odd0002 has quit IRC (Ping timeout: 252 seconds) |
|
18:54
🔗
|
|
Odd0002_ is now known as Odd0002 |
|
19:01
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
19:05
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
19:31
🔗
|
|
Gfy has quit IRC (Read error: Connection reset by peer) |
|
19:39
🔗
|
|
Gfy has joined #archiveteam-bs |
|
19:46
🔗
|
|
Hani111 has joined #archiveteam-bs |
|
19:46
🔗
|
|
Hani has quit IRC (Ping timeout: 259 seconds) |
|
19:46
🔗
|
|
Hani111 is now known as Hani |
|
20:21
🔗
|
|
bitBaron has joined #archiveteam-bs |
|
20:28
🔗
|
|
bitBaron has quit IRC (Read error: Connection reset by peer) |
|
20:28
🔗
|
|
bitBaron has joined #archiveteam-bs |
|
20:45
🔗
|
|
Verified_ has joined #archiveteam-bs |
|
20:52
🔗
|
|
eientei95 has quit IRC (Remote host closed the connection) |
|
20:53
🔗
|
|
eientei95 has joined #archiveteam-bs |
|
20:53
🔗
|
|
svchfoo1 sets mode: +o eientei95 |
|
20:53
🔗
|
|
svchfoo3 sets mode: +o eientei95 |
|
20:54
🔗
|
kiska |
JAA: Wanna write a warrior project for sola.ai? If you can't get your distributed thing up in time |
|
21:02
🔗
|
|
Hani111 has joined #archiveteam-bs |
|
21:02
🔗
|
|
Hani has quit IRC (Read error: Operation timed out) |
|
21:02
🔗
|
|
Hani111 is now known as Hani |
|
21:14
🔗
|
JAA |
kiska: Won't have time for that unfortunately. I have to delay the wpull setup until tomorrow morning as well. But if you or someone else wants to do it, absolutely. |
|
21:16
🔗
|
JAA |
On that note, I'll be mostly gone for the next week. |
|
21:18
🔗
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
|
21:21
🔗
|
|
Verified_ has joined #archiveteam-bs |
|
21:22
🔗
|
|
LowLevelM has joined #archiveteam-bs |
|
21:23
🔗
|
LowLevelM |
What’s new? |
|
21:36
🔗
|
|
Stiletto has quit IRC (Ping timeout: 246 seconds) |
|
21:37
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
21:48
🔗
|
marked |
people are trying to do: facepunch, reddit, and sola.ai |
|
21:51
🔗
|
LowLevelM |
I started working on 3 things; thingiverse-grab, WarriorBox, and an archive team newsletter idea. |
|
21:56
🔗
|
|
enowaldo has quit IRC (Read error: Operation timed out) |
|
22:08
🔗
|
|
BlueMax has joined #archiveteam-bs |
|
22:19
🔗
|
|
LowLevelM has quit IRC (Remote host closed the connection) |
|
22:29
🔗
|
|
enowaldo has joined #archiveteam-bs |
|
22:39
🔗
|
|
enowaldo has quit IRC (Ping timeout: 268 seconds) |
|
22:47
🔗
|
|
kode54 has quit IRC (Quit: ZNC 1.7.2 - https://znc.in) |
|
22:47
🔗
|
|
fredgido has joined #archiveteam-bs |
|
23:04
🔗
|
|
Sgeo__ has joined #archiveteam-bs |
|
23:05
🔗
|
|
Sgeo_ has quit IRC (Read error: Operation timed out) |
|
23:42
🔗
|
|
bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…) |
|
23:49
🔗
|
|
ndiddy has quit IRC () |
|
23:58
🔗
|
|
godane has joined #archiveteam-bs |