Time |
Nickname |
Message |
00:17
🔗
|
|
BlueMax has joined #archiveteam-bs |
00:18
🔗
|
Ryz |
Who runs the wiki bot? If possible, can you make it so it can detect ChromeBot archive attempts? Working on the list of Deaths in 2015, a majority of the remaining websites are JS-heavy and/or HTML5 heavy - and I don't want ArchiveBot to archive them knowing that it's not suitable for JS-heavy/HTML5 heavy websites |
00:53
🔗
|
|
Ryz has quit IRC (west.us.hub irc.Prison.NET) |
00:53
🔗
|
|
SmileyG has quit IRC (west.us.hub irc.Prison.NET) |
00:53
🔗
|
|
robogoat has quit IRC (west.us.hub irc.Prison.NET) |
00:53
🔗
|
|
K4k has quit IRC (west.us.hub irc.Prison.NET) |
00:53
🔗
|
|
wacky has quit IRC (west.us.hub irc.Prison.NET) |
00:53
🔗
|
|
achip has quit IRC (west.us.hub irc.Prison.NET) |
00:59
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
00:59
🔗
|
|
Ryz has joined #archiveteam-bs |
00:59
🔗
|
|
SmileyG has joined #archiveteam-bs |
00:59
🔗
|
|
robogoat has joined #archiveteam-bs |
00:59
🔗
|
|
K4k has joined #archiveteam-bs |
00:59
🔗
|
|
wacky has joined #archiveteam-bs |
00:59
🔗
|
|
achip has joined #archiveteam-bs |
01:01
🔗
|
|
VerifiedJ has quit IRC (Quit: Leaving) |
01:04
🔗
|
|
Sk1d has joined #archiveteam-bs |
01:22
🔗
|
Flashfire |
https://www.reddit.com/r/Games/comments/9x53gy/several_games_by_telltale_are_starting_to_be/ |
01:33
🔗
|
Flashfire |
Someone should buy up the GOG telltale games and steam games |
01:34
🔗
|
|
hdch has quit IRC (Read error: Operation timed out) |
01:41
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
01:46
🔗
|
|
Sk1d has joined #archiveteam-bs |
01:47
🔗
|
|
hdch has joined #archiveteam-bs |
01:58
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
02:02
🔗
|
|
Sk1d has joined #archiveteam-bs |
02:07
🔗
|
|
LFlarey has quit IRC (Ping timeout: 268 seconds) |
02:15
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
02:18
🔗
|
|
Sk1d has joined #archiveteam-bs |
02:19
🔗
|
|
maxiPsych has joined #archiveteam-bs |
02:22
🔗
|
maxiPsych |
sooo... since #archiveteam is for announcements.. i'll ask in the BS, anyone done archive-warrior vm into proxmox? |
02:26
🔗
|
maxiPsych |
... or something along them lines |
02:32
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
02:34
🔗
|
|
Sk1d has joined #archiveteam-bs |
02:40
🔗
|
SketchCow |
< ivan> that was more for SketchCow claiming everything is perfect |
02:41
🔗
|
SketchCow |
There's a different between "perfect" and "With over three million torrents, some have issues just like all our items have issues, but the trackers have been up solid for years now" |
02:54
🔗
|
maxiPsych |
what is this "deaths in 2018/list"? |
03:00
🔗
|
|
m007a83 has quit IRC (Read error: Connection reset by peer) |
03:03
🔗
|
|
m007a83 has joined #archiveteam-bs |
03:12
🔗
|
Kaz |
people that died.. in 2018 |
03:13
🔗
|
Kaz |
maxiPsych: do you specifically need the warriorvm? you can just run the scripts manually in some debian/whatever vm which is going to be less of a pain than making the warrior work with proxmox |
03:13
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
03:14
🔗
|
Kaz |
iirc, the warrior these days is just a docker container inside some distro, so you could just install docker and do it yourself |
03:14
🔗
|
kiska |
Also the vm image is in ova format, and you can just import the ova |
03:15
🔗
|
Kaz |
fyi kiska, from yesterday: |
03:15
🔗
|
Kaz |
<maxiPsych> Ive also attempted to unpack the OVA file, and convert the disk file to something proxmox can read, but i got so far until I brickwalled myself.. |
03:15
🔗
|
Kaz |
23:41:57 <maxiPsych> .. so tl;dr, i want to get ATW into proxmox, if posible |
03:15
🔗
|
Kaz |
so who knows what's going on |
03:15
🔗
|
maxiPsych |
what are these scripts? |
03:16
🔗
|
maxiPsych |
and docker i've never knowing to have used.. |
03:16
🔗
|
kiska |
eg https://github.com/ArchiveTeam/terroroftinytown |
03:16
🔗
|
kiska |
URLTeam |
03:17
🔗
|
Kaz |
each project has its own set of scripts, usually linked in the project wiki page, or the irc channel for the project |
03:17
🔗
|
kiska |
Here are the scripts for URLTeam: https://github.com/ArchiveTeam/terroroftinytown-client-grab |
03:17
🔗
|
maxiPsych |
ive attempted to "import" the ova (unpack, pull srings from the config file) and convert to a file pmx can read.. but where to place them and how to run it was my brickwall |
03:18
🔗
|
|
Sk1d has joined #archiveteam-bs |
03:18
🔗
|
kiska |
The one above that I linked is the tracker |
03:19
🔗
|
kiska |
maxiPsych: Try this http://www.binaryheartbeat.net/2016/05/importing-ova-container-into-proxmox.html |
03:19
🔗
|
maxiPsych |
yep, dependancy: windows |
03:20
🔗
|
kiska |
Other than that I can't help you as I don't use Proxmox, I use ESXi |
03:20
🔗
|
maxiPsych |
yeah, that's fine.. |
03:23
🔗
|
Kaz |
https://docs.docker.com/install/linux/docker-ce/debian/#install-docker-ce |
03:23
🔗
|
Kaz |
then follow the instructions on https://github.com/archiveteam/warrior-dockerfile |
03:30
🔗
|
maxiPsych |
i'll give that a go |
03:30
🔗
|
|
fredgido_ has quit IRC (Read error: Connection reset by peer) |
03:31
🔗
|
|
fredgido_ has joined #archiveteam-bs |
04:10
🔗
|
|
Martle has quit IRC (Remote host closed the connection) |
04:35
🔗
|
|
qw3rty113 has joined #archiveteam-bs |
04:41
🔗
|
|
qw3rty112 has quit IRC (Read error: Operation timed out) |
04:50
🔗
|
|
odemg has quit IRC (Ping timeout: 260 seconds) |
05:02
🔗
|
|
odemg has joined #archiveteam-bs |
05:59
🔗
|
|
kiska has quit IRC (Ping timeout: 252 seconds) |
05:59
🔗
|
|
logchfoo2 has quit IRC (Ping timeout: 252 seconds) |
06:00
🔗
|
|
logchfoo3 starts logging #archiveteam-bs at Thu Nov 15 06:00:56 2018 |
06:00
🔗
|
|
logchfoo3 has joined #archiveteam-bs |
06:00
🔗
|
|
Flashfire has joined #archiveteam-bs |
06:01
🔗
|
|
zerkalo has joined #archiveteam-bs |
06:01
🔗
|
|
kiska has joined #archiveteam-bs |
06:01
🔗
|
|
svchfoo1 sets mode: +o dxrt |
06:01
🔗
|
|
hook54321 has joined #archiveteam-bs |
06:01
🔗
|
|
hdch has quit IRC (Read error: Operation timed out) |
06:01
🔗
|
|
w0rmhole has joined #archiveteam-bs |
06:03
🔗
|
|
TC01 has joined #archiveteam-bs |
06:07
🔗
|
|
Yurume has joined #archiveteam-bs |
06:10
🔗
|
|
SynMonger has joined #archiveteam-bs |
06:11
🔗
|
|
maxiPsych has quit IRC (Ping timeout: 261 seconds) |
06:16
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
06:19
🔗
|
|
Sk1d has joined #archiveteam-bs |
06:30
🔗
|
|
tuluu has quit IRC (Read error: Connection refused) |
06:31
🔗
|
|
tuluu has joined #archiveteam-bs |
06:36
🔗
|
|
hdch has joined #archiveteam-bs |
06:37
🔗
|
|
Pixi has quit IRC (Quit: Pixi) |
06:42
🔗
|
|
Pixi has joined #archiveteam-bs |
06:53
🔗
|
|
PurpleSym sets mode: +oooo Aoede arkiver ivan joepie91 |
06:56
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
06:56
🔗
|
|
LFlarey has joined #archiveteam-bs |
06:57
🔗
|
|
zyphlar has quit IRC (Read error: Operation timed out) |
06:57
🔗
|
|
godane has quit IRC (Ping timeout: 265 seconds) |
07:00
🔗
|
|
zyphlar has joined #archiveteam-bs |
07:00
🔗
|
|
Sk1d has joined #archiveteam-bs |
07:11
🔗
|
|
godane has joined #archiveteam-bs |
07:14
🔗
|
|
BlueMax has quit IRC (Read error: Connection reset by peer) |
07:14
🔗
|
|
Lord_Nigh has quit IRC (Read error: Operation timed out) |
07:16
🔗
|
|
Lord_Nigh has joined #archiveteam-bs |
07:37
🔗
|
|
LFlarey is now known as LFlare |
07:38
🔗
|
|
m007a83 has quit IRC (Read error: No route to host) |
07:39
🔗
|
|
m007a83 has joined #archiveteam-bs |
07:43
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
07:47
🔗
|
|
Sk1d has joined #archiveteam-bs |
08:00
🔗
|
|
hdch has quit IRC (Remote host closed the connection) |
08:02
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
08:05
🔗
|
|
Sk1d has joined #archiveteam-bs |
08:10
🔗
|
|
SketchCow has quit IRC (Read error: Connection reset by peer) |
08:10
🔗
|
|
SketchCow has joined #archiveteam-bs |
08:10
🔗
|
|
swebb sets mode: +o SketchCow |
08:12
🔗
|
|
Stiletto has quit IRC (Ping timeout: 246 seconds) |
08:12
🔗
|
|
Stiletto has joined #archiveteam-bs |
08:53
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 265 seconds) |
08:53
🔗
|
|
Mateon1 has joined #archiveteam-bs |
08:56
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
08:59
🔗
|
|
Sk1d has joined #archiveteam-bs |
09:07
🔗
|
|
Ryz has quit IRC (Quit: ChatZilla 0.9.92-rdmsoft [XULRunner 35.0.1/20150122214805]) |
09:28
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
09:29
🔗
|
ranma |
ah man, the return of https://youtu.be/6r65WwO1-uA?t=461 |
09:29
🔗
|
ranma |
was a funny story in hindsight |
09:30
🔗
|
ranma |
less so now for some :S |
09:31
🔗
|
|
Sk1d has joined #archiveteam-bs |
09:46
🔗
|
|
nyaomi has quit IRC (Read error: Operation timed out) |
09:50
🔗
|
|
SmileyG has quit IRC (Read error: Operation timed out) |
10:04
🔗
|
|
BlueMax has joined #archiveteam-bs |
10:08
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
10:13
🔗
|
|
Sk1d has joined #archiveteam-bs |
10:22
🔗
|
|
nyaomi has joined #archiveteam-bs |
10:26
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
10:29
🔗
|
|
Sk1d has joined #archiveteam-bs |
10:40
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
10:41
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
10:45
🔗
|
|
Sk1d has joined #archiveteam-bs |
10:56
🔗
|
|
TC01 has quit IRC (Read error: Operation timed out) |
10:58
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
11:03
🔗
|
|
Sk1d has joined #archiveteam-bs |
11:08
🔗
|
|
zyphlar has quit IRC (Read error: Operation timed out) |
11:09
🔗
|
|
Smiley has joined #archiveteam-bs |
11:11
🔗
|
|
zyphlar has joined #archiveteam-bs |
11:16
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
11:19
🔗
|
|
Sk1d has joined #archiveteam-bs |
12:05
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
12:09
🔗
|
|
Sk1d has joined #archiveteam-bs |
13:29
🔗
|
|
godane has quit IRC (Read error: Connection reset by peer) |
13:30
🔗
|
|
godane has joined #archiveteam-bs |
13:49
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
13:52
🔗
|
|
Sk1d has joined #archiveteam-bs |
13:55
🔗
|
|
Sanqui has left Leaving |
13:55
🔗
|
|
Sanqui has joined #archiveteam-bs |
14:08
🔗
|
|
TC01 has joined #archiveteam-bs |
14:20
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
14:20
🔗
|
|
RichardG has joined #archiveteam-bs |
14:32
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
14:36
🔗
|
|
Sk1d has joined #archiveteam-bs |
14:54
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
14:59
🔗
|
|
Sk1d has joined #archiveteam-bs |
15:03
🔗
|
eientei95 |
https://www.youtube.com/user/ScuzzTV Now defunct UK music channel |
15:07
🔗
|
eientei95 |
https://forums.castlesiegegame.com/ "The forums will be available until Dec 13, 2018, and after that, they will be archived." |
15:11
🔗
|
JAA |
If only "they will be archived" actually meant proper archival... |
15:11
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
15:16
🔗
|
|
Sk1d has joined #archiveteam-bs |
15:23
🔗
|
eientei95 |
> Inbox by Gmail is going away at the end of March 2019. |
15:23
🔗
|
eientei95 |
Well |
15:23
🔗
|
eientei95 |
There it is |
15:29
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
15:34
🔗
|
|
Sk1d has joined #archiveteam-bs |
15:47
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
15:48
🔗
|
|
hdch has joined #archiveteam-bs |
15:51
🔗
|
|
Sk1d has joined #archiveteam-bs |
16:13
🔗
|
|
Martle has joined #archiveteam-bs |
16:17
🔗
|
ranma |
fuck, should have backed up Anandtech Forums before "an upgrade" |
16:18
🔗
|
ranma |
been down for 24 hours or slightly more |
16:30
🔗
|
|
Ryz has joined #archiveteam-bs |
16:37
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
16:40
🔗
|
|
Sk1d has joined #archiveteam-bs |
17:00
🔗
|
|
m007a83 has quit IRC (Ping timeout: 252 seconds) |
17:02
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
17:08
🔗
|
|
m007a83 has joined #archiveteam-bs |
17:15
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
17:18
🔗
|
godane |
SketchCow: i'm going to updating the Hannaford Fresh Magazine collection |
17:18
🔗
|
|
hdch has quit IRC (Ping timeout: 265 seconds) |
17:19
🔗
|
godane |
i'm 4+ years behind with it |
17:19
🔗
|
godane |
also 2014 issues are going be fixed |
17:19
🔗
|
|
Sk1d has joined #archiveteam-bs |
17:59
🔗
|
|
icedice has joined #archiveteam-bs |
18:29
🔗
|
|
REiN^ has quit IRC (Read error: Connection reset by peer) |
18:31
🔗
|
|
REiN^ has joined #archiveteam-bs |
18:31
🔗
|
|
m007a83 has quit IRC (Ping timeout: 252 seconds) |
18:38
🔗
|
|
icedice has quit IRC (Ping timeout: 600 seconds) |
19:04
🔗
|
|
hook54321 has quit IRC (Quit: Connection closed for inactivity) |
19:26
🔗
|
|
hdch has joined #archiveteam-bs |
19:43
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
19:45
🔗
|
|
Sk1d has joined #archiveteam-bs |
19:57
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
20:00
🔗
|
|
Sk1d has joined #archiveteam-bs |
20:07
🔗
|
jodizzle |
So as part of trying to archive the 2018 midterms, I scraped vote-usa.org, which has extensive candidate archives dating back to 2004. |
20:08
🔗
|
jodizzle |
I snscraped the twitters I found, and, after deduping with some of the other twitters that were sent along recently, have links to about 15.6 million tweets |
20:08
🔗
|
jodizzle |
Could this be put into archivebot, or is that too much? |
20:09
🔗
|
astrid |
#nice |
20:09
🔗
|
astrid |
i suggest splitting it into jobs of about 100k tweets each at most |
20:09
🔗
|
astrid |
which is ... about 150 jobs? |
20:10
🔗
|
astrid |
it's an irritating number but more likely to go down smoothly |
20:11
🔗
|
jodizzle |
Hmm alright |
20:12
🔗
|
jodizzle |
The other thing is I could probably remove some of the really popular twitters, like 'realDonaldTrump' |
20:12
🔗
|
astrid |
yeah but that's not going to save you much |
20:12
🔗
|
astrid |
so it might not even be worth the time |
20:13
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
20:14
🔗
|
jodizzle |
Yeah I guess not, grep-ing for them is giving some pretty small numbers. |
20:14
🔗
|
|
wp494 has quit IRC (Read error: Operation timed out) |
20:15
🔗
|
|
wp494 has joined #archiveteam-bs |
20:16
🔗
|
|
Martle has quit IRC (Ping timeout: 252 seconds) |
20:17
🔗
|
|
Sk1d has joined #archiveteam-bs |
20:19
🔗
|
jodizzle |
So should I send this list to someone else? Or split it into pieces and send it to someone else? I don't have archivebot permissions. |
20:21
🔗
|
astrid |
i suggest you make an item (<https://archive.org/upload/>) out of the split-up lists of urls (as a bunch of files) and then ask someone to queue them? |
20:21
🔗
|
astrid |
it's a big job |
20:21
🔗
|
astrid |
hm |
20:24
🔗
|
jodizzle |
Okay sure, I'll give it a shot. |
20:32
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
20:37
🔗
|
|
Sk1d has joined #archiveteam-bs |
20:37
🔗
|
|
hdch has quit IRC (Ping timeout: 265 seconds) |
20:54
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
20:54
🔗
|
|
hdch has joined #archiveteam-bs |
20:56
🔗
|
|
Sk1d has joined #archiveteam-bs |
21:09
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
21:12
🔗
|
|
Sk1d has joined #archiveteam-bs |
21:24
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
21:28
🔗
|
|
Sk1d has joined #archiveteam-bs |
21:41
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
21:45
🔗
|
|
Sk1d has joined #archiveteam-bs |
22:35
🔗
|
|
Martle has joined #archiveteam-bs |
22:52
🔗
|
|
hook54321 has joined #archiveteam-bs |
23:09
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
23:13
🔗
|
|
Sk1d has joined #archiveteam-bs |
23:27
🔗
|
|
Stiletto has quit IRC (Ping timeout: 264 seconds) |
23:29
🔗
|
|
Stiletto has joined #archiveteam-bs |
23:56
🔗
|
|
hdch has quit IRC (Remote host closed the connection) |
23:56
🔗
|
|
hdch has joined #archiveteam-bs |
23:58
🔗
|
|
Martle_ has joined #archiveteam-bs |