[00:17] *** BlueMax has joined #archiveteam-bs [00:18] Who runs the wiki bot? If possible, can you make it so it can detect ChromeBot archive attempts? Working on the list of Deaths in 2015, a majority of the remaining websites are JS-heavy and/or HTML5 heavy - and I don't want ArchiveBot to archive them knowing that it's not suitable for JS-heavy/HTML5 heavy websites [00:53] *** Ryz has quit IRC (west.us.hub irc.Prison.NET) [00:53] *** SmileyG has quit IRC (west.us.hub irc.Prison.NET) [00:53] *** robogoat has quit IRC (west.us.hub irc.Prison.NET) [00:53] *** K4k has quit IRC (west.us.hub irc.Prison.NET) [00:53] *** wacky has quit IRC (west.us.hub irc.Prison.NET) [00:53] *** achip has quit IRC (west.us.hub irc.Prison.NET) [00:59] *** Sk1d has quit IRC (Read error: Operation timed out) [00:59] *** Ryz has joined #archiveteam-bs [00:59] *** SmileyG has joined #archiveteam-bs [00:59] *** robogoat has joined #archiveteam-bs [00:59] *** K4k has joined #archiveteam-bs [00:59] *** wacky has joined #archiveteam-bs [00:59] *** achip has joined #archiveteam-bs [01:01] *** VerifiedJ has quit IRC (Quit: Leaving) [01:04] *** Sk1d has joined #archiveteam-bs [01:22] https://www.reddit.com/r/Games/comments/9x53gy/several_games_by_telltale_are_starting_to_be/ [01:33] Someone should buy up the GOG telltale games and steam games [01:34] *** hdch has quit IRC (Read error: Operation timed out) [01:41] *** Sk1d has quit IRC (Read error: Operation timed out) [01:46] *** Sk1d has joined #archiveteam-bs [01:47] *** hdch has joined #archiveteam-bs [01:58] *** Sk1d has quit IRC (Read error: Operation timed out) [02:02] *** Sk1d has joined #archiveteam-bs [02:07] *** LFlarey has quit IRC (Ping timeout: 268 seconds) [02:15] *** Sk1d has quit IRC (Read error: Operation timed out) [02:18] *** Sk1d has joined #archiveteam-bs [02:19] *** maxiPsych has joined #archiveteam-bs [02:22] sooo... since #archiveteam is for announcements.. i'll ask in the BS, anyone done archive-warrior vm into proxmox? [02:26] ... or something along them lines [02:32] *** Sk1d has quit IRC (Read error: Operation timed out) [02:34] *** Sk1d has joined #archiveteam-bs [02:40] < ivan> that was more for SketchCow claiming everything is perfect [02:41] There's a different between "perfect" and "With over three million torrents, some have issues just like all our items have issues, but the trackers have been up solid for years now" [02:54] what is this "deaths in 2018/list"? [03:00] *** m007a83 has quit IRC (Read error: Connection reset by peer) [03:03] *** m007a83 has joined #archiveteam-bs [03:12] people that died.. in 2018 [03:13] maxiPsych: do you specifically need the warriorvm? you can just run the scripts manually in some debian/whatever vm which is going to be less of a pain than making the warrior work with proxmox [03:13] *** Sk1d has quit IRC (Read error: Operation timed out) [03:14] iirc, the warrior these days is just a docker container inside some distro, so you could just install docker and do it yourself [03:14] Also the vm image is in ova format, and you can just import the ova [03:15] fyi kiska, from yesterday: [03:15] Ive also attempted to unpack the OVA file, and convert the disk file to something proxmox can read, but i got so far until I brickwalled myself.. [03:15] 23:41:57 .. so tl;dr, i want to get ATW into proxmox, if posible [03:15] so who knows what's going on [03:15] what are these scripts? [03:16] and docker i've never knowing to have used.. [03:16] eg https://github.com/ArchiveTeam/terroroftinytown [03:16] URLTeam [03:17] each project has its own set of scripts, usually linked in the project wiki page, or the irc channel for the project [03:17] Here are the scripts for URLTeam: https://github.com/ArchiveTeam/terroroftinytown-client-grab [03:17] ive attempted to "import" the ova (unpack, pull srings from the config file) and convert to a file pmx can read.. but where to place them and how to run it was my brickwall [03:18] *** Sk1d has joined #archiveteam-bs [03:18] The one above that I linked is the tracker [03:19] maxiPsych: Try this http://www.binaryheartbeat.net/2016/05/importing-ova-container-into-proxmox.html [03:19] yep, dependancy: windows [03:20] Other than that I can't help you as I don't use Proxmox, I use ESXi [03:20] yeah, that's fine.. [03:23] https://docs.docker.com/install/linux/docker-ce/debian/#install-docker-ce [03:23] then follow the instructions on https://github.com/archiveteam/warrior-dockerfile [03:30] i'll give that a go [03:30] *** fredgido_ has quit IRC (Read error: Connection reset by peer) [03:31] *** fredgido_ has joined #archiveteam-bs [04:10] *** Martle has quit IRC (Remote host closed the connection) [04:35] *** qw3rty113 has joined #archiveteam-bs [04:41] *** qw3rty112 has quit IRC (Read error: Operation timed out) [04:50] *** odemg has quit IRC (Ping timeout: 260 seconds) [05:02] *** odemg has joined #archiveteam-bs [05:59] *** kiska has quit IRC (Ping timeout: 252 seconds) [05:59] *** logchfoo2 has quit IRC (Ping timeout: 252 seconds) [06:00] *** logchfoo3 starts logging #archiveteam-bs at Thu Nov 15 06:00:56 2018 [06:00] *** logchfoo3 has joined #archiveteam-bs [06:00] *** Flashfire has joined #archiveteam-bs [06:01] *** zerkalo has joined #archiveteam-bs [06:01] *** kiska has joined #archiveteam-bs [06:01] *** svchfoo1 sets mode: +o dxrt [06:01] *** hook54321 has joined #archiveteam-bs [06:01] *** hdch has quit IRC (Read error: Operation timed out) [06:01] *** w0rmhole has joined #archiveteam-bs [06:03] *** TC01 has joined #archiveteam-bs [06:07] *** Yurume has joined #archiveteam-bs [06:10] *** SynMonger has joined #archiveteam-bs [06:11] *** maxiPsych has quit IRC (Ping timeout: 261 seconds) [06:16] *** Sk1d has quit IRC (Read error: Operation timed out) [06:19] *** Sk1d has joined #archiveteam-bs [06:30] *** tuluu has quit IRC (Read error: Connection refused) [06:31] *** tuluu has joined #archiveteam-bs [06:36] *** hdch has joined #archiveteam-bs [06:37] *** Pixi has quit IRC (Quit: Pixi) [06:42] *** Pixi has joined #archiveteam-bs [06:53] *** PurpleSym sets mode: +oooo Aoede arkiver ivan joepie91 [06:56] *** Sk1d has quit IRC (Read error: Operation timed out) [06:56] *** LFlarey has joined #archiveteam-bs [06:57] *** zyphlar has quit IRC (Read error: Operation timed out) [06:57] *** godane has quit IRC (Ping timeout: 265 seconds) [07:00] *** zyphlar has joined #archiveteam-bs [07:00] *** Sk1d has joined #archiveteam-bs [07:11] *** godane has joined #archiveteam-bs [07:14] *** BlueMax has quit IRC (Read error: Connection reset by peer) [07:14] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [07:16] *** Lord_Nigh has joined #archiveteam-bs [07:37] *** LFlarey is now known as LFlare [07:38] *** m007a83 has quit IRC (Read error: No route to host) [07:39] *** m007a83 has joined #archiveteam-bs [07:43] *** Sk1d has quit IRC (Read error: Operation timed out) [07:47] *** Sk1d has joined #archiveteam-bs [08:00] *** hdch has quit IRC (Remote host closed the connection) [08:02] *** Sk1d has quit IRC (Read error: Operation timed out) [08:05] *** Sk1d has joined #archiveteam-bs [08:10] *** SketchCow has quit IRC (Read error: Connection reset by peer) [08:10] *** SketchCow has joined #archiveteam-bs [08:10] *** swebb sets mode: +o SketchCow [08:12] *** Stiletto has quit IRC (Ping timeout: 246 seconds) [08:12] *** Stiletto has joined #archiveteam-bs [08:53] *** Mateon1 has quit IRC (Ping timeout: 265 seconds) [08:53] *** Mateon1 has joined #archiveteam-bs [08:56] *** Sk1d has quit IRC (Read error: Operation timed out) [08:59] *** Sk1d has joined #archiveteam-bs [09:07] *** Ryz has quit IRC (Quit: ChatZilla 0.9.92-rdmsoft [XULRunner 35.0.1/20150122214805]) [09:28] *** Sk1d has quit IRC (Read error: Operation timed out) [09:29] ah man, the return of https://youtu.be/6r65WwO1-uA?t=461 [09:29] was a funny story in hindsight [09:30] less so now for some :S [09:31] *** Sk1d has joined #archiveteam-bs [09:46] *** nyaomi has quit IRC (Read error: Operation timed out) [09:50] *** SmileyG has quit IRC (Read error: Operation timed out) [10:04] *** BlueMax has joined #archiveteam-bs [10:08] *** Sk1d has quit IRC (Read error: Operation timed out) [10:13] *** Sk1d has joined #archiveteam-bs [10:22] *** nyaomi has joined #archiveteam-bs [10:26] *** Sk1d has quit IRC (Read error: Operation timed out) [10:29] *** Sk1d has joined #archiveteam-bs [10:40] *** Sk1d has quit IRC (Read error: Operation timed out) [10:41] *** BlueMax has quit IRC (Quit: Leaving) [10:45] *** Sk1d has joined #archiveteam-bs [10:56] *** TC01 has quit IRC (Read error: Operation timed out) [10:58] *** Sk1d has quit IRC (Read error: Operation timed out) [11:03] *** Sk1d has joined #archiveteam-bs [11:08] *** zyphlar has quit IRC (Read error: Operation timed out) [11:09] *** Smiley has joined #archiveteam-bs [11:11] *** zyphlar has joined #archiveteam-bs [11:16] *** Sk1d has quit IRC (Read error: Operation timed out) [11:19] *** Sk1d has joined #archiveteam-bs [12:05] *** Sk1d has quit IRC (Read error: Operation timed out) [12:09] *** Sk1d has joined #archiveteam-bs [13:29] *** godane has quit IRC (Read error: Connection reset by peer) [13:30] *** godane has joined #archiveteam-bs [13:49] *** Sk1d has quit IRC (Read error: Operation timed out) [13:52] *** Sk1d has joined #archiveteam-bs [13:55] *** Sanqui has left Leaving [13:55] *** Sanqui has joined #archiveteam-bs [14:08] *** TC01 has joined #archiveteam-bs [14:20] *** RichardG has quit IRC (Read error: Connection reset by peer) [14:20] *** RichardG has joined #archiveteam-bs [14:32] *** Sk1d has quit IRC (Read error: Operation timed out) [14:36] *** Sk1d has joined #archiveteam-bs [14:54] *** Sk1d has quit IRC (Read error: Operation timed out) [14:59] *** Sk1d has joined #archiveteam-bs [15:03] https://www.youtube.com/user/ScuzzTV Now defunct UK music channel [15:07] https://forums.castlesiegegame.com/ "The forums will be available until Dec 13, 2018, and after that, they will be archived." [15:11] If only "they will be archived" actually meant proper archival... [15:11] *** Sk1d has quit IRC (Read error: Operation timed out) [15:16] *** Sk1d has joined #archiveteam-bs [15:23] > Inbox by Gmail is going away at the end of March 2019. [15:23] Well [15:23] There it is [15:29] *** Sk1d has quit IRC (Read error: Operation timed out) [15:34] *** Sk1d has joined #archiveteam-bs [15:47] *** Sk1d has quit IRC (Read error: Operation timed out) [15:48] *** hdch has joined #archiveteam-bs [15:51] *** Sk1d has joined #archiveteam-bs [16:13] *** Martle has joined #archiveteam-bs [16:17] fuck, should have backed up Anandtech Forums before "an upgrade" [16:18] been down for 24 hours or slightly more [16:30] *** Ryz has joined #archiveteam-bs [16:37] *** Sk1d has quit IRC (Read error: Operation timed out) [16:40] *** Sk1d has joined #archiveteam-bs [17:00] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [17:02] *** VerifiedJ has joined #archiveteam-bs [17:08] *** m007a83 has joined #archiveteam-bs [17:15] *** Sk1d has quit IRC (Read error: Operation timed out) [17:18] SketchCow: i'm going to updating the Hannaford Fresh Magazine collection [17:18] *** hdch has quit IRC (Ping timeout: 265 seconds) [17:19] i'm 4+ years behind with it [17:19] also 2014 issues are going be fixed [17:19] *** Sk1d has joined #archiveteam-bs [17:59] *** icedice has joined #archiveteam-bs [18:29] *** REiN^ has quit IRC (Read error: Connection reset by peer) [18:31] *** REiN^ has joined #archiveteam-bs [18:31] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [18:38] *** icedice has quit IRC (Ping timeout: 600 seconds) [19:04] *** hook54321 has quit IRC (Quit: Connection closed for inactivity) [19:26] *** hdch has joined #archiveteam-bs [19:43] *** Sk1d has quit IRC (Read error: Operation timed out) [19:45] *** Sk1d has joined #archiveteam-bs [19:57] *** Sk1d has quit IRC (Read error: Operation timed out) [20:00] *** Sk1d has joined #archiveteam-bs [20:07] So as part of trying to archive the 2018 midterms, I scraped vote-usa.org, which has extensive candidate archives dating back to 2004. [20:08] I snscraped the twitters I found, and, after deduping with some of the other twitters that were sent along recently, have links to about 15.6 million tweets [20:08] Could this be put into archivebot, or is that too much? [20:09] #nice [20:09] i suggest splitting it into jobs of about 100k tweets each at most [20:09] which is ... about 150 jobs? [20:10] it's an irritating number but more likely to go down smoothly [20:11] Hmm alright [20:12] The other thing is I could probably remove some of the really popular twitters, like 'realDonaldTrump' [20:12] yeah but that's not going to save you much [20:12] so it might not even be worth the time [20:13] *** Sk1d has quit IRC (Read error: Operation timed out) [20:14] Yeah I guess not, grep-ing for them is giving some pretty small numbers. [20:14] *** wp494 has quit IRC (Read error: Operation timed out) [20:15] *** wp494 has joined #archiveteam-bs [20:16] *** Martle has quit IRC (Ping timeout: 252 seconds) [20:17] *** Sk1d has joined #archiveteam-bs [20:19] So should I send this list to someone else? Or split it into pieces and send it to someone else? I don't have archivebot permissions. [20:21] i suggest you make an item () out of the split-up lists of urls (as a bunch of files) and then ask someone to queue them? [20:21] it's a big job [20:21] hm [20:24] Okay sure, I'll give it a shot. [20:32] *** Sk1d has quit IRC (Read error: Operation timed out) [20:37] *** Sk1d has joined #archiveteam-bs [20:37] *** hdch has quit IRC (Ping timeout: 265 seconds) [20:54] *** Sk1d has quit IRC (Read error: Operation timed out) [20:54] *** hdch has joined #archiveteam-bs [20:56] *** Sk1d has joined #archiveteam-bs [21:09] *** Sk1d has quit IRC (Read error: Operation timed out) [21:12] *** Sk1d has joined #archiveteam-bs [21:24] *** Sk1d has quit IRC (Read error: Operation timed out) [21:28] *** Sk1d has joined #archiveteam-bs [21:41] *** Sk1d has quit IRC (Read error: Operation timed out) [21:45] *** Sk1d has joined #archiveteam-bs [22:35] *** Martle has joined #archiveteam-bs [22:52] *** hook54321 has joined #archiveteam-bs [23:09] *** Sk1d has quit IRC (Read error: Operation timed out) [23:13] *** Sk1d has joined #archiveteam-bs [23:27] *** Stiletto has quit IRC (Ping timeout: 264 seconds) [23:29] *** Stiletto has joined #archiveteam-bs [23:56] *** hdch has quit IRC (Remote host closed the connection) [23:56] *** hdch has joined #archiveteam-bs [23:58] *** Martle_ has joined #archiveteam-bs