[00:00] anarcat: Nice router though. I'll likely get one as well if my current one (a FritzBox) breaks. [00:01] I keep pfSense as a VM.. it won't update any more and it's fairly broken but I haven't got round to replacing it [00:02] JAA: it's been nice since the beginning, but this is fucking annoying [00:03] it's my first LWN article, incidentally https://anarc.at/blog/2016-11-15-omnia/ [00:03] two years is a good run, but not nearly long enough [00:03] i need to find a serial cable with those pinouts... [00:04] Let's move this to #archiveteam-ot though. [00:07] i thought *this* was -ot [00:25] *** anarcat has quit IRC (Read error: Connection reset by peer) [00:26] *** anarcat has joined #archiveteam-bs [00:34] *** icedice has joined #archiveteam-bs [00:36] *** BlueMax has quit IRC (Quit: Leaving) [01:13] igglybee, hook54321: I just remembered that there's an issue already regarding SlimerJS integration into wpull, and it also links to the bugs that block this integration. Considering the state of RESOLVED WONTFIX on the Bugzilla one, SlimerJS most likely will never be available in wpull. https://github.com/ArchiveTeam/wpull/issues/229 [01:14] Oh, just saw that it was closed due to xulrunner no longer existing. So in that case, not sure what it looks like in current Firefox versions. But I guess it's still unlikely. [01:18] Did phantomjs have the same or a similar issue? [01:19] wait, no, nvm. dumb question [01:19] hook54321: Nope, PhantomJS has an option to ignore SSL errors. [01:19] And it's not based on Firefox. [01:20] yeah, realized that [01:20] I was wondering why there's a "PhantomJS parity" on the issue [01:20] *label on [01:21] *** BlueMax has joined #archiveteam-bs [01:21] *** Boppen has quit IRC (Ping timeout: 186 seconds) [01:21] *** Deewiant has quit IRC (Ping timeout: 186 seconds) [01:21] *** Aoede has quit IRC (Ping timeout: 186 seconds) [01:21] *** Boppen has joined #archiveteam-bs [01:21] *** Aoede has joined #archiveteam-bs [01:22] *** Deewiant has joined #archiveteam-bs [01:22] *** Sk1d has quit IRC (Read error: Operation timed out) [01:26] *** Sk1d has joined #archiveteam-bs [01:29] ftp://ftptest.telekom.hu/ [01:29] What is the meaning of this lol [01:33] *** Selavi has quit IRC (Quit: verb. to stop or discontinue) [01:38] *** Sk1d has quit IRC (Read error: Operation timed out) [01:40] *** Selavi has joined #archiveteam-bs [01:43] *** Sk1d has joined #archiveteam-bs [02:07] *** icedice has quit IRC (Quit: Leaving) [02:15] *** igglybee has quit IRC (Quit: Connection closed for inactivity) [03:26] *** Sk1d has quit IRC (Read error: Operation timed out) [03:29] *** Sk1d has joined #archiveteam-bs [03:41] *** Sk1d has quit IRC (Read error: Operation timed out) [03:44] *** Sk1d has joined #archiveteam-bs [03:59] *** Sk1d has quit IRC (Read error: Operation timed out) [04:01] *** Sk1d has joined #archiveteam-bs [04:44] *** qw3rty112 has joined #archiveteam-bs [04:49] *** qw3rty111 has quit IRC (Read error: Operation timed out) [04:55] *** Mateon1 has quit IRC (Ping timeout: 633 seconds) [04:55] *** Mateon1 has joined #archiveteam-bs [05:00] *** odemg has quit IRC (Ping timeout: 246 seconds) [05:13] *** odemg has joined #archiveteam-bs [05:15] https://www.archiveteam.org/index.php?title=FTP/List 130 available FTP servers not including the canadian government ones. Please can we continue this project [05:19] *** Stiletto has joined #archiveteam-bs [05:21] *** Stilett0 has quit IRC (Ping timeout: 268 seconds) [06:23] *** Sk1d has quit IRC (Read error: Operation timed out) [06:27] *** schbirid has joined #archiveteam-bs [06:28] *** Sk1d has joined #archiveteam-bs [06:41] *** Sk1d has quit IRC (Read error: Operation timed out) [06:44] *** Sk1d has joined #archiveteam-bs [07:00] *** Sk1d has quit IRC (Read error: Operation timed out) [07:02] *** Sk1d has joined #archiveteam-bs [07:15] *** Sk1d has quit IRC (Read error: Operation timed out) [07:20] *** Sk1d has joined #archiveteam-bs [07:31] latest digitize tapes and scans: https://www.patreon.com/posts/digitize-scans-22545774 [07:32] SketchCow: all of the Lotus magazine i have are scanned [07:34] *** Sk1d has quit IRC (Read error: Operation timed out) [07:36] *** decay has quit IRC (Read error: Operation timed out) [07:36] *** TC01 has quit IRC (Read error: Operation timed out) [07:36] *** decay has joined #archiveteam-bs [07:36] *** joepie91_ has quit IRC (Read error: Operation timed out) [07:36] *** svchfoo3 has quit IRC (Read error: Operation timed out) [07:36] *** mr_archiv has quit IRC (Read error: Operation timed out) [07:36] *** PurpleSym has quit IRC (Read error: Operation timed out) [07:36] *** PurpleSym has joined #archiveteam-bs [07:36] *** mr_archiv has joined #archiveteam-bs [07:36] *** joepie91 has joined #archiveteam-bs [07:37] *** Sk1d has joined #archiveteam-bs [07:37] *** svchfoo1 sets mode: +o PurpleSym [07:37] *** wacky has quit IRC (Read error: Operation timed out) [07:37] *** ReimuHaku has quit IRC (Read error: Operation timed out) [07:37] *** pikhq has quit IRC (Read error: Operation timed out) [07:37] *** Fusl_ has quit IRC (Read error: Operation timed out) [07:37] *** wacky has joined #archiveteam-bs [07:37] *** purplebot has quit IRC (Read error: Operation timed out) [07:37] *** pikhq has joined #archiveteam-bs [07:38] *** Fusl_ has joined #archiveteam-bs [07:38] *** Yurume has quit IRC (Read error: Operation timed out) [07:38] *** ReimuHaku has joined #archiveteam-bs [07:39] *** TC01 has joined #archiveteam-bs [07:40] *** Jusque has quit IRC (Read error: Operation timed out) [07:40] *** Valentine has quit IRC (Read error: Operation timed out) [07:40] *** Jusque has joined #archiveteam-bs [07:40] *** dashcloud has quit IRC (Read error: Operation timed out) [07:41] *** Yurume has joined #archiveteam-bs [07:41] *** mistym has quit IRC (Ping timeout: 506 seconds) [07:43] *** mistym has joined #archiveteam-bs [07:43] *** purplebot has joined #archiveteam-bs [07:44] *** Valentine has joined #archiveteam-bs [07:45] *** svchfoo3 has joined #archiveteam-bs [07:45] *** svchfoo1 sets mode: +o svchfoo3 [07:45] *** dashcloud has joined #archiveteam-bs [07:48] *** Sk1d has quit IRC (Read error: Operation timed out) [07:53] *** Sk1d has joined #archiveteam-bs [07:59] Sketchcow any news on the FTP project? [08:05] *** dashcloud has quit IRC (Read error: Operation timed out) [08:06] *** Sk1d has quit IRC (Read error: Operation timed out) [08:10] *** Sk1d has joined #archiveteam-bs [08:12] *** TC01 has quit IRC (Read error: Operation timed out) [08:12] *** TC01 has joined #archiveteam-bs [08:14] *** dashcloud has joined #archiveteam-bs [09:16] *** Sk1d has quit IRC (Read error: Operation timed out) [09:20] *** Sk1d has joined #archiveteam-bs [09:30] Should I keep looking for FTP sites if the project is paused? [09:35] *** Sk1d has quit IRC (Read error: Operation timed out) [09:36] *** Sk1d has joined #archiveteam-bs [09:44] this may need to be archived: http://freemusicarchive.org/member/cheyenne_h/blog/Big_Changes_Ahead_for_FMA [09:44] if not already [09:48] So they want people to use webrecorder/wayback save as... but Archive-it is getting the whole site? [09:49] *** Sk1d has quit IRC (Read error: Operation timed out) [09:52] *** Sk1d has joined #archiveteam-bs [10:00] Flashfire: Keep looking, although I thought we were scanning before, frankly [10:06] *** Sk1d has quit IRC (Read error: Operation timed out) [10:08] *** Sk1d has joined #archiveteam-bs [10:20] *** Sk1d has quit IRC (Read error: Operation timed out) [10:25] *** Sk1d has joined #archiveteam-bs [10:50] *** alex__ has quit IRC (Ping timeout: 255 seconds) [10:50] *** Darkstar has quit IRC (Read error: Connection reset by peer) [10:50] *** alex__ has joined #archiveteam-bs [10:50] *** Darkstar has joined #archiveteam-bs [11:16] *** BlueMax has quit IRC (Read error: Connection reset by peer) [11:20] should we have a wiki page for the mid-term elections? [11:27] *** VerifiedJ has joined #archiveteam-bs [11:42] *** alex__ has quit IRC (take care ye all. Have fun!) [11:47] I intend to have 500 FTP sites listed by the end of the month [11:59] betamax: Here's a list of URLs from Vote411 that weren't in the files you linked earlier: https://transfer.sh/HmR1x/more-midterm-urls.txt [12:00] There's definitely some junk, but I think a lot of it is genuine content. All links in one file (facebook, instagram, other), pre-snscrape. [12:01] I was playing around with scraping Vote411 and ended up writing a scraper that iterates through the race-index (http://onyourballot.vote411.org/race-index.do) and grabs the bio of every candidate. [12:03] Then from there, shell commands to try and get the URLs out. I think there are still some links to pull, but the above file should be the bulk of it. [12:12] Some candidates link to youtube videos/channels, those might be worth processing. [12:15] *** godane has quit IRC (Ping timeout: 255 seconds) [12:28] *** Ryz has quit IRC (Quit: ChatZilla 0.9.92-rdmsoft [XULRunner 35.0.1/20150122214805]) [12:52] *** godane has joined #archiveteam-bs [12:52] *** Sk1d has quit IRC (Read error: Operation timed out) [12:55] *** Sk1d has joined #archiveteam-bs [13:03] *** dashcloud has quit IRC (Quit: No Ping reply in 180 seconds.) [13:08] *** dashcloud has joined #archiveteam-bs [13:11] *** Sk1d has quit IRC (Read error: Operation timed out) [13:14] *** Sk1d has joined #archiveteam-bs [14:18] *** Sk1d has quit IRC (Read error: Operation timed out) [14:21] *** Sk1d has joined #archiveteam-bs [14:24] *** dashcloud has quit IRC (No Ping reply in 180 seconds.) [14:25] *** ivan has quit IRC (Leaving) [14:26] *** ivan has joined #archiveteam-bs [14:32] *** dashcloud has joined #archiveteam-bs [14:32] *** Sk1d has quit IRC (Read error: Operation timed out) [14:37] *** Sk1d has joined #archiveteam-bs [14:49] *** Sk1d has quit IRC (Read error: Operation timed out) [14:54] *** Sk1d has joined #archiveteam-bs [15:22] ivan: I linked this file in -bs as part of a conversation with betamax: https://transfer.sh/HmR1x/more-midterm-urls.txt [15:23] ah, great, thanks [15:23] wups wrong channel, that was supposed to be in -ot [15:24] Anyway, it contains some youtube URLs (videos and channels). I can try and pull more in a little bit. [15:46] *** Jusque has quit IRC (Ping timeout: 260 seconds) [15:46] *** Jusque has joined #archiveteam-bs [15:56] *** me_ has quit IRC (Read error: Operation timed out) [15:59] *** me has joined #archiveteam-bs [16:08] jodizzle: thanks, I'll focus on the facebook / instagram / twitter links [16:08] as snscrape can handle them, maybe someone else could look at thinks like youtube? [16:08] (I have a limited amount of storage) [16:38] *** Sk1d has quit IRC (Read error: Operation timed out) [16:42] *** Sk1d has joined #archiveteam-bs [17:08] *** Martle_ has joined #archiveteam-bs [17:09] *** Martle has quit IRC (Read error: Operation timed out) [17:28] *** Martle has joined #archiveteam-bs [17:29] *** Martle_ has quit IRC (Read error: Operation timed out) [17:33] *** Martle has quit IRC (Quit: Leaving) [17:33] *** Martle has joined #archiveteam-bs [17:41] *** icedice has joined #archiveteam-bs [17:59] *** Sk1d has quit IRC (Read error: Operation timed out) [18:02] *** Sk1d has joined #archiveteam-bs [18:12] betamax: I think ivan is getting the youtube links [18:17] just send me all the youtube channels you find [18:17] what's going on with youtube channels? is there a link to the project? [18:18] Martle: Just US election crazyness. [18:18] across the board, or specific focus? [18:18] s/y/i/ [18:18] ? [18:18] The former. [18:18] Campaign websites, social media accounts, and YT channels. [18:19] oh official channels? [18:19] I think so. [18:19] cool thanks [18:22] fyi hetzner cloud is beta testing some volume thing for the vms, you get 100G for free until they end the beta or something [18:30] *** Martle_ has joined #archiveteam-bs [18:34] *** Martle has quit IRC (Ping timeout: 252 seconds) [18:35] *** Martle_ has quit IRC (Client Quit) [18:35] *** Martle has joined #archiveteam-bs [18:37] *** icedice has quit IRC (Quit: Leaving) [18:38] *** icedice has joined #archiveteam-bs [18:39] *** icedice has quit IRC (Client Quit) [18:40] *** icedice has joined #archiveteam-bs [19:02] *** jspiros has quit IRC (Read error: Operation timed out) [19:07] *** jspiros has joined #archiveteam-bs [19:50] *** astrid has joined #archiveteam-bs [19:50] *** swebb sets mode: +o astrid [20:09] *** bithippo has joined #archiveteam-bs [20:12] *** bithippo has quit IRC (Client Quit) [20:14] *** wp494 has quit IRC (Ping timeout: 492 seconds) [20:14] *** wp494 has joined #archiveteam-bs [20:17] *** icedice has quit IRC (Quit: Leaving) [20:18] *** icedice has joined #archiveteam-bs [20:22] *** bithippo has joined #archiveteam-bs [20:22] *** Sk1d has quit IRC (Read error: Operation timed out) [20:26] *** Sk1d has joined #archiveteam-bs [20:40] *** Sk1d has quit IRC (Read error: Operation timed out) [20:40] *** BlueMax has joined #archiveteam-bs [20:43] *** Sk1d has joined #archiveteam-bs [21:27] *** godane has quit IRC (west.us.hub irc.mzima.net) [21:27] *** svchfoo3 has quit IRC (west.us.hub irc.mzima.net) [21:27] *** Valentine has quit IRC (west.us.hub irc.mzima.net) [21:27] *** purplebot has quit IRC (west.us.hub irc.mzima.net) [21:33] Major is no longer in archivebot [21:36] *** godane has joined #archiveteam-bs [21:36] *** svchfoo3 has joined #archiveteam-bs [21:36] *** Valentine has joined #archiveteam-bs [21:36] *** purplebot has joined #archiveteam-bs [21:36] *** irc.mzima.net sets mode: +o svchfoo3 [21:46] Ok should I seperate the canadian government FTP servers into online and offline or leave them how they are? [22:04] *** schbirid has quit IRC (Remote host closed the connection) [22:13] jodizzle: I'm having internet issues right now which mean I'm having difficulty connecting to my server [22:13] (server is fine, but my poor internet means I can't add any more files to the existing queues) [22:14] so I won't be able to get any of the links you sent in [22:14] apologies, blame Virgin [22:16] *** Sk1d has quit IRC (Read error: Operation timed out) [22:20] *** Sk1d has joined #archiveteam-bs [22:32] *** Martle has quit IRC (Ping timeout: 252 seconds) [22:32] *** Sk1d has quit IRC (Read error: Operation timed out) [22:35] betamax: Would it help if I ran snscrape over the social media links? [22:35] *** Sk1d has joined #archiveteam-bs [22:35] I could also run grab-site or something on the other websites. [22:39] I hit the jackpot of FTP lists might make 500 before the end of the year [22:41] *** Martle has joined #archiveteam-bs [23:12] *** icedice has quit IRC (Quit: Leaving) [23:38] *** Sk1d has quit IRC (Read error: Operation timed out) [23:41] *** Sk1d has joined #archiveteam-bs [23:51] *** m007a83 has quit IRC (Read error: Connection reset by peer) [23:55] *** Sk1d has quit IRC (Read error: Operation timed out) [23:58] *** Sk1d has joined #archiveteam-bs