[00:21] *** Sanqui has quit IRC (Ping timeout: 615 seconds) [00:53] *** jrwr has quit IRC (Connection closed) [00:59] So, I just paid $50 for urlte.am [01:00] Anyone who wants to throw at that or one of our things [01:05] That’s already one of our things [01:05] It redirects to the URL team tracker [01:05] But it’s appreciated all the same [01:07] Flashfire: domains are renewed annually [01:12] .. [01:55] NRA Videos now downloading [01:56] SketchCow: I think JAA started downloading them as well [01:57] Fusl did. [01:57] ah ok [01:57] http://archivebox-hel1.meo.ws/nratv/files/ [01:58] 2863 of ~22k are there [01:58] looks like the videos themselves are being put into WARCs http://archivebox-hel1.meo.ws/nratv/warcs/ [01:59] Yes [01:59] Using wpull to download the playlist and video segments, writing WARCs and plain files, then combining the files into a full video file. [01:59] ah [02:00] The idea being that it could be put in both the WBM and in IA items. [02:08] OK, then I should just delete this then [02:09] Done! (I got plenty else I could go after) [02:27] *** stapler11 has joined #archiveteam-bs [02:31] *** killsushi has quit IRC (Quit: Leaving) [03:32] *** odemgi has joined #archiveteam-bs [03:35] *** odemgi_ has quit IRC (Read error: Operation timed out) [03:35] *** odemg has quit IRC (Ping timeout: 265 seconds) [03:38] *** godane has quit IRC (Ping timeout: 252 seconds) [03:38] *** Fusl5 has joined #archiveteam-bs [03:42] *** Fusl4 has quit IRC (Read error: Operation timed out) [03:47] *** odemg has joined #archiveteam-bs [04:01] *** godane has joined #archiveteam-bs [04:07] *** systwi has joined #archiveteam-bs [04:12] *** systwi has quit IRC (Quit: Give me your HAND, and I'll help you across.) [06:10] *** wyatt8740 has joined #archiveteam-bs [06:30] *** m007a83 has quit IRC (Ping timeout: 252 seconds) [06:58] *** af10b3e5e has quit IRC (Ping timeout: 615 seconds) [07:00] *** d5f4a3622 has joined #archiveteam-bs [07:00] *** BlueMax has quit IRC (Quit: Leaving) [07:11] *** m007a83 has joined #archiveteam-bs [07:14] *** agfa has quit IRC (Read error: Operation timed out) [07:48] *** icedice has joined #archiveteam-bs [07:51] *** icedice2 has quit IRC (Ping timeout: 252 seconds) [09:37] so i uploaded 3 episodes of this japanese show : https://archive.org/details/yoicocchi-1997-12-21 [09:43] *** icedice has quit IRC (Read error: Operation timed out) [10:17] *** BlueMax has joined #archiveteam-bs [10:21] *** icedice has joined #archiveteam-bs [10:33] *** chirlu has quit IRC (Ping timeout: 255 seconds) [10:40] *** icedice has quit IRC (Remote host closed the connection) [10:56] *** BlueMax has quit IRC (Quit: Leaving) [12:24] *** enick_187 is now known as PurpleSym [12:59] *** JH88 has joined #archiveteam-bs [13:23] *** icedice has joined #archiveteam-bs [13:26] *** schbirid has joined #archiveteam-bs [14:08] lol the spam reviewer is back. [14:08] https://archive.org/details/@kozwrlqgsnqkecf [14:14] SketchCow: ^ [14:14] *** BartoCH has quit IRC (Ping timeout: 615 seconds) [14:26] *** BartoCH has joined #archiveteam-bs [14:39] *** BartoCH has quit IRC (Ping timeout: 615 seconds) [14:41] *** underscor has quit IRC (Read error: Connection reset by peer) [14:42] *** underscor has joined #archiveteam-bs [16:27] that url has come from multiple spammers too [16:27] the one in the reviews [16:45] crawler framework in go http://go-colly.org/ [16:47] some interesting bits here too http://go-colly.org/docs/best_practices/distributed/ [17:06] anarcat: problem is that go doesn't yet have a WARC library that supports writing [17:06] and actually building something that can work and act the same as the solution it's currently used (WPULL) is not easy [17:07] ah right [17:07] still, i like the design of shoving some stuff into the proxy and/or shared DB (e.g. redis) [17:07] like it would need extensive testing that ensure it doesn't get less stuff that WPULL currently manages to get [17:08] it should perform equal or better in terms of accuracy [17:08] for sure [17:08] also kinda a lot of the population here speaks python soo :) [17:08] and i mean it doesn't resolve the "chromebot" target at all [17:08] yeah [17:08] yeah ofc [17:09] i mean i know golang myself so i would be the first user around these parts to proposed a solution using go (wich i think i even did in the past lel) but yeah [17:09] anyways, just an interesting framework to start off of i guess [17:26] *** BartoCH has joined #archiveteam-bs [18:04] *** tapos has joined #archiveteam-bs [18:04] *** tapos has quit IRC (Connection closed) [18:08] *** tapos has joined #archiveteam-bs [18:31] *** godane has quit IRC (Read error: Connection reset by peer) [18:43] *** tapos has quit IRC (Quit: Leaving) [19:05] *** godane has joined #archiveteam-bs [20:11] benjins: unfortunately newspaper archives are oftentimes very commercialized these days, which puts those archives at risk. [20:15] And they're becoming more necessary as papers close down [20:37] *** d5f4a3622 has quit IRC (Ping timeout: 615 seconds) [21:16] *** killsushi has joined #archiveteam-bs [21:19] *** apache2 has quit IRC (Remote host closed the connection) [21:19] *** apache2 has joined #archiveteam-bs [21:54] *** Jens has quit IRC (Remote host closed the connection) [21:55] *** Jens has joined #archiveteam-bs [21:59] *** schbirid has quit IRC (Remote host closed the connection) [22:49] SketchCow : looks like youngstown vindicator newspaper was digitize by google: https://news.google.com/newspapers?nid=pqgf-8x9CmQC&dat=19450727&b_mode=2&hl=en [22:50] *** BlueMax has joined #archiveteam-bs [22:50] at least up to 1980s [22:58] nice [23:05] *** VerifiedJ has quit IRC (Quit: Leaving) [23:05] looks like it's missing stuff from before 1893 though [23:21] *** Dallas has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** joshua_ has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** MrRadar2 has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** Xibalba has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** brayden has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** BnAboyZ has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** sHATNER has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** Tenebrae has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** odemgi has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** stapler11 has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** h3ndr1k has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** Lord_Nigh has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** benjins has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** Atom-- has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** MillerBOS has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** Yurume has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** thejsa has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** omglolbah has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** Jon has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** pikami has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** sknebel has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** drcd has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** legoktm has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** Kenshin has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** chfoo has quit IRC (hub.efnet.us irc.efnet.nl) [23:21] *** _niklas has quit IRC (hub.efnet.us irc.efnet.nl) [23:22] *** odemgi has joined #archiveteam-bs [23:22] *** stapler11 has joined #archiveteam-bs [23:22] *** Dallas has joined #archiveteam-bs [23:22] *** joshua_ has joined #archiveteam-bs [23:22] *** h3ndr1k has joined #archiveteam-bs [23:22] *** MrRadar2 has joined #archiveteam-bs [23:22] *** Xibalba has joined #archiveteam-bs [23:22] *** brayden has joined #archiveteam-bs [23:22] *** BnAboyZ has joined #archiveteam-bs [23:22] *** sHATNER has joined #archiveteam-bs [23:22] *** Lord_Nigh has joined #archiveteam-bs [23:22] *** benjins has joined #archiveteam-bs [23:22] *** Atom-- has joined #archiveteam-bs [23:22] *** MillerBOS has joined #archiveteam-bs [23:22] *** Tenebrae has joined #archiveteam-bs [23:22] *** Yurume has joined #archiveteam-bs [23:22] *** thejsa has joined #archiveteam-bs [23:22] *** _niklas has joined #archiveteam-bs [23:22] *** chfoo has joined #archiveteam-bs [23:22] *** Kenshin has joined #archiveteam-bs [23:22] *** legoktm has joined #archiveteam-bs [23:22] *** drcd has joined #archiveteam-bs [23:22] *** sknebel has joined #archiveteam-bs [23:22] *** pikami has joined #archiveteam-bs [23:22] *** Jon has joined #archiveteam-bs [23:22] *** omglolbah has joined #archiveteam-bs [23:22] *** irc.efnet.nl sets mode: +o MrRadar2 [23:40] *** godane has quit IRC (Quit: Leaving.)