[00:03] *** zenguy_pc has quit IRC (Read error: Operation timed out) [00:03] *** dan- has joined #archiveteam [00:07] If you are using a warrior and want to run telenor, run the URLTeam project on it first to install the requests module. [00:09] Don't have to do that anymore ^ [00:15] *** aoierjoae has quit IRC (Ping timeout: 240 seconds) [00:18] *** zenguy_pc has joined #archiveteam [00:26] *** zenguy_pc has quit IRC (Ping timeout: 258 seconds) [00:26] *** WinterFox has quit IRC (Leaving) [00:26] *** WinterFox has joined #archiveteam [00:40] *** xk_id has quit IRC (Remote host closed the connection) [00:48] *** aaaaaaaa_ has joined #archiveteam [00:48] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [00:48] *** swebb sets mode: +o aaaaaaaa_ [00:49] *** aaaaaaaa_ is now known as aaaaaaaaa [00:51] *** xk_id has joined #archiveteam [00:59] *** andrews has joined #archiveteam [01:12] *** andrews has quit IRC (Quit: Page closed) [01:13] *** dashcloud has quit IRC (Remote host closed the connection) [01:14] *** aaaaaaaa_ has joined #archiveteam [01:14] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [01:14] *** swebb sets mode: +o aaaaaaaa_ [01:18] *** aaaaaaaa_ has quit IRC (Read error: Connection reset by peer) [01:18] *** aaaaaaaa_ has joined #archiveteam [01:18] *** swebb sets mode: +o aaaaaaaa_ [01:23] *** xk_id has quit IRC (Remote host closed the connection) [01:26] *** xk_id has joined #archiveteam [01:30] *** aaaaaaaaa has joined #archiveteam [01:30] *** aaaaaaaa_ has quit IRC (Read error: Connection reset by peer) [01:30] *** swebb sets mode: +o aaaaaaaaa [01:31] *** antonizoo has joined #archiveteam [01:49] *** zenguy_pc has joined #archiveteam [01:57] *** Fletcher has joined #archiveteam [01:57] *** diacope has joined #archiveteam [01:59] *** szalwia has joined #archiveteam [02:03] *** Atom__ has joined #archiveteam [02:06] *** zenguy_pc has quit IRC (Ping timeout: 310 seconds) [02:09] *** Atom-- has quit IRC (Ping timeout: 506 seconds) [02:17] *** Atom-- has joined #archiveteam [02:18] *** zenguy_pc has joined #archiveteam [02:19] *** primus104 has quit IRC (Leaving.) [02:24] *** vitzli has joined #archiveteam [02:24] *** Atom__ has quit IRC (Ping timeout: 506 seconds) [02:35] *** svchfoo3 has joined #archiveteam [02:37] *** aaaaaaaaa sets mode: +o svchfoo3 [02:42] *** svchfoo3 sets mode: +o GLaDOS [02:47] *** svchfoo3 sets mode: +o ohhdemgir [02:50] *** svchfoo3 sets mode: +o Smiley [02:52] *** username1 has joined #archiveteam [02:53] *** schbirid2 has quit IRC (Read error: Operation timed out) [02:57] *** svchfoo3 sets mode: +o Kazzy [03:06] *** svchfoo3 sets mode: +o Kenshin [03:18] *** zenguy_pc has quit IRC (Ping timeout: 310 seconds) [03:29] *** zenguy_pc has joined #archiveteam [03:42] *** VADemon has quit IRC (left4dead) [03:51] *** vitzli has quit IRC (Quit: Leaving) [04:15] *** aaaaaaaaa has quit IRC (Leaving) [04:30] *** _vOYtEC has quit IRC (Read error: Connection reset by peer) [04:30] *** _vOYtEC has joined #archiveteam [04:53] *** szalwia has quit IRC (Quit: leaving) [04:56] *** kniffy has quit IRC (Quit: :^)) [04:56] *** kniffy has joined #archiveteam [04:58] *** kniffy has quit IRC (Client Quit) [04:58] *** kniffy has joined #archiveteam [05:00] *** Ctrl-S has joined #archiveteam [05:00] *** Microguru has joined #archiveteam [05:03] *** jspiros has joined #archiveteam [05:04] *** kevin has joined #archiveteam [05:06] *** will__ has quit IRC (Read error: Operation timed out) [05:09] *** _vOYtEC has quit IRC (Ping timeout: 360 seconds) [05:10] *** will__ has joined #archiveteam [05:14] *** RichardG has quit IRC (Remote host closed the connection) [05:15] *** zenguy_pc has quit IRC (Read error: Operation timed out) [05:18] *** tjg has joined #archiveteam [05:20] *** jspiros has quit IRC (Ping timeout: 186 seconds) [05:27] *** jspiros has joined #archiveteam [05:31] *** zenguy_pc has joined #archiveteam [05:39] *** jspiros has quit IRC (Ping timeout: 186 seconds) [06:14] *** RichardG has joined #archiveteam [06:25] *** Ungstein has joined #archiveteam [06:49] *** Stiletto has quit IRC (Read error: Operation timed out) [07:03] *** abartov has joined #archiveteam [07:03] *** zyphlar_ has joined #archiveteam [07:04] *** Boltsie_ has joined #archiveteam [07:07] *** Atom__ has joined #archiveteam [07:11] *** JesseW has joined #archiveteam [07:12] *** Atom-- has quit IRC (Ping timeout: 506 seconds) [07:17] *** scyther has joined #archiveteam [07:17] *** zenguy_pc has quit IRC (Read error: Operation timed out) [07:22] *** Atom-- has joined #archiveteam [07:24] *** JesseW has quit IRC (Leaving.) [07:26] *** Atom-- has quit IRC (Read error: Connection reset by peer) [07:27] *** Atom-- has joined #archiveteam [07:28] *** Atom__ has quit IRC (Ping timeout: 506 seconds) [07:31] *** zenguy_pc has joined #archiveteam [07:34] *** Atom__ has joined #archiveteam [07:39] *** Atom-- has quit IRC (Ping timeout: 506 seconds) [07:45] *** bzc6p_ has joined #archiveteam [07:45] *** swebb sets mode: +o bzc6p_ [07:48] *** bzc6p has quit IRC (Read error: Operation timed out) [07:56] *** vitzli has joined #archiveteam [08:14] *** primus104 has joined #archiveteam [08:38] *** zhongfu_ is now known as zhongfu [08:45] *** Ghost_of_ has joined #archiveteam [09:20] *** zenguy_pc has quit IRC (Ping timeout: 310 seconds) [09:32] *** zenguy_pc has joined #archiveteam [09:51] *** chazchaz has joined #archiveteam [11:19] *** zenguy_pc has quit IRC (Read error: Operation timed out) [11:22] *** BlueMaxim has quit IRC (Quit: Leaving) [11:32] *** vOYtEC has joined #archiveteam [11:32] *** zenguy_pc has joined #archiveteam [11:34] *** remsen has quit IRC (Read error: Operation timed out) [12:03] *** Ghost_of_ has quit IRC (Quit: Leaving) [12:05] *** vitzli has quit IRC (Quit: Leaving) [12:30] *** Gfy has quit IRC (Read error: Operation timed out) [12:31] *** gibigian1 has quit IRC (Read error: Operation timed out) [12:31] *** gibigiana has joined #archiveteam [12:31] *** jmad980 has quit IRC (Read error: Operation timed out) [12:32] *** Smiley has quit IRC (Read error: Operation timed out) [12:32] *** jleclanch has quit IRC (Read error: Operation timed out) [12:32] *** jleclanch has joined #archiveteam [12:32] *** Coderjoe_ has quit IRC (Read error: Operation timed out) [12:32] *** Coderjoe has joined #archiveteam [12:32] *** yipdw has quit IRC (Read error: Operation timed out) [12:32] *** wutno has quit IRC (Read error: Operation timed out) [12:32] *** Famicoman has quit IRC (Read error: Operation timed out) [12:32] *** Apathy has quit IRC (Read error: Operation timed out) [12:33] *** cadbury has quit IRC (Read error: Operation timed out) [12:33] *** Emcy_ has joined #archiveteam [12:33] *** vitzli has joined #archiveteam [12:33] *** yipdw has joined #archiveteam [12:33] *** matthusby has quit IRC (Read error: Operation timed out) [12:33] *** svchfoo3 sets mode: +o yipdw [12:34] *** matthusby has joined #archiveteam [12:34] *** HCross has quit IRC (Read error: Operation timed out) [12:34] *** ats has joined #archiveteam [12:35] *** RichardG has quit IRC (Read error: Operation timed out) [12:35] *** jmad980 has joined #archiveteam [12:36] *** ats_ has quit IRC (Read error: Operation timed out) [12:36] *** superkuh has quit IRC (Excess Flood) [12:36] *** brayden_ has quit IRC (Read error: Operation timed out) [12:36] *** Emcy has quit IRC (Read error: Operation timed out) [12:36] *** RichardG has joined #archiveteam [12:36] *** superkuh has joined #archiveteam [12:37] *** mistym has quit IRC (Read error: Operation timed out) [12:37] *** mistym has joined #archiveteam [12:38] *** cvb has joined #archiveteam [12:41] *** Smiley has joined #archiveteam [12:41] *** svchfoo3 sets mode: +o Smiley [12:42] *** Silvan has joined #archiveteam [12:42] *** jk[SVP] has quit IRC (Ping timeout: 606 seconds) [12:43] *** dashcloud has joined #archiveteam [12:43] *** svchfoo3 sets mode: +o dashcloud [12:45] *** SilSte has quit IRC (Ping timeout: 606 seconds) [12:45] *** jk[SVP] has joined #archiveteam [12:46] *** vitzli has quit IRC (Quit: Leaving) [12:47] SketchCow: can you please have a look at FOS? [12:48] *** Sue_ has quit IRC (Read error: Connection reset by peer) [12:49] *** Gfy has joined #archiveteam [12:49] *** xmc has quit IRC (Ping timeout: 606 seconds) [12:52] *** xmc has joined #archiveteam [12:52] *** swebb sets mode: +o xmc [12:53] *** HarryCros is now known as HCrossOVH [12:58] FOS might be full [13:00] *** Apathy has joined #archiveteam [13:01] *** HCross has joined #archiveteam [13:01] We're gonna need a bigger boat [13:03] *** cadbury has joined #archiveteam [13:05] ersi: Some time ago SketchCow said FOS is going to home more space soon [13:07] All projects that have FOS as rsync target are paused. [13:07] does telenor use it? [13:07] no [13:08] ok [13:08] telenor uses schbirids target [13:11] So are we going to do anything about YouTube making videos private untill owners agree with the new ToS? [13:11] I think it'd be very hard to get a list of uploaders that are not going to agree with the new ToS [13:11] we should [13:12] private requires a link to access, right? [13:12] I think so [13:12] so we'd basically be trying to build an index of videos instead of actually saving videos themselves [13:15] *** remsen has joined #archiveteam [13:15] *** Sue_ has joined #archiveteam [13:17] I mailed SketchCow about the FOS issue [13:17] Ctrl-S: I think so [13:18] But downloading the videos will also be done. If uploaders don't agree with the new ToS YouTube very likely won't keep the videos forever. [13:18] if you have the capacity to, i'd like that [13:18] but an index seems like the obvious initial step either way [13:19] yes [13:19] *** zenguy_pc has quit IRC (Read error: Operation timed out) [13:19] *** luckcolor has joined #archiveteam [13:20] *** remsen has quit IRC (Read error: Connection reset by peer) [13:20] dc [13:20] cya [13:20] *** luckcolor has left [13:28] *** xk_id has quit IRC (Remote host closed the connection) [13:31] *** Stiletto has joined #archiveteam [13:32] *** WinterFox has quit IRC (Remote host closed the connection) [13:32] *** zenguy_pc has joined #archiveteam [13:36] *** scyther has quit IRC (Quit: Leaving) [13:39] *** Kksmkrn has quit IRC (Quit: leaving) [13:57] *** brayden has joined #archiveteam [13:57] *** swebb sets mode: +o brayden [14:21] *** xk_id has joined #archiveteam [14:31] Is telenor more or less done? [14:31] no [14:31] tonight I'll release an update with which we should be able to finish the whole grab [14:32] is there a place to see which urls have been grabbed [14:33] nox: everyhting will be uploaded to the Internet Archive, and then you can view the pages in the wayback machine [14:34] ok thanks [14:35] *** primus104 has quit IRC (Leaving.) [15:08] *** zenguy_pc has quit IRC (Ping timeout: 310 seconds) [15:14] *** Famicoman has joined #archiveteam [15:15] *** jleclanch has quit IRC (Remote host closed the connection) [15:15] *** jleclanch has joined #archiveteam [15:16] *** vitzli has joined #archiveteam [15:20] *** zenguy_pc has joined #archiveteam [16:10] *** SimpBrain has quit IRC (Ping timeout: 615 seconds) [16:22] *** SimpBrain has joined #archiveteam [16:52] *** username1 has quit IRC (Quit: Leaving) [16:59] *** Jordan_ has quit IRC (Read error: Operation timed out) [17:03] *** Jordan_ has joined #archiveteam [17:03] *** zerkalo has quit IRC (Write error: Broken pipe) [17:04] *** phuzion has quit IRC (Read error: Operation timed out) [17:04] *** dserodio has quit IRC (Read error: Operation timed out) [17:04] *** slyphic has quit IRC (Read error: Operation timed out) [17:04] *** phuzion has joined #archiveteam [17:04] *** SN4T14 has quit IRC (Read error: Operation timed out) [17:05] *** signius has quit IRC (Read error: Operation timed out) [17:05] *** dcmorton has quit IRC (Read error: Operation timed out) [17:05] *** filippo__ has quit IRC (Ping timeout: 255 seconds) [17:05] *** cvb has quit IRC (Read error: Operation timed out) [17:06] *** atlogbot has quit IRC (Read error: Operation timed out) [17:06] *** chazchaz has quit IRC (Read error: Operation timed out) [17:06] *** HCrossOVH has quit IRC (Read error: Operation timed out) [17:06] *** Jordan_ has quit IRC (Read error: Operation timed out) [17:07] *** Coderjoe has quit IRC (Read error: Operation timed out) [17:07] *** cvb has joined #archiveteam [17:08] *** ohhdemgir has quit IRC (Read error: Operation timed out) [17:08] *** jleclanch has quit IRC (Ping timeout: 369 seconds) [17:08] *** zerkalo has joined #archiveteam [17:08] *** filippo__ has joined #archiveteam [17:09] *** Jordan_ has joined #archiveteam [17:11] *** SimpBrain has quit IRC (Read error: Operation timed out) [17:12] *** SimpBrain has joined #archiveteam [17:12] *** jleclanch has joined #archiveteam [17:15] *** primus104 has joined #archiveteam [17:18] *** Coderjoe has joined #archiveteam [17:20] *** zenguy_pc has quit IRC (Read error: Operation timed out) [17:29] *** schbirid has joined #archiveteam [17:32] *** dcmorton has joined #archiveteam [17:32] *** HarryCros has joined #archiveteam [17:33] *** atlogbot has joined #archiveteam [17:33] *** dserodio has joined #archiveteam [17:34] *** schbirid has quit IRC (Read error: Operation timed out) [17:34] *** HarryCros is now known as HCrossOVH [17:34] *** zenguy_pc has joined #archiveteam [17:36] *** vitzli has quit IRC (Quit: Leaving) [17:38] *** schbirid has joined #archiveteam [17:38] FOS has space again it seems(?) [17:38] *** slyphic has joined #archiveteam [17:41] *** SN4T14 has joined #archiveteam [17:43] I'm still having errors uploading to FOS, specifically for the Gamefront project. [17:44] yeah, but wikis is uploading ok [17:44] *** primus104 has quit IRC (Leaving.) [17:44] maybe they are one different partitions [17:45] *** chazchaz has joined #archiveteam [17:45] nei, they are not ok [17:46] *no [17:50] *** Jordan_ has quit IRC (Read error: Operation timed out) [17:55] *** Jordan_ has joined #archiveteam [18:17] *** bisko has joined #archiveteam [18:36] *** signius has joined #archiveteam [18:41] *** bisko has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) [18:43] *** aaaaaaaaa has joined #archiveteam [18:43] *** swebb sets mode: +o aaaaaaaaa [18:45] *** bisko has joined #archiveteam [18:49] *** bisko has quit IRC (Client Quit) [18:59] *** JesseW has joined #archiveteam [19:16] *** hrcl_ has joined #archiveteam [19:21] *** zenguy_pc has quit IRC (Read error: Operation timed out) [19:26] No hurry, but in case people missed these questions I asked on #urlteam a few days ago, here's a link: http://badcheese.com/~steve/atlogs/?chan=urlteam&day=2015-10-29 [19:33] *** bzc6p_ is now known as bzc6p [19:33] JesseW: I'll join #urlteam and try to answer [19:34] bzc6p: sure [19:34] *** Jordan_ has quit IRC (Read error: Operation timed out) [19:34] *** zenguy_pc has joined #archiveteam [19:41] *** Ghost_of_ has joined #archiveteam [19:41] hi [19:41] I seem to remember a way of embedding AI books without getting the full page [19:41] not like this: http://kristian.anapnea.net/quatermass/blog/film1-danishpress/ [19:52] *** primus104 has joined #archiveteam [19:53] *** scyther has joined #archiveteam [19:57] *** Smiley has quit IRC (Remote host closed the connection) [20:03] *** Jordan_ has joined #archiveteam [20:04] *** bzc6p_ has joined #archiveteam [20:04] *** swebb sets mode: +o bzc6p_ [20:05] *** bzc6p has quit IRC (Read error: Operation timed out) [20:10] *** Smiley has joined #archiveteam [20:10] *** svchfoo3 sets mode: +o Smiley [20:13] *** Jordan__ has joined #archiveteam [20:18] *** Jordan__ has quit IRC (Client Quit) [20:21] *** hrcl_ has quit IRC () [20:28] *** svchfoo3 sets mode: +o arkiver [20:40] *** VADemon has joined #archiveteam [20:42] *** Start has quit IRC (Read error: Connection reset by peer) [20:43] *** Start has joined #archiveteam [20:47] *** jleclanch has quit IRC (Read error: Connection reset by peer) [20:51] *** jleclanch has joined #archiveteam [21:09] *** wyatt8750 has quit IRC (Remote host closed the connection) [21:11] *** wyatt8750 has joined #archiveteam [21:17] *** Ungstein has quit IRC (Quit: Leaving.) [21:17] *** scyther has quit IRC (Read error: Connection reset by peer) [21:21] *** zenguy_pc has quit IRC (Read error: Operation timed out) [21:22] *** bzc6p_ is now known as bzc6p [21:29] *** WinterFox has joined #archiveteam [21:34] *** SketchCo1 is now known as SketchCow [21:35] ON THE FOS ISSUE NOW [21:35] SOTIRED [21:35] *** zenguy_pc has joined #archiveteam [21:41] *** JesseW has quit IRC (Leaving.) [21:52] SketchCow: if you can't fix FOS right now we can wait a bit [21:52] The projects that are currently going to FOS aren't very important [21:53] important as in going away soon [21:53] *** jleclanch has quit IRC (Read error: Connection reset by peer) [21:53] *** nertzy has joined #archiveteam [21:56] *** jleclanch has joined #archiveteam [22:12] So, basically gamefront gbackedinto the bilge pump [22:13] I'm killing a few terabytes of it, after I verified that the data was uploaded safely [22:13] That'll help. [22:13] It slows down archivebot. [22:13] ok [22:14] Best way of pushing a load of video from the EU to the IA from a Windows Server? [22:16] 1. Burn the windows server [22:16] Well, its a Windows VM on a Debian server xD [22:16] *** PepsiMax has joined #archiveteam [22:17] *** schbirid has quit IRC (Quit: Leaving) [22:17] oh why [22:18] its for this twitch stream [22:19] What. twitch stream [22:19] Say bob ross say it [22:21] http://www.twitch.tv/twitchinstallsarchlinux when it finishes [22:34] SketchCow: then I'll start my 200 gamefront instances again then [22:50] *** BlueMaxim has joined #archiveteam [23:04] *** JesseW has joined #archiveteam [23:07] SketchCow: is FOS full? [23:10] FOS fills up, everything collapses :D [23:12] Sad news people. Telenor have closed their ISP hosting (We think) [23:20] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [23:21] *** zenguy_pc has quit IRC (Read error: Operation timed out) [23:22] Telenor just died. [23:23] We got a lot [23:24] And in one fell click, many 90's norwegian websites are gone [23:25] Yeah [23:25] anyone want to guestimate how many percent of it we got? [23:26] I think it must have been a very large percent [23:26] 237GB of it all [23:26] I wish we had more time for this project [23:27] Their bad loadbalancer nodes also didn't help :/ [23:27] yeah. We should have somehow bypassed them [23:28] *** yeoldeto1 has quit IRC (Ping timeout: 258 seconds) [23:30] *** yeoldetoa has joined #archiveteam [23:32] SketchCow: telenor had a timer set on the shutdown. At exactly 00:00 the website shut down... [23:33] Twatlords, that is what describes them [23:33] and its not even a shutdown... I bet its still up for the norwegian national library [23:36] *** zenguy_pc has joined #archiveteam [23:38] Timeline on telenor: [23:38] - 28th of October: We know telenor shuts down the websites [23:39] and late that evening the grab starts [23:39] - 28th of October: Great effors is started to find as many websites as possible [23:39] - 29th of October: Scripts up and running [23:41] - 29th of October: We find out their loadbalancer nodes are totally not synced. (most files up to that moment are probably useless, still have to find out exactly which) [23:43] - 30th of October: New grab is started [23:44] - 1st of November: Telenor shuts down at exactly 00:00 between 31st of October and first of November [23:45] So that's basically what happened for the telenor grab. [23:46] Judging by that synopsis, I think it is clear why they got out of the hosting business [23:47] *** cvb has quit IRC (Read error: Operation timed out) [23:47] yeah, this was not a service anyone maintained anymore [23:52] At least we know they are good at one thing: picking a good domain name. [23:52] Online? No! [23:52] haha [23:52] haha [23:53] lol [23:58] *** Ghost_of_ has quit IRC (Quit: Leaving)