[00:33] *** Somebody has joined #archiveteam [01:13] *** maelstrom has quit IRC (Quit: Leaving) [01:17] *** maelstrom has joined #archiveteam [01:21] *** Coderjoe has quit IRC (http://www.mibbit.com ajax IRC Client) [01:48] *** Coderjoe has joined #archiveteam [01:50] uh [01:50] I seem to have lost my wiki password :x [01:56] guess I'm screwed [02:31] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [02:37] *** BartoCH has joined #archiveteam [02:43] *** krazedkat has quit IRC (Quit: Leaving) [02:50] nicolas17: just make another account -- don't worry about it [02:51] (that's presuming you didn't add an email -- if you did, you can get a password reset that way) [02:51] I don't know if I did, but I can't see a "request password reset" link anywhere [02:53] ah, yeah it looks like that option is disabled [02:54] so then, yes, just make a new account [02:54] meh :P [03:36] *** pizzaiolo has quit IRC (Quit: Leaving.) [03:42] *** kristian_ has joined #archiveteam [04:07] *** jrwr has quit IRC (Remote host closed the connection) [04:12] *** sivoais_ has quit IRC (Read error: Operation timed out) [04:13] *** sivoais has joined #archiveteam [04:43] *** ravetcofx has quit IRC (Read error: Operation timed out) [04:54] *** maelstrom has quit IRC (Quit: Leaving) [04:54] *** ravetcofx has joined #archiveteam [05:06] *** Lord_Nigh has quit IRC (Ping timeout: 633 seconds) [05:12] *** Lord_Nigh has joined #archiveteam [05:26] *** ravetcofx has quit IRC (Read error: Operation timed out) [05:27] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [05:41] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [05:43] *** ravetcofx has joined #archiveteam [05:44] *** Start has quit IRC (Quit: Disconnected.) [05:47] *** Sk1d has joined #archiveteam [05:47] *** Start has joined #archiveteam [05:54] *** Lord_Nigh has joined #archiveteam [05:55] *** krazedkat has joined #archiveteam [06:08] *** nicolas17 has quit IRC (zzz) [06:37] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [06:42] *** Aranje has quit IRC (Quit: Three sheets to the wind) [06:52] *** Lord_Nigh has joined #archiveteam [06:53] *** jspiros has quit IRC (Read error: Operation timed out) [06:54] *** remsen has quit IRC (Read error: Operation timed out) [06:57] *** jspiros has joined #archiveteam [06:57] *** remsen has joined #archiveteam [06:57] *** Somebody has quit IRC (Ping timeout: 370 seconds) [07:02] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [07:12] *** Lord_Nigh has joined #archiveteam [07:31] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [07:33] *** kristian_ has quit IRC (Quit: Leaving) [07:35] *** Lord_Nigh has joined #archiveteam [08:00] *** Lord_Nigh has quit IRC (Ping timeout: 633 seconds) [08:02] *** Lord_Nigh has joined #archiveteam [08:09] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [08:30] *** atomotic has joined #archiveteam [08:30] *** remsen has quit IRC (Ping timeout: 246 seconds) [08:30] *** Coderjoe has quit IRC (http://www.mibbit.com ajax IRC Client) [08:32] *** remsen has joined #archiveteam [08:39] *** Rotab has joined #archiveteam [08:41] http://www.overpwn.com/news/241-were-closing-our-doors [08:51] *** Lord_Nigh has joined #archiveteam [08:52] *** Igloo^_^ has quit IRC (Ping timeout: 250 seconds) [08:56] *** BlueMaxim has quit IRC (Quit: Leaving) [08:57] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [09:05] *** Lord_Nigh has joined #archiveteam [09:10] *** Lord_Nigh has quit IRC (Ping timeout: 244 seconds) [09:46] *** vitzli has joined #archiveteam [09:52] *** jspiros has quit IRC (Read error: Operation timed out) [09:52] *** kurt_ has joined #archiveteam [09:54] *** signius has quit IRC (Read error: Operation timed out) [09:54] *** jspiros has joined #archiveteam [09:54] *** signius_ has quit IRC (Read error: Operation timed out) [09:54] *** signius_ has joined #archiveteam [09:55] *** signius has joined #archiveteam [09:57] *** kurt_ has quit IRC (Read error: Operation timed out) [09:58] *** Lord_Nigh has joined #archiveteam [10:06] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [10:11] *** Lord_Nigh has joined #archiveteam [10:15] *** Lord_Nigh has quit IRC (Excess Flood) [10:19] *** ravetcofx has quit IRC (Read error: Operation timed out) [10:26] *** Lord_Nigh has joined #archiveteam [10:43] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [10:45] *** _Zialus_ has joined #archiveteam [10:46] *** Zialus has quit IRC (Read error: Operation timed out) [10:50] *** Lord_Nigh has joined #archiveteam [10:57] *** swebb has quit IRC (Ping timeout: 246 seconds) [10:57] *** swebb has joined #archiveteam [11:01] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [11:04] *** pizzaiolo has joined #archiveteam [11:14] *** BartoCH has joined #archiveteam [11:21] *** dashcloud has quit IRC (Read error: Operation timed out) [11:33] *** dashcloud has joined #archiveteam [11:34] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [11:39] *** Igloo^_^ has joined #archiveteam [11:41] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [11:44] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [11:52] *** Lord_Nigh has joined #archiveteam [11:54] *** BartoCH has joined #archiveteam [12:08] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [12:09] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [12:10] *** BartoCH has joined #archiveteam [12:22] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [12:23] *** BartoCH has joined #archiveteam [12:24] *** Lord_Nigh has joined #archiveteam [12:29] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [12:32] *** Lord_Nigh has joined #archiveteam [12:33] *** RevSnowfo has joined #archiveteam [12:34] *** RevSnowfo has quit IRC (Client Quit) [12:34] *** Snowfox has joined #archiveteam [12:35] *** atomotic has joined #archiveteam [12:36] do you guys consider archiving very well-known YouTube channels? and btw hi [12:37] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [12:41] *** Lord_Nigh has quit IRC (Ping timeout: 244 seconds) [12:41] not that I care about his content much, but PewDiePie announced he will delete his channel when reaching 50 million subs to start a fresh one [12:41] and we have to admit he's one of the most-known YouTubers out there [12:43] I'm not sure though if YouTube wouldn't IP-ban anyone trying to pull all of his videos with youtube-dl [12:46] youtube-dl now handles playlists, but probably not channel URLs [12:46] *** Lord_Nigh has joined #archiveteam [12:57] Snowfox: there's an 'Uploads' playlist for every channel, does that do what you need? [12:57] it's only visible on hover, though. open the channel, hover over 'Uploads', button appears on the right. pewdiepie's: https://www.youtube.com/watch?v=rxPOFp45AIg&list=UU-lHJZR3Gqxm24_Vd_AJ5Yw [13:04] looks like a playlist URL yeah [13:06] Snowfox: I've already done PewDiePie [13:06] might even consider doing it myself for the sake of ensuring posterity, if I had some space around, he has quite a few 1080p videos there (and also the hammering) [13:06] oh, that's nice [13:06] 500GB [13:06] that's bigger than I expected [13:07] *** Lord_Nigh has quit IRC (Ping timeout: 633 seconds) [13:09] is there a regular effort around here to archive popular YT channels? or just ad hoc? [13:13] the new content guidelines and all the false Content-ID pulldowns takes a toll [13:24] I mean, we can do one off pulldowns via ArchiveBot [13:42] *** Rotab has quit IRC (Quit: http://chat.efnet.org (Session timeout)) [13:48] *** Lord_Nigh has joined #archiveteam [14:03] is there a list somewhere of the channels which are archived more or less up to date? [14:07] Archived by whom? ArchiveTeam folks or IA itself? [14:09] *** vOYtEC_ has quit IRC (Ping timeout: 260 seconds) [14:12] *** Lord_Nigh has quit IRC (Ping timeout: 961 seconds) [14:23] *** Lord_Nigh has joined #archiveteam [14:25] *** WinterFox has quit IRC (Read error: Operation timed out) [14:27] *** Lord_Nigh has quit IRC (Ping timeout: 244 seconds) [14:29] *** Lord_Nigh has joined #archiveteam [14:33] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [14:34] *** K4k_ has quit IRC (Quit: WeeChat 1.5) [14:34] *** K4k has joined #archiveteam [14:39] *** Lord_Nigh has joined #archiveteam [14:41] well ArchiveTeam. I didn't know IA specifically archives channels per se [14:53] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [15:00] *** Lord_Nigh has joined #archiveteam [15:01] *** bRick5772 has joined #archiveteam [15:03] *** Lord_Nigh has quit IRC (Excess Flood) [15:07] *** Lord_Nigh has joined #archiveteam [15:07] *** RichardG has quit IRC (Ping timeout: 506 seconds) [15:08] *** Lord_Nigh has quit IRC (Excess Flood) [15:08] *** Lord_Nigh has joined #archiveteam [15:09] *** nicolas17 has joined #archiveteam [15:13] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [15:13] *** RichardG has joined #archiveteam [15:38] *** RichardG has quit IRC (Read error: Operation timed out) [15:39] *** RichardG has joined #archiveteam [15:41] *** vitzli has quit IRC (Quit: Leaving) [15:41] *** Start has quit IRC (Quit: Disconnected.) [16:05] *** maseck has left http://quassel-irc.org - Chat comfortably. Anywhere. [16:15] *** kristian_ has joined #archiveteam [16:44] livejournal discovery requeued. [16:44] scripts for codebender are being tested now [17:08] *** VADemon has joined #archiveteam [17:37] *** Somebody has joined #archiveteam [17:41] *** ravetcofx has joined #archiveteam [18:04] *** BartoCH has joined #archiveteam [18:05] *** ravetcofx has quit IRC (Read error: Operation timed out) [18:09] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [18:13] *** BartoCH has joined #archiveteam [18:26] *** Somebody has quit IRC (Ping timeout: 370 seconds) [18:33] *** ndiddy has joined #archiveteam [18:39] *** squires has quit IRC (Remote host closed the connection) [18:43] *** squires has joined #archiveteam [19:30] https://archive.org/post/1066242/corrupt-webshots-data [19:30] Can someone look at this? [19:34] *** edadx0 has joined #archiveteam [19:39] tried from home and from a server in france. Both are cutting out very early. Got ~13mb at home and 4mb from france. possible that the warctozip service is choking on a huge megawarc? [19:40] is that supposed to be two URLs? [19:40] no [19:40] ok, trying [19:40] warctozip takes the URL of a warc as an argument [19:41] took a long time in "HTTP request sent, waiting for reply" [19:41] then it gave me a 736KB file [19:42] i got 36,7 MB [19:42] with no zip central directory [19:42] well the megawarc is 50GB [19:42] sec, seeing if I can set up warctozip locally [19:42] any service that tries on-the-fly conversion is going to choke I would think :D [19:43] 502 Proxy Error - The proxy server received an invalid response from an upstream server. [19:43] maybe an issue with the storage server, the megawarc is on? [19:44] Medowar: I tried downloading the megawarc directly and it seemed to go fine [19:44] would take 10 hours with my Internet connection though [19:47] okay, downloading locally now. [19:48] Ah, big warc = warctozip workers get killed for timing out [19:49] seek time maybe [19:53] right, this zip seems to be okay [19:54] can I PM a user on archive.org, is that even a thing [19:54] *** ndizzle has joined #archiveteam [19:58] anyone mind taking this zip off my hands? would rather not install nginx just for this file, so he can DL it [19:58] uh [19:58] php -S ~/pub 0.0.0.0/80 [19:58] or something like that [19:59] *** webchat12 has joined #archiveteam [19:59] *** webchat12 has quit IRC (Connection closed) [20:00] php -S localhost:8080 -t ~/pub/ [20:00] I'd consider installing php worse than nginx :< [20:00] heh [20:00] how big is it? [20:00] *** tomcat has joined #archiveteam [20:00] *** ndiddy has quit IRC (Read error: Operation timed out) [20:00] cd ~/pub && python -m SimpleHTTPServer 8000 [20:00] i replied asking him to come here, that should do it [20:02] edadx0: python I can do. Not sure why that didn't cross my mind when you gave me the php example. Thanks :) [20:02] I'm glad you're okay with that one because idk how to do it in ruby or perl heh [20:04] *** tomcat has quit IRC (Ping timeout: 194 seconds) [20:08] *** VADemon has quit IRC (Quit: left4dead) [20:37] *** HarryCros has joined #archiveteam [20:38] *** HarryCros is now known as HCross3 [20:54] *** HCross has quit IRC (Quit: Leaving) [20:55] *** HCross3 is now known as HCross [20:56] folks [20:56] I'm talking to the maintainer of a link shortener service [20:56] he's asking whether submitting the database of shortened links to the internet archive is enough for backing up [20:56] what are your thoughts? [20:58] *** dashcloud has quit IRC (Read error: Operation timed out) [20:59] *** dashcloud has joined #archiveteam [21:15] *** Smiley has quit IRC (Ping timeout: 250 seconds) [21:19] is it a regular backup? [21:19] because that'd be important imo [21:20] *** Smiley has joined #archiveteam [21:23] edadx0: I've only just now drew his attention for the need of archiving it [21:23] so I don't think there's any work there so far [21:23] *** hawc145 has joined #archiveteam [21:24] *** hawc145 has quit IRC (Read error: Connection reset by peer) [21:49] *** maelstrom has joined #archiveteam [22:06] *** bRick5772 has quit IRC (Quit: Leaving.) [22:11] *** dlandi has joined #archiveteam [22:21] *** brayden has quit IRC (Ping timeout: 633 seconds) [22:32] *** maelstrom has quit IRC (Ping timeout: 250 seconds) [22:43] *** Snowfox has quit IRC (Ping timeout: 268 seconds) [22:54] *** BlueMaxim has joined #archiveteam [22:58] *** vOYtEC has joined #archiveteam [23:02] *** vOYtEC has quit IRC (Ping timeout: 250 seconds) [23:10] *** vOYtEC has joined #archiveteam [23:13] scripts for codeblender are online [23:16] *** dashcloud has quit IRC (Remote host closed the connection) [23:22] *** Start has joined #archiveteam [23:24] *** brayden has joined #archiveteam [23:35] 50000 items are loaded in the tracker for codeblender [23:35] each contains 10 sketches [23:35] project is started [23:35] target is FOS [23:46] *** SN4T14_ has joined #archiveteam [23:48] *** SN4T14_ has quit IRC (Client Quit) [23:50] *** powerKitt has joined #archiveteam [23:50] http://www.independent.co.uk/news/people/pewdiepie-youtube-delete-account-subscribers-analytics-white-lily-singh-a7457171.html Well.