[00:03] *** nertzy3 has joined #archiveteam [00:06] *** nertzy2 has quit IRC (Ping timeout: 310 seconds) [00:13] *** philpem has quit IRC (Ping timeout: 252 seconds) [00:26] *** BiggieJon has joined #archiveteam [00:27] *** ndiddy has quit IRC (Ping timeout: 310 seconds) [00:31] *** JesseW has joined #archiveteam [01:12] *** zenguy_pc has quit IRC (Read error: Operation timed out) [01:28] *** Wyatts has quit IRC (Read error: Connection reset by peer) [01:28] *** Wyatts has joined #archiveteam [01:40] I just did my first multi-gig upload, that was neat. Survived network changes and the laptop falling asleep, even. [01:49] myself: awesome! what did you upload? [01:50] *** primus104 has quit IRC (Leaving.) [01:52] *** Wyatts has quit IRC (Read error: Connection reset by peer) [01:54] *** Wyatts has joined #archiveteam [02:07] *** MoreWyatt has joined #archiveteam [02:07] *** Wyatts has quit IRC (Ping timeout: 506 seconds) [02:16] JesseW: https://archive.org/details/wdet_april2007 [02:17] *** kniffy has quit IRC (Ping timeout: 268 seconds) [02:21] I need to edit the readme, but otherwise it's complete [02:30] *** kniffy has joined #archiveteam [02:32] myself: nice [02:34] if you have available space, you should probably keep a copy, as it could get hidden if one of the shows complains (although I suppose that's not too likely) [02:34] you may also want to add more subjects/tags [02:35] oh I have a copy, don't worry :) had it for 8 years and drives just keep getting cheaper.. [02:35] ha. 8 years? thanks for posting it, then! [02:35] what sort of subjects/tags would you suggest? I don't have a feel for that stuff yet [02:36] well, it was the 2007 schedule-change... [02:37] i'd suggest adding some tags for the genres of music featured in each program. [02:37] for that matter, stuffing the titles of each program in the tags is probably worth doing [02:38] it was funny, when they announced the change, and that all those shows would be cancelled, my friend Mark and I both set about archiving as much as we could, in two different ways in case one didn't work. Him by recording off-the-air to minidisc, me by crawing the shit out of their streaming server, which would also let you listen to shows a few weeks old. In the end, the streaming proved more successf [02:38] ul, and the total archive was ~8 gig, just barely fit on a dual-layer DVD. I burned a few copies and gave them to some of the deeejays in the following weeks. [02:39] definitly put *that* (what you just wrote) in the description. [02:39] dj: "They... they told us they didn't have this. You have this. You made this?" me: "Yes, because the shows were worth it." dj: *tears* [02:39] it's in there in readme.txt, I'll pull that out into the descrip. Good call. [02:40] it's great to have context about how the item was made, and stories of people who cared about it. [02:40] actually, just put the *whole* readme in the description. :-) [02:40] lengthy/off-topic in #archiveteam-bs [02:41] aaaaaaaaa: thanks [02:42] * JesseW goes /join #archiveteam-bs [02:45] *** BlueMaxim has quit IRC (Read error: Operation timed out) [02:45] *** BlueMaxim has joined #archiveteam [03:19] *** ndiddy has joined #archiveteam [03:19] *** xk_id has quit IRC (Remote host closed the connection) [03:21] *** xk_id has joined #archiveteam [03:22] *** xk_id has quit IRC (Remote host closed the connection) [03:35] *** vitzli has joined #archiveteam [03:37] *** zenguy_pc has joined #archiveteam [03:39] *** bentpins has joined #archiveteam [03:46] *** MMovie1 has quit IRC (Ping timeout: 310 seconds) [03:48] *** MMovie has joined #archiveteam [03:49] *** ndiddy has quit IRC (Quit: Leaving) [03:56] *** aaaaaaaaa has quit IRC (Read error: Operation timed out) [04:10] *** JesseW has quit IRC (Read error: Operation timed out) [04:40] *** chfoo has quit IRC (Ping timeout: 310 seconds) [04:52] *** JesseW has joined #archiveteam [04:54] *** caber has quit IRC (Read error: Operation timed out) [04:55] *** caber has joined #archiveteam [04:56] *** DopefishJ has joined #archiveteam [05:00] *** DFJustin has quit IRC (Read error: Operation timed out) [05:11] *** bzc6p_ has joined #archiveteam [05:11] *** swebb sets mode: +o bzc6p_ [05:14] *** MoreWyatt is now known as Wyatts [05:16] *** bzc6p has quit IRC (Ping timeout: 600 seconds) [05:20] hello wyatts [05:38] *** zenguy_pc has quit IRC (Read error: Operation timed out) [05:54] *** zenguy_pc has joined #archiveteam [05:56] *** MrRadar_ is now known as MrRadar [06:19] *** cvb has joined #archiveteam [06:28] *** DopefishJ is now known as DFJustin [06:28] *** Dark_Star has quit IRC (Ping timeout: 606 seconds) [06:51] *** JesseW has quit IRC (Read error: Operation timed out) [07:03] *** WubTheCap has joined #archiveteam [07:03] There's a substantial amount of historically important video content in an open directory by The Wall Street Journal there: http://m.wsj.net/video/ [07:03] Could ArchiveBot grab it? [07:04] Example content: http://m.wsj.net/video/20151008/100115_hostagefulldoc3/100115_hostagefulldoc3.mp4 [07:06] *** PurpleSym has joined #archiveteam [07:12] *** Wyatts has quit IRC (Ping timeout: 252 seconds) [07:16] *** robink has quit IRC (Remote host closed the connection) [07:33] *** schbirid has joined #archiveteam [07:40] *** cvb has quit IRC (Quit: Page closed) [07:45] *** zenguy_pc has quit IRC (Read error: Operation timed out) [07:46] *** godane has quit IRC (Read error: Operation timed out) [07:49] *** Wyatts has joined #archiveteam [07:55] *** zenguy_pc has joined #archiveteam [07:56] *** godane has joined #archiveteam [08:07] *** Wyatts has quit IRC (Read error: Connection reset by peer) [08:09] *** Wyatts has joined #archiveteam [08:15] *** cvb has joined #archiveteam [08:31] *** primus104 has joined #archiveteam [08:32] *** atomotic has joined #archiveteam [08:37] WubTheCap: it could, just wondering about the size [08:52] Assuming quite large [08:52] Videos are in multiple resolutions and sizes [08:53] A 15-minute video was about 1GB there [08:53] at highest quality [08:53] Perhaps do a scrape first to get a consensus of size [09:03] *** vitzli has quit IRC (Quit: Leaving) [09:41] *** zenguy_pc has quit IRC (Read error: Operation timed out) [09:50] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [09:55] 82,000 folders in and it looks like it isn't going to be done soon here [09:55] warrior project maybe? [09:55] *** zenguy_pc has joined #archiveteam [10:38] *** lysobit has quit IRC (Quit: quit) [10:48] *** xk_id has joined #archiveteam [10:53] *** primus104 has quit IRC (Leaving.) [11:04] *** atomotic has joined #archiveteam [11:21] *** xk_id_ has joined #archiveteam [11:21] *** xk_id has quit IRC (Read error: Connection reset by peer) [11:31] *** lysobit has joined #archiveteam [11:42] *** zenguy_pc has quit IRC (Ping timeout: 258 seconds) [11:55] *** zenguy_pc has joined #archiveteam [12:05] *** arkiver6 has joined #archiveteam [12:11] *** Mayonaise has quit IRC (Read error: Operation timed out) [12:14] *** cvb has quit IRC (Ping timeout: 240 seconds) [12:19] *** Wyatts has quit IRC (Read error: Connection reset by peer) [12:21] *** cvb has joined #archiveteam [12:25] *** Wyatts has joined #archiveteam [12:49] *** arkiver6 has quit IRC (Ping timeout: 252 seconds) [12:54] *** cvb has quit IRC (Quit: Page closed) [12:57] *** zhongfu has quit IRC (Ping timeout: 360 seconds) [13:09] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [13:14] *** zhongfu has joined #archiveteam [13:26] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [13:43] *** zenguy_pc has quit IRC (Ping timeout: 258 seconds) [13:47] *** primus104 has joined #archiveteam [13:55] *** PurpleSym has quit IRC (Remote host closed the connection) [13:56] *** zenguy_pc has joined #archiveteam [14:04] *** scyther has joined #archiveteam [14:09] *** primus104 has quit IRC (Leaving.) [14:13] *** PurpleSym has joined #archiveteam [14:29] *** nwf has joined #archiveteam [14:32] *** nertzy3 has quit IRC (Quit: Leaving) [14:35] *** nertzy has joined #archiveteam [14:39] *** Wyatts has quit IRC (Ping timeout: 506 seconds) [14:44] *** Wyatts has joined #archiveteam [14:59] *** Wyatts has quit IRC (Ping timeout: 252 seconds) [15:04] *** Wyatts has joined #archiveteam [15:10] *** vitzli has joined #archiveteam [15:11] *** vtyl has quit IRC (Read error: Operation timed out) [15:13] *** lytv has joined #archiveteam [15:27] *** Elegance has quit IRC (:(){ :|:& };:) [15:28] *** Elegance has joined #archiveteam [15:28] *** Elegance has quit IRC (Connection closed) [15:28] *** Elegance has joined #archiveteam [15:28] *** Elegance has quit IRC (Connection closed) [15:29] *** Elegance has joined #archiveteam [15:42] *** zenguy_pc has quit IRC (Read error: Operation timed out) [15:50] *** xk_id_ has quit IRC (Remote host closed the connection) [15:51] *** chfoo has joined #archiveteam [15:57] *** zenguy_pc has joined #archiveteam [15:57] *** arkiver6 has joined #archiveteam [16:06] *** arkiver6 has quit IRC (Ping timeout: 252 seconds) [16:08] *** JesseW has joined #archiveteam [16:28] *** primus104 has joined #archiveteam [16:29] *** Ungstein has joined #archiveteam [16:33] *** Ungstein has quit IRC (Ping timeout: 252 seconds) [16:34] *** Ungstein has joined #archiveteam [16:44] *** JesseW has quit IRC (Read error: Operation timed out) [16:50] *** xk_id has joined #archiveteam [17:00] *** sivoais_ is now known as sivoais [17:15] *** bzc6p__ has joined #archiveteam [17:15] *** swebb sets mode: +o bzc6p__ [17:22] *** bzc6p_ has quit IRC (Ping timeout: 600 seconds) [17:33] *** Gfy has quit IRC (ircd.choopa.net irc2.choopa.net) [17:40] *** Gfy has joined #archiveteam [17:42] *** zenguy_pc has quit IRC (Read error: Operation timed out) [17:50] *** Froggypwn has quit (ircd.choopa.net irc.choopa.net) [17:50] *** Kenshin has quit (ircd.choopa.net irc.choopa.net) [17:50] *** Lord_Nigh has quit (ircd.choopa.net irc.choopa.net) [17:50] *** balrog has quit (ircd.choopa.net irc.choopa.net) [17:50] *** beardicus has quit (ircd.choopa.net irc.choopa.net) [17:50] *** bzc6p__ has quit (ircd.choopa.net irc.choopa.net) [17:50] *** chfoo-_ has quit (ircd.choopa.net irc.choopa.net) [17:50] *** dxrt has quit (ircd.choopa.net irc.choopa.net) [17:50] *** gibigiana has quit (ircd.choopa.net irc.choopa.net) [17:50] *** lbft has quit (ircd.choopa.net irc.choopa.net) [17:50] *** lrkj has quit (ircd.choopa.net irc.choopa.net) [17:50] *** marvinw_ has quit (ircd.choopa.net irc.choopa.net) [17:50] *** mr-b has quit (ircd.choopa.net irc.choopa.net) [17:50] *** myself has quit (ircd.choopa.net irc.choopa.net) [17:50] *** nwf has quit (ircd.choopa.net irc.choopa.net) [17:50] *** rduser has quit (ircd.choopa.net irc.choopa.net) [17:50] *** rizzzz has quit (ircd.choopa.net irc.choopa.net) [17:50] *** sivoais has quit (ircd.choopa.net irc.choopa.net) [17:50] *** toad2 has quit (ircd.choopa.net irc.choopa.net) [17:50] *** w0rp has quit (ircd.choopa.net irc.choopa.net) [17:50] *** will has quit (ircd.choopa.net irc.choopa.net) [17:50] *** xk_id has quit (ircd.choopa.net irc.choopa.net) [17:50] *** Gfy has quit (ircd.choopa.net irc2.choopa.net) [17:50] *** Jonimus has quit (ircd.choopa.net irc.choopa.net) [17:50] *** PepsiMax has quit (ircd.choopa.net irc.choopa.net) [17:50] *** aMunster has quit (ircd.choopa.net irc.choopa.net) [17:50] *** achip has quit (ircd.choopa.net irc.choopa.net) [17:50] *** logchfoo has quit (ircd.choopa.net irc.choopa.net) [17:50] *** sep332 has quit (ircd.choopa.net irc.choopa.net) [17:50] *** vegbrasil has quit (ircd.choopa.net irc.choopa.net) [17:50] *** yakfish has quit (ircd.choopa.net irc.choopa.net) [17:50] *** vitzli has quit (Quit: Leaving) [17:51] *** dabsdude (webchat@[redacted]) has joined #archiveteam [17:51] Okay, I need help. [17:51] *** philpem (~philpem@[redacted]) has joined #archiveteam [17:51] The internet fucked up really bad and deleted the 4chan archive. [17:51] I neeed to know that you guys got this. [17:51] we have several copies of the damn thing [17:52] Can you direct me to a usable one? [17:52] *** riz (~riz@[redacted]) has joined #archiveteam [17:52] The owner of 4plebs went out like a bitch. "Ugh, my servers are shitty so I quit." [17:52] http://archive.fart.website/archivebot/viewer/job/9y56g is one, http://archive.fart.website/archivebot/viewer/job/hdglr is another, there are probably others [17:53] There's no front end for easy viewing? [17:53] Just a 5 gig file? [17:53] it's a WARC, there are several tools to view these [17:53] Someone really needs to make a nice front end with this archive. [17:53] I recommend https://github.com/ikreymer/webarchiveplayer [17:53] *** RKenshin (~rurouni@[redacted]) has joined #archiveteam [17:53] yes, someone did [17:54] *** PepsiMax_ (~CocaCola@[redacted]) has joined #archiveteam [17:54] Who? [17:54] Ilya Kreymer [17:54] author of webarchiveplayer [17:54] *** sivoais_ (~zaki@[redacted]) has joined #archiveteam [17:54] Does it have a web address? [17:55] Because I see a github. [17:55] it's an application you download and run locally [17:55] See, it needs to be embedded into the page. [17:55] if you instead want someone to host terabytes of WARCs, that's IA; if you want someone to host gigabytes of indexes for fast retrieval you are asking for a lot [17:56] unless you have this perception that that sort of storage and upkeep is free in which case I will just disagree [17:56] Eh, a social security check and free power can go a long way. [17:56] *** will- (will@[redacted]) has joined #archiveteam [17:56] Nonetheless, I'm glad you guys are keeping up on this shit. [17:56] I felt cheated when 4plebs went down. [17:57] in any case, for now, download the WARCs and use webarchiveplayer [17:57] surely you have a gigantic pipe for this sort of stuff [17:57] *** zenguy_pc (~oracle__@[redacted]) has joined #archiveteam [17:57] Yeah, the Louisiana oil pipes. [17:57] :^) [17:57] No, there's no way I could maintain such a large server. [17:57] But surely the internet archive can. [17:58] They do so with literally millions of games. [17:58] they have a very large task list and a very limited budget [17:58] *** dxrt- (~dxrt@[redacted]) has joined #archiveteam [17:58] I'll do it for free. [17:58] I'll design the entire frontend. [17:58] the games thing is handled by a small number of people [17:58] *** lbft_ (~lbft@[redacted]) has joined #archiveteam [17:58] *** w0rp_ (~w0rp@[redacted]) has joined #archiveteam [17:58] I'll have it all embedded through Javascript and it'll be solid. [17:58] k [17:59] *** phuzion (~phuzion@[redacted]) has joined #archiveteam [17:59] Seriously though, who would I contact in regards to that? [17:59] *** chfoo- (~chfooZnc@[redacted]) has joined #archiveteam [17:59] *** gibigian1 (~gibigiana@[redacted]) has joined #archiveteam [17:59] *** rduser` (~rduser@[redacted]) has joined #archiveteam [18:00] *** balrog_ (~balrog@[redacted]) has joined #archiveteam [18:00] *** swebb gives channel operator status to balrog_ [18:00] *** LordNigh2 (~Lord_Nigh@[redacted]) has joined #archiveteam [18:01] *** mr-b_ (~mr-b@[redacted]) has joined #archiveteam [18:02] you could write such a thing without adding anything to IA; they support Range requests on WARC and WARC index items [18:06] *** LordNigh2 is now known as Lord_Nigh [18:06] *** mr-b_ is now known as mr-b [18:06] *** balrog_ is now known as balrog [18:06] *** will- is now known as will [18:06] *** RKenshin is now known as Kenshin [18:06] *** w0rp_ is now known as w0rp [18:06] *** xk_id (~xk_id@[redacted]) has joined #archiveteam [18:06] *** rduser` is now known as rduser [18:07] *** Froggypwn (~Froggypwn@[redacted]) has joined #archiveteam [18:07] *** logchfoo_ starts logging #archiveteam at Mon Oct 12 18:07:48 2015 [18:07] *** logchfoo_ has joined #archiveteam [18:08] *** Ungstein1 has joined #archiveteam [18:08] yipdw: Did you by any chance happen to take a copy of RBT? The maintainer was complaining about bad internet speeds. [18:08] I don't know what that is [18:08] RebeccaBlackTech archive [18:09] 4chan related [18:09] search at rchive.fart.website/archivebot/viewer/ [18:09] er http://archive.fart.website/archivebot/viewer/ [18:09] Regardless, a backup of it is being created right now with the maintainer to IA [18:11] *** Ungstein has quit IRC (Ping timeout: 252 seconds) [18:11] *** Dark_Star has joined #archiveteam [18:24] *** bzc6p has joined #archiveteam [18:24] *** swebb sets mode: +o bzc6p [18:29] *** atomotic has joined #archiveteam [18:30] *** lrkj has joined #archiveteam [18:47] *** RichardG_ has joined #archiveteam [18:47] *** RichardG has quit IRC (Read error: Connection reset by peer) [18:47] *** RichardG_ is now known as RichardG [18:50] *** marvinw has joined #archiveteam [18:52] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [18:55] *** sep332 has joined #archiveteam [18:55] *** beardicus has joined #archiveteam [18:55] *** Jonimus has joined #archiveteam [18:55] *** achip has joined #archiveteam [18:55] *** nwf has joined #archiveteam [18:55] *** vegbrasil has joined #archiveteam [18:55] *** yakfish has joined #archiveteam [18:56] *** myself has joined #archiveteam [18:56] *** aMunster has joined #archiveteam [18:57] *** human39 has joined #archiveteam [18:59] *** toad1 has joined #archiveteam [18:59] *** Gfy has joined #archiveteam [19:02] *** balrog sets mode: +o Lord_Nigh [19:03] *** thefinn91 is now known as thefinn93 [19:26] *** kniffy is now known as kniffy-ol [19:27] *** aaaaaaaaa has joined #archiveteam [19:27] *** swebb sets mode: +o aaaaaaaaa [19:29] *** Froggypwn has quit IRC (Read error: Operation timed out) [19:29] *** kniffy has joined #archiveteam [19:30] *** kris33 has joined #archiveteam [19:31] *** Stiletto has quit IRC (Read error: Operation timed out) [19:32] *** Froggypwn has joined #archiveteam [19:34] *** Jonimus has quit IRC (WeeChat 1.3) [19:34] *** jonimus has joined #archiveteam [19:36] *** kris33 has quit IRC (Textual IRC Client: www.textualapp.com) [19:37] *** kniffy-ol has quit IRC (Quit: :^)) [19:46] *** zenguy_pc has quit IRC (Ping timeout: 258 seconds) [19:59] *** zenguy_pc has joined #archiveteam [20:04] *** Stiletto has joined #archiveteam [20:06] *** PurpleSym has quit IRC (Remote host closed the connection) [20:14] *** Mayonaise has joined #archiveteam [20:15] *** Mayonaise has quit IRC (Client Quit) [20:15] *** Mayonaise has joined #archiveteam [20:19] *** kniffy is now known as kniffy-ol [20:19] *** kniffy-ol is now known as kniffy [20:30] *** schbirid has quit IRC (Quit: Leaving) [20:46] *** Ungstein1 has quit IRC (Ping timeout: 252 seconds) [20:52] *** kniffy has quit IRC (Quit: :^)) [20:52] *** kniffy has joined #archiveteam [20:52] *** Ungstein has joined #archiveteam [21:02] *** jonimus is now known as Jonimus [21:03] *** kniffy has quit IRC (Quit: :^)) [21:11] *** kniffy has joined #archiveteam [21:16] *** kniffy has quit IRC (Quit: :^)) [21:17] *** scyther has quit IRC (Read error: Connection reset by peer) [21:18] *** kniffy has joined #archiveteam [21:22] *** kevin has quit IRC (Ping timeout: 252 seconds) [21:25] *** kniffy has quit IRC (Quit: :^)) [21:26] *** kniffy has joined #archiveteam [21:30] *** karissa has quit IRC (Ping timeout: 252 seconds) [21:42] *** arkiver6 has joined #archiveteam [21:44] *** human39 has quit IRC (Read error: Operation timed out) [21:46] *** zenguy_pc has quit IRC (Ping timeout: 258 seconds) [21:59] *** dxrt- is now known as dxrt [21:59] *** zenguy_pc has joined #archiveteam [22:00] *** kevin has joined #archiveteam [22:09] *** zenguy_pc has quit IRC (Ping timeout: 258 seconds) [22:22] *** arkiver6 has quit IRC (Ping timeout: 252 seconds) [22:22] *** zenguy_pc has joined #archiveteam [22:30] *** BlueMaxim has joined #archiveteam [22:33] *** karissa has joined #archiveteam [22:33] *** philpem has quit IRC (Ping timeout: 252 seconds) [22:51] *** JesseW has joined #archiveteam [23:15] *** JesseW has quit IRC (Read error: Operation timed out)