[00:15] *** kristian_ has quit IRC (Quit: Leaving) [00:28] *** JesseW has joined #archiveteam [00:32] *** jrwr has joined #archiveteam [00:43] *** RichardG has quit IRC (Ping timeout: 255 seconds) [00:51] *** Blackout has quit IRC (Quit: http://www.mibbit.com ajax IRC Client) [00:53] *** maelstrom has joined #archiveteam [01:41] *** RichardG has joined #archiveteam [01:42] *** BlackoutI has joined #archiveteam [01:49] *** BlackoutI has quit IRC (Quit: http://www.mibbit.com ajax IRC Client) [01:51] *** Blackout has joined #archiveteam [01:55] *** BlueMaxim has quit IRC (Ping timeout: 1208 seconds) [02:00] *** RichardG has quit IRC (Ping timeout: 370 seconds) [02:09] *** vitzli has joined #archiveteam [02:18] *** RichardG has joined #archiveteam [02:26] *** RichardG_ has joined #archiveteam [02:29] *** powerKitt has joined #archiveteam [02:30] *** RichardG has quit IRC (Ping timeout: 370 seconds) [02:38] *** RichardG_ has quit IRC (Ping timeout: 370 seconds) [03:03] *** powerKitt has quit IRC (Ping timeout: 270 seconds) [03:22] *** powerKitt has joined #archiveteam [03:24] https://www.reddit.com/r/trackers/comments/5aew97/sciencehd_says_farewell_on_november_31/ We might want to get in contact with the sysop and have him dump the torrent files, and then import them into archive.org ? [03:24] I might have a contact for sciencehd, gimme a minute [03:25] Alright. [03:29] What kind of content is it powerKitt ? [03:30] Blackout: https://opentrackers.org/sciencehd/ e-learning, apparently. [03:37] 32-28TB, would we have the ability to store that much on short notice? [03:38] *** tyzoid has joined #archiveteam [03:38] *** tyzoid has left [03:42] I know I don't have that much space. [03:43] phuzion, where'd you get that number? [03:44] Selavi: Connections. [03:44] haha okay [03:44] They said they had a contact for ScienceHD's staff. [03:45] Phuzion: is that all just the .torrent files or the actual files in the torrents? [03:45] Almost certainly content. [03:45] Yeah I was wondering the same thing [03:45] That would be a ton of .torrent files [03:46] What.CD probably has less than 250GB of .torrent files, tbqh. [03:47] Aren't they text as well meaning they should compress? [03:47] I'm not sure, I don't have an account there and therefore can't really say [03:48] I meant torrent files in general [03:48] Not the contents [03:48] .torrent files are text, yeah. [03:50] Sadly I am a drive pesant so I don't have that kind of space you mentioned. Would the torrents work after the tracker goes dark? [03:50] If we could get just the .torrent files, they could be split up and have the content downloaded as a warrior project? [03:50] But where would it go? [03:51] I wouldn't think the IA would be acceptable due to potential copyright issues [03:51] They could be modified to be tracked on a public tracker and then reuploaded to thepiratebay.org [03:52] *** nickname_ has joined #archiveteam [03:52] *** tyzoid has joined #archiveteam [03:52] But they'd still need initial seeds right? [03:52] so hey is it death week [03:53] well it's partway into the last fiscal quarter [03:53] so, [03:53] *** gelob has joined #archiveteam [03:53] *burn everything* [03:54] panic grab everything [03:54] lol you can only grab one thing per hour per country [03:54] They're still going to be tracked on scienceHD until it shuts down on the 30th of November, so if we just modify them to add public trackers they should be seeded up until then by existing users. [03:54] muahahaha [03:54] but would the seeds need to be on the same tracker? [03:55] or is it like a secondary tracker [03:55] Almost all modern torrent clients can pull swarms from multiple trackers. [03:55] so yeah vessel is dead [03:55] Yeah I saw that and it made me so sad [03:56] tfw Verizon [03:56] ? [03:56] I'm pretty sure they use a higher bitrate than YouTube as well as no ads [03:56] i only know vessel because of a video by veratasium [03:56] Verizon bought Vessel and is killing them [03:56] Blackout: Vessel was a paid platform [03:56] Yeah I use it [03:57] or used? as it's shutting down [03:57] I used it when they had a 1 year free trial from starting up [03:57] tfw https://i.imgur.com/7mmsd3H.png [03:57] 20 months [03:57] I move right back to youtube once it ended, plus I've got youtube red now [03:57] I think youtube red killed it, in part [03:57] i have regular old youtube [03:58] Pretty much all vessel videos were on youtube anyway [03:58] I can't recall of any content that wasn't already on youtube that wasn't on vessel [03:58] A lot of youtubers used it as a way to release content earlier to paying viewers. [03:59] I know LinusTechTips posted early but I think that's about it [03:59] Anyway, phuzion see if you can get your contact to add a public tracker to all the torrents. That way any user downloading a torrent will be seeding it publically as well. [03:59] Anyone know if anyone's taken the virtualbox warrior machine and converted it to a vagrant box? [03:59] if not, would that be worthwhile to do? [04:00] I wasn't able to find much from a cursory google search [04:00] -shrug- go for it if you want. [04:01] archive myspleen [04:01] I know this isn't archive.org, but perhaps someone knows this: The software archive contains a bunch of old software, but is there any use for more modern software packages? [04:01] I happen to run an arch linux package mirror, so I could help get some open source binary packages on there. [04:02] you could make a mirror if you want [04:02] *** nickname_ has quit IRC (Leaving) [04:04] *** ndizzle has joined #archiveteam [04:05] *** tyzoid has quit IRC () [04:06] *** ndiddy has quit IRC (Read error: Operation timed out) [04:07] *** ndizzle has quit IRC (Client Quit) [04:22] Ok I remember how I first heard of archive team now [04:22] it was isoHunt! [04:35] *** dashcloud has quit IRC (Read error: Operation timed out) [04:53] Blackout: Nice. I think I heard of the AT when I was looking up geocities info. [05:15] *** maelstrom has quit IRC (Quit: Leaving) [05:18] *** powerKitt has quit IRC (Read error: Operation timed out) [05:21] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [05:28] *** Sk1d has joined #archiveteam [05:40] *** Aranje has quit IRC (Quit: Three sheets to the wind) [06:26] *** JesseW has quit IRC (Read error: Operation timed out) [06:47] *** ravetcofx has quit IRC (Read error: Operation timed out) [06:49] *** ravetcofx has joined #archiveteam [06:58] *** Deewiant_ is now known as Deewiant [07:40] *** vitzli has quit IRC (Quit: Leaving) [07:40] *** ravetcofx has quit IRC (Read error: Operation timed out) [07:45] *** ravetcofx has joined #archiveteam [08:19] *** Smiley has joined #archiveteam [08:21] *** SmileyG has quit IRC (Read error: Operation timed out) [08:29] FOS appears to have gone down. [08:31] my uploads to the archive s3 have stopped - more widespread network issues? [08:33] i was having trouble all night with s3 [08:33] good to know its not just mee [08:49] *** db48x has quit IRC (west.us.hub irc.Prison.NET) [08:49] *** Yoshimura has quit IRC (west.us.hub irc.Prison.NET) [08:49] *** patrickod has quit IRC (west.us.hub irc.Prison.NET) [08:49] *** superkuh has quit IRC (west.us.hub irc.Prison.NET) [08:49] *** godane has quit IRC (west.us.hub irc.Prison.NET) [08:49] *** Jonimus has quit IRC (west.us.hub irc.Prison.NET) [08:49] *** achip has quit IRC (west.us.hub irc.Prison.NET) [08:50] *** patricko- has joined #archiveteam [09:22] *** z00nx has quit IRC (Quit: WeeChat 1.5) [09:23] *** z00nx has joined #archiveteam [09:36] *** Darkstar has quit IRC (Read error: Operation timed out) [09:39] *** db48x has joined #archiveteam [09:39] *** Yoshimura has joined #archiveteam [09:39] *** superkuh has joined #archiveteam [09:39] *** godane has joined #archiveteam [09:39] *** achip has joined #archiveteam [09:39] *** Jonimus has joined #archiveteam [09:39] *** irc.Prison.NET sets mode: +o Jonimus [09:39] *** swebb sets mode: +o Jonimus [09:55] *** Darkstar has joined #archiveteam [10:03] *** pikhq_ has quit IRC (Read error: Operation timed out) [10:05] *** ravetcofx has quit IRC (Read error: Operation timed out) [10:08] *** ravetcofx has joined #archiveteam [10:18] *** Peetz0r has quit IRC (Ping timeout: 250 seconds) [10:18] *** ravetcofx has quit IRC (Ping timeout: 506 seconds) [10:24] *** WinterFox has joined #archiveteam [10:26] *** Peetz0r has joined #archiveteam [12:47] *** RichardG has joined #archiveteam [13:01] *** hewi has joined #archiveteam [13:27] *** powerKitt has joined #archiveteam [13:31] *** WinterFox has quit IRC (Read error: Operation timed out) [13:55] *** mschfr has joined #archiveteam [14:10] *** drunksci has joined #archiveteam [14:14] *** hewi has left [14:20] *** Start has quit IRC (Quit: Disconnected.) [14:51] SketchCow: I'll be obtaining a ZIP of all of the .torrents from ScienceHD, we cool to push 42TB to IA? [14:54] lol [15:00] what does a 42tb .zip look like [15:01] It's not a 42TB ZIP [15:01] It's a ZIP with .torrents, and the .torrents will download 42 TB of data. [15:02] ah, yeah I misread that bit [15:02] that makes a little more sense [15:02] *** JesseW has joined #archiveteam [15:16] "a little" [15:16] :P [15:30] Someone wanna make a channel for the ScienceHD project? [15:33] *** will has quit IRC (Quit: Goodbye) [15:33] *** will has joined #archiveteam [16:08] *** bRick5772 has joined #archiveteam [16:12] *** Stilett0 has quit IRC (Ping timeout: 246 seconds) [16:13] *** Stiletto has joined #archiveteam [16:13] *** hewi has joined #archiveteam [16:18] Explain ScienceHD to me [16:19] it's some torrent site that's closing [16:19] (Found it) [16:19] you're welcome [16:19] Berzap [16:19] https://opentrackers.org/sciencehd/ at least explained to me [16:24] *** atomotic has joined #archiveteam [16:38] Oh hi. So, as far as what it is, yeah, it's a bittorrent tracker with a bunch of scientific material. [16:38] I've spoken to some of the staff there, and they said that they would be willing to provide us an archive of all of their .torrent files. [16:39] One staff member wants to discuss this stuff with us a bit more, but doesn't want to do so in a publicly logged channel [16:40] *** Stiletto has quit IRC () [16:42] *** JesseW has quit IRC (Read error: Operation timed out) [16:52] *** pikhq has joined #archiveteam [17:10] *** brayden has quit IRC (Read error: Connection reset by peer) [17:12] *** vOYtEC has joined #archiveteam [17:20] *** Stiletto has joined #archiveteam [17:23] *** RichardG has quit IRC (Ping timeout: 370 seconds) [17:26] *** mschfr has quit IRC (Quit: Page closed) [17:29] This really is a pretty thing, indeed: http://gilbertsinnott.com/theshapeofdeathtocome/ [17:33] *** johtso has joined #archiveteam [17:33] Is anyone on this? https://blog.snipt.net/snipt-is-closing/ [17:37] johtso: so those are code snippets? [17:39] Yeah. They're provided in raw format. Public snipts seem to be indexed all the way back to 9 years and 5 months ago. [17:40] *** powerKit2 has joined #archiveteam [17:40] nice [17:41] https://snipt.net/raw/49f71e74a84550f34d0690ce5990e52b/ example snipt, the oldest public one. [17:41] https://snipt.net/public/?page=2599 last page of results [17:42] can that just be thrown in archivebot? [17:42] archivebot should be good enough [17:42] yeah [17:42] it's in [17:43] let's create a channel for codebender [17:43] http://nicksergeant.com/from-html-mockup-to-a-full-drupal-site-a-tutorial-part-i-introduction-and-installation/ there are snipts that appear to be somewhat on offsite domains [17:44] https://snipt.net/raw/75d55869130a96ea7547221f7bcb6091/?nice corresponding snipt "Raw Nice" [17:47] #codeblender ? [17:48] I grabbed a git clone --mirror of the site's github repository. [17:48] Is tar or zip preferred when uploading compressed files to archive.org? [17:50] for a repository? check out 'git bundle' [17:50] zip is better than tar.gz because you can live browse it [17:50] Oh, okay. [17:50] (in general) [17:52] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [17:52] *** RichardG has joined #archiveteam [17:55] You can live browse tar with index a good tool. [17:56] not if its gzip'd [17:56] Well, if it is the kind of tar that is composed of compressed segments. [17:56] Uploading.... [17:56] If it's non-solid you can. [17:56] https://archive.org/details/Nicksergeantsnipt.git feel free to tell me if I should do it a different way. [17:57] Yoshimura: this is why you are on shitlist. i know how things are implemented and am responding based on reality. you are responding with hypothetical "you could do X" turbo-nerd shit. [17:57] xmc: then archivebot, warc how you do it, and megawarc is shit. [17:57] That's how it works. [17:58] what? [17:58] >.> [17:58] I'm confuesd [17:58] powerKit2: when uploading to IA for web serving, using a .zip is best for a collection of files [17:58] It takes gzip packed files and contatenates them toggether adding tar headers and tar block padding. [17:58] *** Swizzle has joined #archiveteam [17:58] xmc: ^ [17:58] Alright, so I didn't fuck it up. good to know. [17:59] Yoshimura: you're wrong and it's complicated and i have actual useful things to do that don't involve arguing with you [17:59] I am not wrong on this. [17:59] go ahead and think that [17:59] there's no tar involved in WARCs [17:59] In megawarcs. [18:00] i recommended powerKit2 use zip because it is natively non-solid and ships with an index [18:00] you can do that with tar and gzip and tooling but that's way too much work, also it's confusing to end-users [18:00] like, the people who will download it in future [18:00] I did not oppose that. I just said with tar you can too. [18:01] ( fyi: powerKitt is also me, I just didn't want to bump my phone off efnet. ) [18:01] powerKit2: yeah, no worries, that's pretty clear [18:01] Alright, thanks. I just wanted to make sure there wasn't any confusion :) [18:01] But sure, tag me with shit. Why not. [18:02] -bs [18:32] *** Stiletto has quit IRC (Read error: Operation timed out) [18:32] *** Stiletto has joined #archiveteam [18:32] *** JW_work has quit IRC (Read error: Operation timed out) [18:45] *** Stiletto has quit IRC () [18:58] *** jrwr has quit IRC (Remote host closed the connection) [19:13] *** ravetcofx has joined #archiveteam [19:25] phuzion, awesome. I was really hoping I didn't have to make a scraper to grab all the torrents [19:25] Selavi: Do you wanna head up this project? I'm a bit swamped with IRL shit right now. [19:28] phuzion, I can do a bit. I'm not very familiar with AT routines yet though [19:28] Alright [19:29] phuzion: how is the metadata? [19:29] currently, I'm mostly wondering if they wouldn't mind me sharing my account with fellow folks to grab more quickly [19:29] phuzion: do you think you can also get the page webpage of a torrent saved? [19:29] to extract metadata [19:30] but if they're willing to talk to us, that's a great start [19:30] arkiver: if someone gets a channel going, I can possibly get a staff member in there to chat with us regarding the project [19:30] ok [19:30] I just don't have the bandwidth right now to coordinate a project [19:31] Hmm [19:31] and I only have 2.5TB free until I get my next server built [19:32] #scienceld ? [19:32] Please join that ^ [19:33] *** JW_work has joined #archiveteam [20:01] *** JW_work1 has joined #archiveteam [20:02] *** Swizzle has quit IRC (Read error: Operation timed out) [20:03] *** JW_work has quit IRC (Read error: Operation timed out) [20:40] *** JW_work1 has quit IRC (Quit: Leaving.) [21:00] *** Stiletto has joined #archiveteam [21:04] *** Stiletto has quit IRC (Client Quit) [21:05] *** Stiletto has joined #archiveteam [21:11] *** Stiletto has quit IRC () [21:15] *** kisspunch has quit IRC (Quit: ZNC - http://znc.in) [21:15] *** kisspunch has joined #archiveteam [21:25] *** bRick5772 has quit IRC (Quit: Leaving.) [21:25] *** BlueMaxim has joined #archiveteam [21:28] *** Stiletto has joined #archiveteam [21:39] *** maelstrom has joined #archiveteam [21:47] *** JW_work has joined #archiveteam [21:51] *** Swizzle has joined #archiveteam [22:06] *** Sanqui has quit IRC (Ping timeout: 260 seconds) [22:06] *** scyther has quit IRC (Ping timeout: 260 seconds) [22:11] *** Sanqui has joined #archiveteam [22:12] *** scyther has joined #archiveteam [22:51] *** powerKit2 has quit IRC (Quit: Page closed) [22:59] *** atomotic has joined #archiveteam [23:15] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [23:56] *** Swizzle has quit IRC (Read error: Operation timed out)