[00:00] because my suggestion, is use vagrant [00:00] Probably just being lazy to the level thinking about how to be more lazy. The outcome agreed before was that it would be nice to have docker -> vm thing. [00:00] vagrant is like docker, except it has proper virtualisation and works everywhere [00:00] Then he came with packer and said it solves everything, which it does not, needs multiple records, and also needs manual steps likely like booting with pre-seed [00:01] yeah, vagrant should be easier than both packer and docker [00:01] https://www.vagrantup.com/docs/getting-started/ i'm currently working on something, but if you have a read through the vagrant docs you should be able to figure it out, it's pretty easy [00:01] The goal is to generate docker and vm image. My goal was more refined though. Including easier mainteance. [00:02] Okay, will take a look, thanks. [00:02] vagrant sits on top of virtualbox, so yes you'll be generating a VM image, but you'll have the ease-of-use of docker [00:02] except you'll get proper virtualisation, compared to docker's "not really isolated shared kernel containers" [00:03] Does it at least (vagrant or packer) allow to specify a preseed somehow? [00:03] docker is popular, docker is not good :P [00:03] what would you need a preseed for? [00:03] docker is good, that is the aim, stripping down the virtualisation. [00:04] preseed is in another words config how the installer should "click" [00:04] Yoshimura: IMO the aim is abstracting away the virtualisation [00:04] Actually VM means slower, so stripping also, depends on person. [00:05] VM doesn't necessarily mean slower [00:05] or rather, "slower" isn't necessarily a caveat of VMs [00:06] Well, the overhead, not only being slower. Have to figure out what exactly vagrant is [00:06] i think you should aim for easy re-deployment, which vagrant does awesomely [00:07] ova import is easy. [00:07] Yoshimura: vagrant is a VM provisioning tool, it's crazy awesome [00:07] I have no idea what it is there is no page explaining. [00:08] https://www.vagrantup.com/docs/why-vagrant/ this page explains it [00:08] but vagrant is basically docker for VMs [00:08] so, docker, but useful ;) [00:09] Yoshimura: I don't know who has the highest word [00:09] I'd say we all do [00:10] But if it's an improvement to what we have, most people here will be fine with it [00:10] ArchiveTeam doesn't seem to have a hierarchy [00:10] :p [00:10] well, except SketchCow is at the top [00:10] I think [00:11] hold on, i'll draw out the archiveteam "heirarchy", gimme two seconds [00:12] archiveteam hierarchy most closely resembles a quantum state [00:12] changes every time you look at it [00:12] joepie91: shush, wait for my terrible visual joke [00:12] lol [00:12] xD [00:12] k [00:12] (currently attempting to find a decent brush in krita) [00:13] You know and use krita, cool, did you backup kickstarter? [00:13] Yoshimura: nah, didn't have any money at the time. i do know, use, and adore krita, and will donate when i have the funds :D [00:13] Btw... everything boils down to you have to use someones else box to start of, or an iso with manual input. [00:14] I did fund, never used it. [00:14] Everyone alsmost has $5 [00:16] https://alfiepates.me/junk/archiveteam.png [00:16] cc joepie91 [00:16] poor alfie :p [00:16] appreciate my five minutes of krita+terrible mouse drawing [00:17] Hmm. [00:19] now before you guys distracted me with horrendous art, what was i actually working on [00:21] http://i.imgur.com/vDxJOf6.gif [01:11] *** GLaDOS has quit IRC (Quit: Oh crap, I died.) [01:11] *** GLaDOS has joined #archiveteam-bs [01:20] *** davidar has quit IRC (Quit: Connection closed for inactivity) [01:29] *** xXx_ndidd has joined #archiveteam-bs [01:36] SketchCow: i'm uploading TV Time Capsule pt. III and pt. IV from myspleen [01:37] these are old encodes from 2005 and 2006 [01:38] pt. IV for example has first 3 hours of CNN and 3 hours of the Challenger Disaster [01:38] *** Stiletto has quit IRC (Read error: Operation timed out) [01:40] *** ndiddy has quit IRC (Read error: Operation timed out) [01:53] *** Stiletto has joined #archiveteam-bs [01:58] *** davidar has joined #archiveteam-bs [02:00] *** Yoshimura has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) [02:00] *** Yoshimura has joined #archiveteam-bs [02:28] SketchCow: found a wrongly categorized WARC: https://archive.org/details/warc-8ch.net-leaked [03:00] *** JesseW has joined #archiveteam-bs [03:11] *** JesseW has quit IRC (Ping timeout: 370 seconds) [03:29] *** SadDM has joined #archiveteam-bs [03:29] *** swebb sets mode: +o SadDM [03:30] *** matthusb- has joined #archiveteam-bs [03:30] *** yakfish has joined #archiveteam-bs [03:32] *** jspiros has joined #archiveteam-bs [03:32] Yoshimura: if you got the idea that I switched goals, then I communicated them badly; the goal was the same the entire time [03:33] Alright. I still cannot convince myself that packer is the best giving result, but a good way non-theless. [03:34] whichever [03:35] I am more worried about the large version bump, and compatibility. [03:35] gotta test it [03:35] in any case, I suspect your goal is different than mine; I just wanted an update of the base image, and perhaps a single source for the two [03:35] it sounds like others are hankering for much more substantial changes [03:35] Yeah, I had to remove some packages, noted those in #warrior. Also removed glibc6-i686 package glibc6 automatically selects the platform [03:35] as a result I have no further input [03:36] My first goal is same. Updated image. Secondary better way to manage it. [03:38] Iterations over one large thing would be currently more beneficial. The size check and some other stuff optimizing for less CPU. And stats reporting to tracker. [03:49] *** bwn has quit IRC (Quit: Leaving) [03:50] *** bwn has joined #archiveteam-bs [04:48] Packer is bullshit. [04:49] Either bad documentation or there is not ability to not create a disk. [04:59] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [05:06] *** Sk1d has joined #archiveteam-bs [05:09] *** Honno has joined #archiveteam-bs [05:51] yipdw_: Actually there is more problems. The scripts on git do not even include the framebuffer logo. Unless it's hidden in something. [05:52] Some idiot has taken nick on github just to never uploadanything [06:53] *** Medowar has joined #archiveteam-bs [07:00] *** metalcamp has joined #archiveteam-bs [07:11] *** schbirid has joined #archiveteam-bs [07:31] *** vitzli has joined #archiveteam-bs [07:44] Lord_Nigh: yep. https://rg3.github.io/youtube-dl/supportedsites.html - just be sure to always upgrade to the latest version before using. [07:46] The Fotolog job has no remaining objects, but 170k jobs are still out. Do these remaining Objects get republished, so they can get grabbed or are they basically lost? [07:48] Re-queued stuff is put back manually later, if they are just not completed by warriors as usual. [07:49] If there is another problem, have no idea, ask someone in charge :P [08:21] They were not aware of urlteam, I guess: http://arstechnica.com/security/2016/04/guess-what-url-shorteners-short-circuit-cloud-security/ [08:29] *** vitzli has quit IRC (Quit: Leaving) [08:38] *** Stiletto has quit IRC (Read error: Operation timed out) [08:41] PurpleSym: Old news, you are third today. And it's good they do not. [08:42] Else we could not archive. And that their security sucks is not our problem. There should be a tickbox: "More secure link" or something. [08:43] The bottomline is : have 6 char [a-zA-Z0-9] links and use smart (log) rate limiting. [08:43] That way a burst (likely user) would be fine, while repeated hits would get throttled fast. [08:44] Also 404s would give much higher negative score. [08:48] There’s no point in archiving if nobody is allowed to use the data. [08:52] Archiving what? Short urls? There is, most of the stuff is public. [08:55] My point was: The researchers should know about urlteam its data trove. [09:19] *** Stiletto has joined #archiveteam-bs [09:28] *** bwn has quit IRC (Read error: Operation timed out) [09:37] *** pwnsrv_ has joined #archiveteam-bs [09:39] *** pwnsrv has quit IRC (Ping timeout: 250 seconds) [09:47] Medowar: I need to do some processing to get the new itemlists [09:48] I'm not sure yet when that is done. [09:51] *** bwn has joined #archiveteam-bs [09:53] *** Stiletto has quit IRC (Read error: Operation timed out) [10:18] *** VADemon has joined #archiveteam-bs [11:53] hmm, if ms stopped offering the one drive shortener, we should crawl tht soonish as it might go soon, no? [12:26] ^ #urlteam [12:27] *** VADemon has quit IRC (Quit: left4dead) [12:42] i feel like he came in here just to tell me that, lol [12:55] *** Stiletto has joined #archiveteam-bs [13:02] *** arkiver2 has joined #archiveteam-bs [13:10] *** BlueMaxim has quit IRC (Quit: Leaving) [13:25] *** vitzli has joined #archiveteam-bs [13:58] https://freedom-to-tinker.com/blog/vitaly/gone-in-six-characters-short-urls-considered-harmful-for-cloud-services/ [13:58] terror in tiny town [14:09] *** arkiver3 has joined #archiveteam-bs [14:09] *** dashcloud has quit IRC (Ping timeout: 250 seconds) [14:10] *** dashcloud has joined #archiveteam-bs [14:13] *** arkiver2 has quit IRC (Ping timeout: 244 seconds) [14:14] Sanqui: yeah, just realized it meant bit.ly WAS the same thing, lol [14:44] *** pwnsrv_ has quit IRC (Ping timeout: 250 seconds) [15:10] *** arkiver3 has quit IRC (Ping timeout: 244 seconds) [15:15] *** arkiver3 has joined #archiveteam-bs [15:15] *** arkiver3 has quit IRC (Client Quit) [15:31] *** atrocity has quit IRC (Read error: Connection reset by peer) [16:06] *** bwn_ has joined #archiveteam-bs [16:11] *** bwn__ has joined #archiveteam-bs [16:19] *** bwn has quit IRC (Read error: Operation timed out) [16:23] *** bwn_ has quit IRC (Read error: Operation timed out) [16:27] *** VADemon has joined #archiveteam-bs [16:38] *** Medowar has quit IRC (Quit: Connection closed for inactivity) [17:06] *** espes__ has quit IRC (Read error: Operation timed out) [17:10] *** DarkMorph has joined #archiveteam-bs [17:11] FileFront shutting down :( [17:13] Yep, we're on it: http://www.archiveteam.org/index.php?title=GameFront [17:14] DarkMorph: ~28TB saved from them so far [17:15] *** espes__ has joined #archiveteam-bs [17:16] awesome [17:23] *** DarkMorph has quit IRC (Sayonara!) [18:33] *** Stiletto has quit IRC (Read error: Operation timed out) [18:36] *** bzc6p_ has joined #archiveteam-bs [18:36] *** swebb sets mode: +o bzc6p_ [18:36] *** bzc6p_ is now known as bzc6p [18:38] http://www.independent.co.uk/life-style/gadgets-and-tech/news/man-accidentally-deletes-his-entire-company-with-one-line-of-bad-code-a6984256.html [18:41] *** bzc6p sets mode: +oooo achip Atluxity chfoo chfoo- [18:41] *** bzc6p sets mode: +oooo closure dashcloud Fletcher Fletcher_ [18:41] *** bzc6p sets mode: +oooo GLaDOS godane HCross HCross2 [18:41] *** bzc6p sets mode: +oooo ivan` joepie91 JW_work Kazzy [18:41] *** bzc6p sets mode: +oooo Kaz midas PurpleSym Sanqui [18:41] *** bzc6p sets mode: +oooo SimpBrain schbirid Smiley Start [18:42] *** bzc6p sets mode: +ooo VADemon wp494 yipdw_ [19:15] *** SilSte has joined #archiveteam-bs [19:18] *** VADemon has quit IRC (Ping timeout: 260 seconds) [19:22] bzc6p; That one was an obvious troll. It's not possible to do what he said he did on a normal Linux disk now a days, and he made it even less likely when answering comments. [19:24] zino: it's a slightly odd troll because the account has over a year of more or less plausible questions in its history [19:26] JW_work: Well, it might make more sense in the context marketing. See https://meta.serverfault.com/questions/8696/what-to-do-with-the-rm-rf-hoax-question [19:27] 'The original poster said in a recent article it was " a guerrilla marketing operation" so blatant spam/troll. tombull89' [19:30] I got that sent by a collegue when it was fresh, and we all cringed a bit at someone being that stupid. Then he posted the followup with "I tried to save disk images with dd, but I confused if and of". Then it was obvious he was just trolling. My technophobic mother doesn't do misstakes that bad. [19:40] *** arkiver2 has joined #archiveteam-bs [19:53] *** pwnsrv has joined #archiveteam-bs [20:01] *** bwn__ has quit IRC (Read error: Operation timed out) [20:10] *** mismatch has quit IRC (Ping timeout: 370 seconds) [20:12] *** vitzli has quit IRC (Quit: Leaving) [20:19] *** mismatch has joined #archiveteam-bs [20:22] *** bwn__ has joined #archiveteam-bs [20:38] * Yoshimura does apologize to everyone he has offended or was not nice to, for whatever reason. Yoshimura wishes to be nice to everyone, but his mind sometimes is going places. [20:52] I seriously don't like yiu. [20:53] you are still here because some team members find some measure of value in your insulting, high spectrum premise clarification demands. [20:53] Our own little Chaos Monkey. [20:55] *** bzc6p has left [21:02] *** bwn_ has joined #archiveteam-bs [21:03] Well, as you could noticed I did stop that, or at least tried. Depending on person it is hard to get first impressions go. [21:04] six hours is kind of long for "first impressions" [21:05] I am aware of that, though it's still a single instance. [21:06] borrowed time. [21:06] you're on thin ice, please make a note of it [21:06] not thin ice [21:06] literally no ice [21:07] two people who are brilliant and who I deeply respect have asked me not to just block out someone as they try to extract a razor-thin amount of value from interacting with him. [21:07] Well, not sure how could I "fix" it, undo it, or anything, so ... if any notes, just please tell me. [21:08] nothing [21:09] you will eventually be gone [21:15] *** bwn__ has quit IRC (Read error: Operation timed out) [21:22] Warrior does not do thing for what lies at the end, but for what lies in the process. I might be gone, but my work would be not, unless made so. So I am keeping my work. [21:22] *sigh* [21:26] warrior is for archiving, archiving is not done for the fun of archiving [21:27] * arkiver disagrees a bit there [21:28] * arkiver likes it when a new websites pops up which needs to be archived [21:28] website* [21:30] In this context warrior was not the software, and noone mentioned 'fun' as purpose. [21:31] So what is Yoshimura trying to make exactly? I haven't read the whole conversation [21:32] enemies? [21:32] * JW_work is also somewhat confused. [21:32] I'm grateful for the help with #urlteam entries, though. [21:32] Well sketch just said I would eventually be gone, so that was the rest [21:33] I think it's something to do with modernising the Warrior [21:33] And there is no specific goal of mine, just making the process and stuff better and preserving knowledge that is worth doing so. [21:33] But what exactly would become better about the warrior except for modernising it? [21:33] new features [21:34] or faster? [21:34] Well, when I came I did talk about format and stuff, most of that was questions or concepts, and not particulary pushing those to be adopted, but it was understood like so, and now "noone" likes me apparently. [21:34] it'd help if you were less pompous [21:34] Warrior? Features, faster, modernized. [21:35] Well, since I did meditate about that after first day I am, second day I said only few sentences, but some people carry that todate. [21:36] yes, it is everyone else's fault. [21:37] Everyone is responsible for his actions and for his perception. [21:37] I did not ever say it is someones else fault what I wrote. [21:38] Warrior - Apparently due to its outdated nature, modernizing is the first logical step. After that user related features, then those going backend gradually, leaving that as last. [21:39] Then a fix (it works, so why rewrite) of megawarc factory. [21:40] And then getting through metadata and processing. [21:40] (Not mentioning labor type of work like shorteners) [21:40] arkiver: Summed that for you. [21:44] About deflate, have to confirm again, about compression gain, but fast eval was 20% less space which is great. But in context of switching from gzip to deflate with dictionary, thanks to the climate noone might want it. ... It is a question.. rewrite few lines on most of software or store 20% more. Text stuff is not that large (or is it? does anyon [21:44] e have estimate how much text part or archive.org takes?) and the other is not that compressible by additional dictionary, so unless proven the benefit is worth overall, including binary data, pictures, etc, it would not be smart to swap. [21:47] did you check whether archive.org's wayback machine still works when you switch from gzip to deflate? [21:47] because we can't control that end of things [21:47] it. absolutely. diesn't [21:48] ok well then if we're switching out the whole world i'd like to propose lzma [21:48] if it weren't for your host, I'd assume you were that y2k kid [21:48] which y2k kid? [21:48] Dec-29-99 or whatever the fuck his name was [21:49] oh yeah good old DEC-31-99 [21:49] DEC was just an angry tyke. [21:50] i wonder if he's archived every simpsons episode onto m-disc yet [21:50] Two Problwms here is just going to write a Medium think piece about his poor treatment and his conclusions via confirmation bias [21:51] xmc: The thing is that deflate can have predefined dictionary and is essentialy same algo and library (zlib) [21:53] SketchCow: if you want me to grab twilight cds, shout now [21:53] No need to use what bullies do, I was whole life (including abuse), which is how I did not gain great social skills in all circumstance. [21:54] check thr items on archive.org for twilight. [21:54] can't be arsed sorry, i have access to discs 1-89 and can download them if you tell me which ones [21:55] pp9987654ew kiuytq [21:55] JW_work: Bless you [21:55] JW_work: time for a new irc account [21:55] fine, grab em and ftp them [21:55] ant other too [21:56] any others [21:56] not gonna ruin my ratio by grabbing unneeded stuff [21:58] arghgh, sorry! [21:58] *** metalcamp has quit IRC (Ping timeout: 250 seconds) [22:00] *** arkiver2 has quit IRC (Ping timeout: 244 seconds) [22:01] schbirid: I quickly browsed through the "Twilight cds" category on IA and it looks like 58, 59, 88, and 89 are missing from the 1-89 range [22:02] the hero we need [22:04] ok, grabbing those [22:18] hero [22:25] i can get them [22:26] i just been behind on things [22:28] schbirid: i have 58 and 59 [22:28] ah nice [22:28] i will just grab 88 and 89 then [22:28] don' [22:29] i can get them [22:29] ok [22:29] thanks [22:31] *** Honno has quit IRC (Read error: Operation timed out) [22:35] *** nickname_ has joined #archiveteam-bs [22:42] https://archive.org/details/dvdrom-twilight-062 [22:42] https://archive.org/details/dvdrom-twilight-061 [22:43] https://archive.org/details/dvdrom-twilight-060 [22:43] these need to be move [22:44] *those need to be moved to here: https://archive.org/details/cdromsoftware [22:44] *** VADemon has joined #archiveteam-bs [22:45] looks like someone took my thunder away with that [22:46] i had the iso's but i have been busy with kpfa stuff [22:47] *** schbirid has quit IRC (Quit: Leaving) [22:54] looks like thw twilight 061 dvd is not the same iso that i have [22:57] This needs to be moved: https://archive.org/details/wshu_2016-03-31.warc [22:58] looks like twilight 062 dvd doesn't have the same md5 as i do too [23:06] ok the twilight isos i have are 100% [23:06] so i may have to upload them anyways :-/ [23:07] what are you uploading? [23:13] *** dashcloud has quit IRC (Read error: Operation timed out) [23:15] twilight isos [23:16] i think these isos are corruppted [23:16] not my fault at least since the torrent was 100% complete [23:18] *** nickname_ has quit IRC (Read error: Operation timed out) [23:20] so i can't mount twilight iso 58 and 59 [23:21] *** dashcloud has joined #archiveteam-bs [23:34] *** nickname_ has joined #archiveteam-bs