[00:16] *** ZexaronS has joined #archiveteam-bs [00:42] *** ZexaronS- has joined #archiveteam-bs [00:42] *** ZexaronS has quit IRC (Read error: Connection reset by peer) [00:47] *** Valentine has quit IRC (Read error: Connection reset by peer) [00:51] *** Valentine has joined #archiveteam-bs [01:18] Where does the ArchiveTeam meet? [01:19] here is the bullsh*t :D [01:19] check out #architeam or #warrior for less degredation :D [01:19] What's #architeam? [01:20] it's a channel..with typos [01:20] Yay, free typos! [01:21] (it a cool sounding name though 'ARCHY-TEAM!' [01:21] ..much cooler than #archiveteam [01:23] oh god [01:23] / kickban ola_norsk [01:24] http://archie.icm.edu.pl/archie-adv_eng.html [01:24] Any work going on with a new warrior? Maybe on that can be deployed via docker? [01:25] y tho [01:25] why not just git clone , sudo ./get-wget-lua-whatever, seesaw, dependencies, done [01:28] Because we need a pretty interface for the less technically inclined supporters of AT. [01:28] The kind that can figure out how to boot a VM but has never seen a terminal before. [01:29] Basically, "download this file, open it with VMWare/VirtualBox, and just leave it running until the heat death of the universe". [01:30] we cant keep a wiki up, we cant keep a twitter active. we also cant keep a vm up to date. Will we create a better vm, based on the past? [01:31] We keep at least one Twitter account *too* active. But that's an entire separate discussion that I'd rather not have right now. [01:31] https://twitter.com/archiveteam [01:31] Be the change you want to see in the world. :-) [01:31] tried that [01:32] was told its not good to duplicate data [01:32] hmm [01:33] Now, to get back to the original question. sec0nd: 1. There is a warrior docker image. 2. There is also a VM which uses that Docker image. In both cases, I'm not sure how well those systems stay up to date. [01:33] Well yeah, we need to solve the problems with our existing wiki. Creating a copy, then redirecting (some) people to that instead of the original and have two different versions of articles only creates more problems. [01:34] loadbalancing [01:34] How do I become an archiveteam member? [01:34] You already are. [01:34] warriorv3 image does not seem to work on vmware player 5 on windows at least.. roblox job works fine (tested it overnight) but the vidme project fails to do anything at all [01:34] wait what [01:34] vmware player FIVE? [01:35] JAA so there is not really an ArchiveTeam membership eh, nothing official [01:35] sir have you considered running version .... 14? [01:35] Can we start offering memberships etc? [01:35] is it still free? :p [01:35] Maybe become an organization? [01:35] Maybe offer emails? [01:35] but really, is the vmware version going to change how the scripts run in the image? [01:35] sec0nd: Nope. Being here and sharing our goals is all that's necessary. [01:35] Player was always freemium [01:36] version 7 added support for ubuntu 14.10. [01:36] version 4 is 6 years old [01:37] so, in the current discussion of a warrior image that works... Is vmware player 5 going to fail to run the vidme job, but work fine with roblox? [01:37] (bit of a leading question there) [01:37] what error do you get? [01:37] no error, just a blankt 'current project' page [01:39] CoolCanuk: We don't need load balancing, we need to fix issues on the wiki installation. Literally any server should be able to handle the traffic we're getting. Jason posted stats the other day, it's only about 1.5 requests per second including all static imagery etc. or an order of magnitude less for only page views... [01:39] what happens when you run the script manually [01:40] JAA 1.5 requests per second that *went through* [01:40] How would one do that? No docs that I can find [01:40] unless your stats are at dns level [01:41] *** tobbez has quit IRC (Read error: Connection reset by peer) [01:41] omglolbah: https://github.com/ArchiveTeam/roblox-grab/blob/master/README.md [01:41] use "Running without a warrior" [01:41] how do those apply to vidme? [01:42] Meh, whatever, even if it was ten times more, that shouldn't be an issue if the server is configured correctly. [01:42] https://github.com/ArchiveTeam/vidme-grab/blob/master/README.md [01:45] all that is within the docker container right? [01:45] wherever linux is [01:45] i disticly remember reading not >3 hours ago.. "We were offered the data" (vidme) [01:46] if the delivered format is the problem..well..tough nuggins [01:46] https://www.irccloud.com/pastebin/OIphYzGk/ [01:46] this might help. [01:51] not sure how to access the internals of the docker image, little experience with docker <.< [01:52] omglolbah: the virtualbox seems to be basically 3 files packed in a tar archive [01:52] disk1. disk2, and the ovf [01:53] docker is undoubtebly no lesser [01:54] 2 partion images + machine definition [01:54] a "docker" file is problable the same [01:55] some kind of tar/gz/zip/rar thingy [01:56] Yeah we basically need one-click programs... I was gonna try and package up IA.BAK for windows but... I was lazy and didn't... [01:56] this warrior seems to just grab a docker image on first start, but the docker-image is broken for vidme [01:58] for 'one click' it would require some solid platform detection, download of requirements, then applying a shitload of commands to get it moving [01:59] e.g "Virtualbox is not available..Trying " [02:00] the old warrior image worked great for the jobs that came with it [02:00] and was 30 seconds of setup-time [02:00] except it crashed when i tried to run it.. [02:00] One click is easier to IA.BAK than warrior, yeah [02:00] ia.bak? [02:01] omglolbah: medium-alive project to back up IA [02:01] with associated software [02:02] http://iabak.archiveteam.org/, http://archiveteam.org/index.php?title=INTERNETARCHIVE.BAK [02:03] VirtualBox does not seem to be the stabelest of things..IMO [02:03] Works fine for me. [02:03] here it crashed, while the same worked fine in KVM [02:05] it even froze desktop interaction, so had to go to tty and kill it to go interact with the desktop [02:06] the fact that all shit froze, i'd blame on vbox, not archiveteam [02:07] Sounds like you're using an unstable version of VirtualBox then. [02:07] i takes what apt-get giveth meh [02:07] I've been running the version in the Debian repos for years without issues. [02:07] versions* [02:08] 'unstable version' is a problem then [02:08] mind you, i'm not exactly on 'cutting edge' :D [02:10] if 'apt-get install virtualbox' fucks things up..that's a bad [02:10] Yeah, my experience is mostly with versions from the stable distribution(s). [02:11] Hm, in what way? [02:11] newly installed lubuntu [02:11] with no frills or whistles [02:14] ubuntu Ubuntu 17.10 based Lubuntu [02:14] -ubuntu [02:15] every depo would be 'official' , nothing added whatsoever [02:17] i think i posted the virtualbox log of the crash [02:18] *** ranavalon has quit IRC (Read error: Connection reset by peer) [02:18] *** ranavalon has joined #archiveteam-bs [02:22] it's all fun and games until the virtual machine behaves irradical ... https://youtu.be/FL7-sbiGlzw [02:24] JAA: put some grease into it man https://bitbucket.org/duckhuntpr0/archiveteam-warrior-kvm [02:25] JAA: it could use decreasing of mess.. But it does run.. [02:25] That seems to require an account? [02:26] aye, it's too shit to put on github [02:26] yet [02:26] or= [02:26] i don't know.. [02:27] *** eLbot has quit IRC (Quit: Page closed) [02:27] There's so much crap on GitHub anyway. :-P [02:28] if put on github, and in public, in general, it's so shit it would be cause 'Issue' :D [02:28] ? [02:29] first of all, it needs 'dynamic' modifying of the xml file, since relative paths doesnt work [02:30] And now you're going to tell me that you do that with regex? :-P [02:30] and also, since it's intended for 'off site' host, briding (with or without vnc or http acces) [02:30] regex is greek to me [02:32] if it can't be done by c++, python, sh, bat...i'm screwed [02:33] fucking regex... [02:33] :[ [02:35] *** Darkstar has quit IRC (Ping timeout: 600 seconds) [02:36] JAA: you killed my morale man :( https://youtu.be/LIPc1cfS-oQ [02:37] JAA: psst..do you happen to know regex? ;) i could use it.. [02:38] Without even understanding what you're trying to do. :-/ [02:38] Yeah, I know and love regex. What do you need? [02:39] *** Darkstar has joined #archiveteam-bs [02:39] i'll get there...the failure to understand is EXACTLY why i keep the shit on bitbucket for the time being :D [02:39] *** mr_archiv has quit IRC (Quit: WeeChat 1.6) [02:40] * ola_norsk doesn't understand x% of it [02:40] *** schbirid has quit IRC (Read error: Operation timed out) [02:48] *** mr_archiv has joined #archiveteam-bs [02:49] how can "Camera" be a link? https://i.imgur.com/Wwn1LuO.png [02:52] *** schbirid has joined #archiveteam-bs [02:52] internet is thoroughly broken :( https://youtu.be/98AJUj-qxHI [02:53] *** ola_norsk has quit IRC (rm -R internet) [02:56] hostname [02:56] idk [02:57] id love to watch that but I got a 1 min unskippable ad [02:58] *** beardicus has quit IRC (Read error: Operation timed out) [02:58] *** beardicus has joined #archiveteam-bs [03:02] *** Pixi` has joined #archiveteam-bs [03:02] *** Pixi` has quit IRC (Client Quit) [03:03] *** Pixi has quit IRC (Ping timeout: 255 seconds) [03:03] *** ZexaronS- has quit IRC (Read error: Operation timed out) [03:10] *** Pixi has joined #archiveteam-bs [04:02] *** Jusque_ has joined #archiveteam-bs [04:04] *** Pixi has quit IRC (Quit: Pixi) [04:05] *** Jusque has quit IRC (Read error: Operation timed out) [04:15] *** Jusque_ has quit IRC (Read error: Operation timed out) [04:22] *** Pixi has joined #archiveteam-bs [04:57] *** ola_norsk has joined #archiveteam-bs [04:58] CoolCanuk: hey canuc, how might i get youtube-dl to execute an upload after each downlowed? [04:58] wot [04:58] oh [04:58] im not sure :( [04:58] my damn script deleted itself... [04:58] we are told not to modify the script so you need to submit a pull request [04:58] wot? [04:58] is this for vid.me ? [04:59] aye [04:59] idk [04:59] sowwy [04:59] im not a magician like others [04:59] i'm not sticking with those pessimists though, i'm archiving channels i like [04:59] damnit [05:00] *** Valentin- has joined #archiveteam-bs [05:01] it takes a real idiot to spend 30 minutes to write a shell script..and then run it for an hour, just to have it delete itself.. [05:01] * ola_norsk is that idiot [05:01] *** Valentine has quit IRC (Ping timeout: 506 seconds) [05:11] youtube-dl is damn mong not having a --execute-on-dowload argument [05:51] what? [06:01] aye [06:13] Odd0002: questioning percieved logic is the road to success [06:14] I didn't understand what you mean by that statement [06:15] Odd0002: neither did i :) https://youtu.be/ieQH6X_XBJo [06:15] the scrip deleted itself though.. [06:16] along with an hour of downloaded shit.. [06:18] lesson is; don't write scripts that delete themselves after finished task.. [06:39] *** K4k has quit IRC (Quit: WeeChat 1.9.1) [06:39] *** K4k has joined #archiveteam-bs [06:43] *** K4k has quit IRC (Client Quit) [06:44] *** K4k has joined #archiveteam-bs [06:47] Odd0002: you know youtube-dl ? [06:49] yes [06:50] great, how do i make it iterate trough weeks, using --datebefore and --dateafter ? that's what this mong machine deleted :) [06:51] no idea [06:52] then we are two [06:52] I just do youtube-dl -f best [06:52] I didn't even know it had a datebefore and dateafter [06:52] aye it does [06:54] e.g "--dateafter now-1weeks" [06:54] and e.g "--datebefore now+1weeks" [06:59] * ola_norsk is a sufferer of dyscalculia [07:04] holy crap..i just realized the mistake! https://youtu.be/mgXphurrsE0 [07:05] 1+1=2 [07:07] *** ola_norsk has quit IRC (took me till 8am though :/) [07:55] *** Aerochrom has joined #archiveteam-bs [07:56] *** CoolCanuk has quit IRC (Quit: Connection closed for inactivity) [08:07] *** kimmer1 has joined #archiveteam-bs [08:25] *** Mateon1 has quit IRC (Remote host closed the connection) [08:25] *** Mateon1 has joined #archiveteam-bs [09:18] *** kimmer1 has quit IRC (Ping timeout: 633 seconds) [09:34] *** ZexaronS has joined #archiveteam-bs [10:34] *** REiN^ has quit IRC (Remote host closed the connection) [10:42] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [10:55] *** REiN^ has joined #archiveteam-bs [10:55] *** REiN^ has quit IRC (Excess Flood) [10:56] *** REiN^ has joined #archiveteam-bs [11:12] *** Mateon1 has quit IRC (Read error: Operation timed out) [11:12] *** Mateon1 has joined #archiveteam-bs [11:26] so i can't sign up on fedex.com [11:27] i don't know what i'm doing wrong since there is no bold red error saying i didn't fill it out [11:28] the continue button is not clickable [12:02] *** kimmer1 has joined #archiveteam-bs [13:04] *** icedice has joined #archiveteam-bs [13:46] *** refeed has joined #archiveteam-bs [13:50] *** kimmer1 has quit IRC (Remote host closed the connection) [13:58] *** refeed has quit IRC (Leaving) [14:40] *** Cyn_ has joined #archiveteam-bs [14:46] *** jschwart has joined #archiveteam-bs [14:56] SketchCow: FedEx Online Account Registration is not able to process your request at this time. Please try again later or call 1.800.463.3339. [14:56] i really hate fedex now [15:30] *** icedice2 has joined #archiveteam-bs [15:31] *** vitzli has joined #archiveteam-bs [15:36] *** icedice has quit IRC (Read error: Operation timed out) [15:45] *** kimmer1 has joined #archiveteam-bs [15:56] *** zalgo_ has quit IRC (Leaving) [15:57] *** zalgo has quit IRC (Remote host closed the connection) [16:00] *** vitzli has quit IRC (Quit: Leaving) [16:05] *** zalgo has joined #archiveteam-bs [16:32] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [16:36] *** BartoCH has joined #archiveteam-bs [16:37] *** CoolCanuk has joined #archiveteam-bs [16:45] *** dd0a13f37 has joined #archiveteam-bs [16:50] *** icedice2 has quit IRC (Quit: Leaving) [17:25] *** TheLovina has quit IRC (Read error: Operation timed out) [17:28] *** eLbot has joined #archiveteam-bs [17:42] *** TheLovina has joined #archiveteam-bs [17:58] *** zalgo has quit IRC (Remote host closed the connection) [18:36] how about ..... no https://usercontent.irccloud-cdn.com/file/nNf0YmuS/image.png [18:37] what the actual f https://usercontent.irccloud-cdn.com/file/fqq2ciHl/image.png [19:09] *** Cyn_ has quit IRC (Ping timeout: 260 seconds) [20:35] yay, i found my old backups that should have my bitcoinz [20:37] lol, for a second i thought i had 5 of them because the shitty tool showed no unit [20:37] but it is mbtc [20:37] i am rich! [21:01] dude, you made me look at my wallets [21:04] woah, 100 mbtc is worth actual money? That was like, dust [21:05] how can I find a GO pack via domain? https://archive.fart.website doesnt show it [21:08] CoolCanuk: Try searching https://github.com/JustAnotherArchivist/archivebot-archives [21:08] we really need a directory of all our tools. thanks [21:15] *** kimmer2 has quit IRC (Ping timeout: 633 seconds) [21:15] *** K4k has quit IRC (Read error: Connection reset by peer) [21:20] there's an audit page(s) on the wiki where we previously tried to add in links to the final locations for the archives, and any other information- maybe one like that for tools? [21:29] *** schbirid has quit IRC (Read error: Connection reset by peer) [21:30] *** Asparagir has joined #archiveteam-bs [21:32] *** TheLovina has quit IRC (Read error: Connection reset by peer) [21:38] *** kimmer2 has joined #archiveteam-bs [21:38] to be useful, the wiki needs to stay up. a static page would be fine [21:38] maybe I'll make us a symbaloo page [21:38] CoolCanuk: I just built that thing pretty recently, and it's really just a workaround until the viewer is fixed. But yeah, that might take a while, so it would probably make sense to mention it on the wiki somewhere. [21:43] *** dd0a13f37 has quit IRC (Quit: Connection closed for inactivity) [21:44] *** Pixi has quit IRC (Ping timeout: 255 seconds) [22:09] *** K4k has joined #archiveteam-bs [23:09] So we've got all this data but no way to organize and categorize it really. Are there any methods of curation / organization that anyone knows of that works well? [23:09] *** BlueMaxim has joined #archiveteam-bs [23:10] That question definitely needs more details on what you're trying to do. [23:11] Personally, I'm a fan of deeply nested directories and links (symlinks or hardlinks). [23:11] There's also tagging software and all kinds of other stuff. [23:16] *** jschwart has quit IRC (Quit: Konversation terminated!) [23:33] *** TheLovina has joined #archiveteam-bs