[02:50] has anyone tried using openshift to run a pipeline? [02:55] well a google search shows me logs of -bs from two years ago so i guess that's a no [03:59] rsync: failed to connect to rsync.archiveteam.kenshin.sg: Permission denied (13) [03:59] :( [03:59] huh [04:00] it's just this weird box full of restrictions [04:00] i'm pretty sure my box is up [04:01] hmm [04:01] wait [04:01] yeah it's just not letting me do outgoing connections to port 873 [04:01] :P [04:01] ah nvm not related, u have a firewall [04:01] not exactly a firewall but yeah kinda like that [04:58] AYE OH [05:02] OH AYE [05:09] garyrh~ [05:09] i'm running a couple of those grab project things [05:10] i've been running some of them for weeks. why are my archives so slow? [05:11] like my server is doing VERY few items [05:21] https://github.com/ArchiveTeam/seesaw-kit/issues/5 :( [05:44] is that related dx [05:45] because i can just change it [05:46] nah i'm just complaining that i can't do it, i'm not using the warrior [05:47] what are you currently using? just 2? [05:48] 15, but i had to stop the thing every time i wanted to change it [05:48] meg: if you're doing verizon stuff, it may be because the script is currently recording 423s to a server that hit 100% disk space and is now offline [05:48] more concurrency will only make things worse [05:50] * dx is doing quitpic [05:51] i'm doing pretty much every project [05:51] the one i was referring to was twitpic [06:13] We LOST wallbase.cc [06:16] https://archive.org/details/wallpapers.wallbase.cc-rozne-wallpaper-jpg-1-to-100000-20140130 [06:16] did we? [06:17] that page has a huge sad face [06:18] and mentions the word 'panic' [06:18] jeez [06:18] it sounds like the creator of wallbase passed away [06:18] RIP [06:19] oh. that sucks... [06:19] well mentioned being sick years ago [06:19] and then never back since [06:19] xmc https://archive.org/details/wallpapers.wallbase.cc-rozne-wallpaper-jpg-1-to-100000-20140130 is far far far from complete [06:19] and he said some stuff that indicated his sickness was pretty bad [06:19] ok [06:19] BUT [06:19] the twitter claims wallhaven will have all of the old wallpapers [06:20] alpha.wallhaven.cc [07:14] ugh, just noticed that my pipeline is listening in port 8001 publicly in my VPS [07:16] yup [07:16] https://github.com/ArchiveTeam/seesaw-kit/pull/71 [07:16] submitted this a while ago to fix a different issue, but now i realized it also means that my --address 127.0.0.1 parameter gets ignored [07:17] ...well it's basically the same issue. it was a server that didn't let me bind to 0.0.0.0, this is a server in which i don't want to bind to 0.0.0.0 [11:04] dear pipeline maintainer, please disable the webserver by default. some people like a little bit of privacy... [11:21] a default firewall setting of drop goes a long way ;) [11:40] http://dump.dequis.org/5IY9m.txt - rsync task failed with out of memory, *and* the rest of the tasks in the pipeline got blocked at that point, i had to ctrl-c :( [11:41] http://dump.dequis.org/zlhbD.png - blocked here, i mean [11:42] ah, so its the same bug i ran into yesterday [13:13] someone archive https://twitter.com/minecraftcpw/with_replies [13:14] Yeah, The deal was made [13:15] 2.5 billions [13:17] https://notes.pinboard.in/u:vitorio/05dec9f04909d9b6edff "Notes on bookmarks from 1997" 91% link rot, internet archive reduces that to 45% [13:23] can someone archive that twitter account? [13:23] I'm not sure how we archive twitter accounts [13:34] http://notch.net/2014/09/im-leaving-mojang/ - wopuld be nice archiving notch.net if there is anything left [13:35] dx: did you get all those minecraft versions? [13:35] notch.net, mojang.com, minecraft.net [13:35] I think we went over those not too long ago [13:45] balrog: all the files indexed in assets.minecraft.net and all the jars/libraries/resources downloaded by the new launcher (which goes all the way back to pre-alphas) [13:45] good [13:50] balrog: does something needs to be archived? [13:55] [15:15] [15:21:28] a default firewall setting of drop goes a long way ;) [13:55] not practical on a serrver [13:55] server * [13:56] balrog: phantomjs [13:58] trs80: that's still at least 44% too much :/ [13:58] also [13:58] https://twitter.com/MojangSupport/status/511512688514449411 [13:59] joepie91: if we need an emergency warrior project for any of these things, let me know [13:59] don't think so [13:59] it's archivebot-able stuff I think [14:00] yeah that is [14:00] but there are no extremely big communities? [14:00] arkiver: they're independent, afaik? [14:01] ok [14:07] joepie91: Most Minecraft communities are indeed independent. Doesn't mean none of them are anti-MS, which could lead to a closure sooner than later. We need to keep an eye on this no matter what. [14:08] phuzion: that is a fair point [14:08] and I wouldn't blame them, tbqh [14:08] MS is where awesome things go to die [20:45] my recursive crawl for file sizes of ftp://ftp.cs.tu-berlin.de has produced a log of over 300MB [20:45] i mayyyy not have enough space for the whole thing. [20:48] RedType_: ftp://ftp.cs.tu-berlin.de/INDEX [20:48] not to mention ftp://ftp.cs.tu-berlin.de/du-2014-01-29.log [20:54] aaaaaaaa: yeah but im testing my script. i have my eyes set on dell's ftp and they dont have an index that i could find [20:56] ah [20:56] i can recomment curlftpfs in combination with ncdu [21:14] RedType: i can recomment curlftpfs in combination with ncdu [21:20] hmmm... okay. stealing that idea [21:21] there is/was a memory leak in curlftpfs though, dont blame me if it swaps [21:21] iirc it only happened when actually downloading a lot of files [21:54] !ao http://corporate.comcast.com/comcast-voices/setting-the-record-straight-on-tor [21:55] oops :)