#archiveteam 2014-09-15,Mon

↑back Search

Time Nickname Message
02:50 🔗 dx has anyone tried using openshift to run a pipeline?
02:55 🔗 dx well a google search shows me logs of -bs from two years ago so i guess that's a no
03:59 🔗 dx rsync: failed to connect to rsync.archiveteam.kenshin.sg: Permission denied (13)
03:59 🔗 dx :(
03:59 🔗 RKenshin huh
04:00 🔗 dx it's just this weird box full of restrictions
04:00 🔗 RKenshin i'm pretty sure my box is up
04:01 🔗 RKenshin hmm
04:01 🔗 RKenshin wait
04:01 🔗 dx yeah it's just not letting me do outgoing connections to port 873
04:01 🔗 RKenshin :P
04:01 🔗 RKenshin ah nvm not related, u have a firewall
04:01 🔗 dx not exactly a firewall but yeah kinda like that
04:58 🔗 meg AYE OH
05:02 🔗 garyrh OH AYE
05:09 🔗 meg garyrh~
05:09 🔗 meg i'm running a couple of those grab project things
05:10 🔗 meg i've been running some of them for weeks. why are my archives so slow?
05:11 🔗 meg like my server is doing VERY few items
05:21 🔗 dx https://github.com/ArchiveTeam/seesaw-kit/issues/5 :(
05:44 🔗 meg is that related dx
05:45 🔗 meg because i can just change it
05:46 🔗 dx nah i'm just complaining that i can't do it, i'm not using the warrior
05:47 🔗 meg what are you currently using? just 2?
05:48 🔗 dx 15, but i had to stop the thing every time i wanted to change it
05:48 🔗 yipdw meg: if you're doing verizon stuff, it may be because the script is currently recording 423s to a server that hit 100% disk space and is now offline
05:48 🔗 yipdw more concurrency will only make things worse
05:50 🔗 * dx is doing quitpic
05:51 🔗 meg i'm doing pretty much every project
05:51 🔗 meg the one i was referring to was twitpic
06:13 🔗 arkiver We LOST wallbase.cc
06:16 🔗 xmc https://archive.org/details/wallpapers.wallbase.cc-rozne-wallpaper-jpg-1-to-100000-20140130
06:16 🔗 xmc did we?
06:17 🔗 dx that page has a huge sad face
06:18 🔗 dx and mentions the word 'panic'
06:18 🔗 RedType jeez
06:18 🔗 RedType it sounds like the creator of wallbase passed away
06:18 🔗 dx RIP
06:19 🔗 xmc oh. that sucks...
06:19 🔗 RedType well mentioned being sick years ago
06:19 🔗 RedType and then never back since
06:19 🔗 arkiver xmc https://archive.org/details/wallpapers.wallbase.cc-rozne-wallpaper-jpg-1-to-100000-20140130 is far far far from complete
06:19 🔗 RedType and he said some stuff that indicated his sickness was pretty bad
06:19 🔗 xmc ok
06:19 🔗 RedType BUT
06:19 🔗 RedType the twitter claims wallhaven will have all of the old wallpapers
06:20 🔗 RedType alpha.wallhaven.cc
07:14 🔗 dx ugh, just noticed that my pipeline is listening in port 8001 publicly in my VPS
07:16 🔗 Rotab yup
07:16 🔗 dx https://github.com/ArchiveTeam/seesaw-kit/pull/71
07:16 🔗 dx submitted this a while ago to fix a different issue, but now i realized it also means that my --address 127.0.0.1 parameter gets ignored
07:17 🔗 dx ...well it's basically the same issue. it was a server that didn't let me bind to 0.0.0.0, this is a server in which i don't want to bind to 0.0.0.0
11:04 🔗 schbirid dear pipeline maintainer, please disable the webserver by default. some people like a little bit of privacy...
11:21 🔗 lhobas a default firewall setting of drop goes a long way ;)
11:40 🔗 dx http://dump.dequis.org/5IY9m.txt - rsync task failed with out of memory, *and* the rest of the tasks in the pipeline got blocked at that point, i had to ctrl-c :(
11:41 🔗 dx http://dump.dequis.org/zlhbD.png - blocked here, i mean
11:42 🔗 Rotab ah, so its the same bug i ran into yesterday
13:13 🔗 balrog someone archive https://twitter.com/minecraftcpw/with_replies
13:14 🔗 norbert79 Yeah, The deal was made
13:15 🔗 norbert79 2.5 billions
13:17 🔗 trs80 https://notes.pinboard.in/u:vitorio/05dec9f04909d9b6edff "Notes on bookmarks from 1997" 91% link rot, internet archive reduces that to 45%
13:23 🔗 balrog can someone archive that twitter account?
13:23 🔗 balrog I'm not sure how we archive twitter accounts
13:34 🔗 norbert79 http://notch.net/2014/09/im-leaving-mojang/ - wopuld be nice archiving notch.net if there is anything left
13:35 🔗 balrog dx: did you get all those minecraft versions?
13:35 🔗 balrog notch.net, mojang.com, minecraft.net
13:35 🔗 balrog I think we went over those not too long ago
13:45 🔗 dx balrog: all the files indexed in assets.minecraft.net and all the jars/libraries/resources downloaded by the new launcher (which goes all the way back to pre-alphas)
13:45 🔗 balrog good
13:50 🔗 arkiver balrog: does something needs to be archived?
13:55 🔗 joepie91 [15:15] <lhobas> [15:21:28] a default firewall setting of drop goes a long way ;)
13:55 🔗 joepie91 not practical on a serrver
13:55 🔗 joepie91 server *
13:56 🔗 joepie91 balrog: phantomjs
13:58 🔗 joepie91 trs80: that's still at least 44% too much :/
13:58 🔗 joepie91 also
13:58 🔗 joepie91 https://twitter.com/MojangSupport/status/511512688514449411
13:59 🔗 arkiver joepie91: if we need an emergency warrior project for any of these things, let me know
13:59 🔗 joepie91 don't think so
13:59 🔗 joepie91 it's archivebot-able stuff I think
14:00 🔗 arkiver yeah that is
14:00 🔗 arkiver but there are no extremely big communities?
14:00 🔗 joepie91 arkiver: they're independent, afaik?
14:01 🔗 arkiver ok
14:07 🔗 phuzion joepie91: Most Minecraft communities are indeed independent. Doesn't mean none of them are anti-MS, which could lead to a closure sooner than later. We need to keep an eye on this no matter what.
14:08 🔗 joepie91 phuzion: that is a fair point
14:08 🔗 joepie91 and I wouldn't blame them, tbqh
14:08 🔗 joepie91 MS is where awesome things go to die
20:45 🔗 RedType_ my recursive crawl for file sizes of ftp://ftp.cs.tu-berlin.de has produced a log of over 300MB
20:45 🔗 RedType_ i mayyyy not have enough space for the whole thing.
20:48 🔗 aaaaaaaa RedType_: ftp://ftp.cs.tu-berlin.de/INDEX
20:48 🔗 aaaaaaaa not to mention ftp://ftp.cs.tu-berlin.de/du-2014-01-29.log
20:54 🔗 RedType_ aaaaaaaa: yeah but im testing my script. i have my eyes set on dell's ftp and they dont have an index that i could find
20:56 🔗 aaaaaaaa ah
20:56 🔗 aaaaaaaa i can recomment curlftpfs in combination with ncdu
21:14 🔗 aaaaaaaa RedType: <aaaaaaaa> i can recomment curlftpfs in combination with ncdu
21:20 🔗 RedType hmmm... okay. stealing that idea
21:21 🔗 aaaaaaaa there is/was a memory leak in curlftpfs though, dont blame me if it swaps
21:21 🔗 aaaaaaaa iirc it only happened when actually downloading a lot of files
21:54 🔗 dserodio !ao http://corporate.comcast.com/comcast-voices/setting-the-record-straight-on-tor
21:55 🔗 dserodio oops :)

irclogger-viewer