Time |
Nickname |
Message |
02:50
🔗
|
dx |
has anyone tried using openshift to run a pipeline? |
02:55
🔗
|
dx |
well a google search shows me logs of -bs from two years ago so i guess that's a no |
03:59
🔗
|
dx |
rsync: failed to connect to rsync.archiveteam.kenshin.sg: Permission denied (13) |
03:59
🔗
|
dx |
:( |
03:59
🔗
|
RKenshin |
huh |
04:00
🔗
|
dx |
it's just this weird box full of restrictions |
04:00
🔗
|
RKenshin |
i'm pretty sure my box is up |
04:01
🔗
|
RKenshin |
hmm |
04:01
🔗
|
RKenshin |
wait |
04:01
🔗
|
dx |
yeah it's just not letting me do outgoing connections to port 873 |
04:01
🔗
|
RKenshin |
:P |
04:01
🔗
|
RKenshin |
ah nvm not related, u have a firewall |
04:01
🔗
|
dx |
not exactly a firewall but yeah kinda like that |
04:58
🔗
|
meg |
AYE OH |
05:02
🔗
|
garyrh |
OH AYE |
05:09
🔗
|
meg |
garyrh~ |
05:09
🔗
|
meg |
i'm running a couple of those grab project things |
05:10
🔗
|
meg |
i've been running some of them for weeks. why are my archives so slow? |
05:11
🔗
|
meg |
like my server is doing VERY few items |
05:21
🔗
|
dx |
https://github.com/ArchiveTeam/seesaw-kit/issues/5 :( |
05:44
🔗
|
meg |
is that related dx |
05:45
🔗
|
meg |
because i can just change it |
05:46
🔗
|
dx |
nah i'm just complaining that i can't do it, i'm not using the warrior |
05:47
🔗
|
meg |
what are you currently using? just 2? |
05:48
🔗
|
dx |
15, but i had to stop the thing every time i wanted to change it |
05:48
🔗
|
yipdw |
meg: if you're doing verizon stuff, it may be because the script is currently recording 423s to a server that hit 100% disk space and is now offline |
05:48
🔗
|
yipdw |
more concurrency will only make things worse |
05:50
🔗
|
* |
dx is doing quitpic |
05:51
🔗
|
meg |
i'm doing pretty much every project |
05:51
🔗
|
meg |
the one i was referring to was twitpic |
06:13
🔗
|
arkiver |
We LOST wallbase.cc |
06:16
🔗
|
xmc |
https://archive.org/details/wallpapers.wallbase.cc-rozne-wallpaper-jpg-1-to-100000-20140130 |
06:16
🔗
|
xmc |
did we? |
06:17
🔗
|
dx |
that page has a huge sad face |
06:18
🔗
|
dx |
and mentions the word 'panic' |
06:18
🔗
|
RedType |
jeez |
06:18
🔗
|
RedType |
it sounds like the creator of wallbase passed away |
06:18
🔗
|
dx |
RIP |
06:19
🔗
|
xmc |
oh. that sucks... |
06:19
🔗
|
RedType |
well mentioned being sick years ago |
06:19
🔗
|
RedType |
and then never back since |
06:19
🔗
|
arkiver |
xmc https://archive.org/details/wallpapers.wallbase.cc-rozne-wallpaper-jpg-1-to-100000-20140130 is far far far from complete |
06:19
🔗
|
RedType |
and he said some stuff that indicated his sickness was pretty bad |
06:19
🔗
|
xmc |
ok |
06:19
🔗
|
RedType |
BUT |
06:19
🔗
|
RedType |
the twitter claims wallhaven will have all of the old wallpapers |
06:20
🔗
|
RedType |
alpha.wallhaven.cc |
07:14
🔗
|
dx |
ugh, just noticed that my pipeline is listening in port 8001 publicly in my VPS |
07:16
🔗
|
Rotab |
yup |
07:16
🔗
|
dx |
https://github.com/ArchiveTeam/seesaw-kit/pull/71 |
07:16
🔗
|
dx |
submitted this a while ago to fix a different issue, but now i realized it also means that my --address 127.0.0.1 parameter gets ignored |
07:17
🔗
|
dx |
...well it's basically the same issue. it was a server that didn't let me bind to 0.0.0.0, this is a server in which i don't want to bind to 0.0.0.0 |
11:04
🔗
|
schbirid |
dear pipeline maintainer, please disable the webserver by default. some people like a little bit of privacy... |
11:21
🔗
|
lhobas |
a default firewall setting of drop goes a long way ;) |
11:40
🔗
|
dx |
http://dump.dequis.org/5IY9m.txt - rsync task failed with out of memory, *and* the rest of the tasks in the pipeline got blocked at that point, i had to ctrl-c :( |
11:41
🔗
|
dx |
http://dump.dequis.org/zlhbD.png - blocked here, i mean |
11:42
🔗
|
Rotab |
ah, so its the same bug i ran into yesterday |
13:13
🔗
|
balrog |
someone archive https://twitter.com/minecraftcpw/with_replies |
13:14
🔗
|
norbert79 |
Yeah, The deal was made |
13:15
🔗
|
norbert79 |
2.5 billions |
13:17
🔗
|
trs80 |
https://notes.pinboard.in/u:vitorio/05dec9f04909d9b6edff "Notes on bookmarks from 1997" 91% link rot, internet archive reduces that to 45% |
13:23
🔗
|
balrog |
can someone archive that twitter account? |
13:23
🔗
|
balrog |
I'm not sure how we archive twitter accounts |
13:34
🔗
|
norbert79 |
http://notch.net/2014/09/im-leaving-mojang/ - wopuld be nice archiving notch.net if there is anything left |
13:35
🔗
|
balrog |
dx: did you get all those minecraft versions? |
13:35
🔗
|
balrog |
notch.net, mojang.com, minecraft.net |
13:35
🔗
|
balrog |
I think we went over those not too long ago |
13:45
🔗
|
dx |
balrog: all the files indexed in assets.minecraft.net and all the jars/libraries/resources downloaded by the new launcher (which goes all the way back to pre-alphas) |
13:45
🔗
|
balrog |
good |
13:50
🔗
|
arkiver |
balrog: does something needs to be archived? |
13:55
🔗
|
joepie91 |
[15:15] <lhobas> [15:21:28] a default firewall setting of drop goes a long way ;) |
13:55
🔗
|
joepie91 |
not practical on a serrver |
13:55
🔗
|
joepie91 |
server * |
13:56
🔗
|
joepie91 |
balrog: phantomjs |
13:58
🔗
|
joepie91 |
trs80: that's still at least 44% too much :/ |
13:58
🔗
|
joepie91 |
also |
13:58
🔗
|
joepie91 |
https://twitter.com/MojangSupport/status/511512688514449411 |
13:59
🔗
|
arkiver |
joepie91: if we need an emergency warrior project for any of these things, let me know |
13:59
🔗
|
joepie91 |
don't think so |
13:59
🔗
|
joepie91 |
it's archivebot-able stuff I think |
14:00
🔗
|
arkiver |
yeah that is |
14:00
🔗
|
arkiver |
but there are no extremely big communities? |
14:00
🔗
|
joepie91 |
arkiver: they're independent, afaik? |
14:01
🔗
|
arkiver |
ok |
14:07
🔗
|
phuzion |
joepie91: Most Minecraft communities are indeed independent. Doesn't mean none of them are anti-MS, which could lead to a closure sooner than later. We need to keep an eye on this no matter what. |
14:08
🔗
|
joepie91 |
phuzion: that is a fair point |
14:08
🔗
|
joepie91 |
and I wouldn't blame them, tbqh |
14:08
🔗
|
joepie91 |
MS is where awesome things go to die |
20:45
🔗
|
RedType_ |
my recursive crawl for file sizes of ftp://ftp.cs.tu-berlin.de has produced a log of over 300MB |
20:45
🔗
|
RedType_ |
i mayyyy not have enough space for the whole thing. |
20:48
🔗
|
aaaaaaaa |
RedType_: ftp://ftp.cs.tu-berlin.de/INDEX |
20:48
🔗
|
aaaaaaaa |
not to mention ftp://ftp.cs.tu-berlin.de/du-2014-01-29.log |
20:54
🔗
|
RedType_ |
aaaaaaaa: yeah but im testing my script. i have my eyes set on dell's ftp and they dont have an index that i could find |
20:56
🔗
|
aaaaaaaa |
ah |
20:56
🔗
|
aaaaaaaa |
i can recomment curlftpfs in combination with ncdu |
21:14
🔗
|
aaaaaaaa |
RedType: <aaaaaaaa> i can recomment curlftpfs in combination with ncdu |
21:20
🔗
|
RedType |
hmmm... okay. stealing that idea |
21:21
🔗
|
aaaaaaaa |
there is/was a memory leak in curlftpfs though, dont blame me if it swaps |
21:21
🔗
|
aaaaaaaa |
iirc it only happened when actually downloading a lot of files |
21:54
🔗
|
dserodio |
!ao http://corporate.comcast.com/comcast-voices/setting-the-record-straight-on-tor |
21:55
🔗
|
dserodio |
oops :) |