#archiveteam-bs 2015-04-20,Mon

↑back Search

Time Nickname Message
00:20 🔗 dashcloud has quit IRC (Read error: Operation timed out)
00:24 🔗 dashcloud has joined #archiveteam-bs
00:33 🔗 SketchCow later
01:01 🔗 ohhdemgir https://wildarchives.com/r/The.Hacker.Wars.2014.1080p.mkv.torrent
01:01 🔗 ohhdemgir magnet:?xt=urn:btih:38fe4b53be18646b65784d9b543ee39145e73cda&dn=The.Hacker.Wars.2014.1080p.mkv
01:01 🔗 phillipsj kyan you can probably install qemu under Windows
01:03 🔗 * phillipsj always feels awkward making a cmment like that after more than an hour's delay without checking first.
01:12 🔗 phillipsj I may be able to find an OS/2 Warp Beta CD that was supposed to be destroyed within 90 days of so. (we did not have a machine capable of running it until years later)
01:17 🔗 xmc joepie91: there was nodejs in there too
01:17 🔗 xmc joepie91: i can tell the difference between js and ruby, thank you very much
01:46 🔗 dashcloud has quit IRC (Read error: Operation timed out)
01:49 🔗 dashcloud has joined #archiveteam-bs
02:02 🔗 kyan has quit IRC (Quit: Leaving)
02:08 🔗 kyan has joined #archiveteam-bs
02:13 🔗 xmc well well well
02:13 🔗 xmc http://xn--zoty-01a.xrtc.net/feeboop/
02:14 🔗 xmc i have a feeboop project
02:30 🔗 primus105 has quit IRC (Leaving.)
02:31 🔗 yipdw xmc: cool, load it with items and let's see if it works
02:33 🔗 xmc i'm trying to figure out how to set up syncing from the current tracker to the new one
02:33 🔗 xmc i'm also waiting for the restroom at this coffeeshop to open up
02:33 🔗 xmc so it might be kind of spotty for a minute
02:38 🔗 yipdw I find it amusing to think that the restroom and tracker sync are related
02:38 🔗 yipdw xmc: if you'd like I can work on that
02:38 🔗 yipdw slaving Redis on tracker1 to tracker2 over ssh should suffice
02:38 🔗 xmc i'll do it myself and then you can look over it :)
02:39 🔗 yipdw er
02:39 🔗 yipdw slave Redis on tracker2 to tracker1
02:39 🔗 yipdw the other way is a Bad Idea
02:39 🔗 yipdw that'll overwrite tracker1 with a bunch of nothing
02:40 🔗 yipdw ooooh
02:40 🔗 yipdw we might be able to use Redis Cluster now
02:41 🔗 xmc yeah, it would be a bunch of nothing
02:41 🔗 xmc what does Cluster get us?
02:41 🔗 yipdw failover
02:42 🔗 xmc i want to retire tracker1 because it costs me $40 a month and tracker2 is on hardware i'm already paying for
02:42 🔗 yipdw that usually isn't our problem though
02:42 🔗 yipdw our problem is that we have too much shit in the working set
02:42 🔗 xmc yea
02:42 🔗 yipdw Cluster won't help with that directly; to fix that we need to move towards a scheme where we use consistent hashing or something to split up sets
02:42 🔗 yipdw OR
02:43 🔗 yipdw we just keep doing what we do now
02:43 🔗 yipdw which frankly has worked fine
02:43 🔗 xmc it'll be fiiiine
02:43 🔗 yipdw consistent hashing has a higher HN arousal factor
02:43 🔗 yipdw which come to think of it means we shouldn't do it
02:44 🔗 xmc amen, so mote it be
02:49 🔗 yipdw there's something perversely fun about playing with the Bugatti Veyron configurator and making the ugliest car ever
02:54 🔗 yipdw e.g. https://imgur.com/de6aBZY
02:54 🔗 yipdw (this has nothing to do with the tracker; this is just what I do while I wait for Jenkins)
02:57 🔗 xmc rottenbananacar
02:59 🔗 xmc hm
03:00 🔗 xmc oh my
03:00 🔗 xmc did i fuck something up
03:03 🔗 xmc ah, i should have not configured the leader to have authentication
03:03 🔗 xmc security who needs it
03:03 🔗 yipdw ?
03:04 🔗 yipdw oh, in Redis?
03:04 🔗 xmc i did config requirepass fwoyutalsltrjotars
03:04 🔗 xmc and then everything broke
03:04 🔗 xmc but i undid it and it seems to be back to normal
03:04 🔗 yipdw hm
03:04 🔗 yipdw oh yeah, the tracker doesn't pass a password
03:04 🔗 xmc in the old tracker yes
03:04 🔗 yipdw if you're restricting it to bind to localhost and only tunnel to it via e.g. ssh the password's kinda meh
03:04 🔗 xmc yea
03:12 🔗 xmc reptilication is not reptiling
03:12 🔗 xmc come see?
03:13 🔗 yipdw what
03:13 🔗 yipdw oh shell in?
03:13 🔗 xmc yeah i think so
03:13 🔗 xmc > slaveof 127.0.0.1 6363
03:13 🔗 xmc OK Already connected to specified master
03:14 🔗 xmc not sure how to restart it and see if that redoes
03:15 🔗 xmc ?
03:15 🔗 yipdw so, the link to the master is established:
03:15 🔗 yipdw # Replication
03:15 🔗 yipdw role:slave
03:15 🔗 yipdw master_host:127.0.0.1
03:15 🔗 yipdw master_port:6363
03:15 🔗 yipdw is the tunnel up?
03:15 🔗 xmc yes
03:15 🔗 yipdw hmm yes
03:15 🔗 yipdw ok
03:15 🔗 xmc it's giving a bunch of
03:15 🔗 xmc debug1: Connection to port 6363 forwarding to localhost port 6379 requested.
03:15 🔗 xmc debug1: channel 3: new [direct-tcpip]
03:15 🔗 xmc debug1: channel 3: free: direct-tcpip: listening port 6363 for localhost port 6379, connect from 127.0.0.1 port 51582 to 127.0.0.1 port 6363, nchannels 4
03:15 🔗 xmc repeat infinitely every second or so
03:16 🔗 yipdw well, redis-cli -p 6363 works
03:16 🔗 yipdw one sec, let me try SLAVEOF NO ONE and reestablish the link
03:16 🔗 xmc ok
03:16 🔗 yipdw hmm wtf
03:16 🔗 xmc now it's back to reconnect-loop ing
03:16 🔗 xmc oh you know what
03:16 🔗 xmc i told it that it needs to auth
03:16 🔗 yipdw oh
03:17 🔗 yipdw I cut the slave link, feel free to try again whenever
03:17 🔗 xmc k
03:18 🔗 xmc ok now it's connected
03:19 🔗 xmc hrm
03:21 🔗 yipdw it's up
03:21 🔗 yipdw if you want to see it run redis-cli monitor and terminate it ASAP
03:21 🔗 xmc cool
03:21 🔗 yipdw actually
03:22 🔗 yipdw at this point we should be able to connect to Tracker Neue Italic and watch the same data
03:22 🔗 xmc http://złoty.xrtc.net/lastfm/ is saying no such project, as are many of the others
03:22 🔗 yipdw it's fine, they probably haven't been fully replicated
03:22 🔗 yipdw http://tracker.archiveteam.org/furaffinity/ is there
03:22 🔗 yipdw er
03:22 🔗 yipdw ...
03:22 🔗 yipdw fuck me I am a dumb
03:22 🔗 xmc the links are pretty cool.
03:22 🔗 xmc er
03:23 🔗 xmc the absolute links are pretty cool.
03:23 🔗 yipdw yeah I guess it hasn't fully replicated
03:23 🔗 xmc ah
03:23 🔗 xmc it probably depends on keys which come last, eh
03:23 🔗 yipdw I don't know what the order is
03:23 🔗 xmc random!
03:23 🔗 yipdw Redis will tell you on the server console when it's caught up
03:23 🔗 xmc server console = ?
03:23 🔗 yipdw stderr where redis-server is running
03:23 🔗 yipdw or server log
03:24 🔗 yipdw hmm
03:24 🔗 yipdw 13844:S 19 Apr 20:18:16.913 * MASTER <-> SLAVE sync: receiving 171366370 bytes from master
03:24 🔗 yipdw 13844:S 19 Apr 20:18:50.108 * MASTER <-> SLAVE sync: Flushing old data
03:24 🔗 yipdw 13844:S 19 Apr 20:18:52.546 * MASTER <-> SLAVE sync: Loading DB in memory
03:24 🔗 yipdw 13844:S 19 Apr 20:18:56.371 * MASTER <-> SLAVE sync: Finished with success
03:24 🔗 * xmc thinks really hard about where that is
03:24 🔗 yipdw /var/log/redis_6379.log
03:24 🔗 xmc oooh cool
03:24 🔗 xmc logs
03:24 🔗 yipdw yeah, hmm
03:24 🔗 yipdw something might be misconfigured
03:25 🔗 yipdw global-admin on Tracker Neue Extrabold isn't locked down, so yeah that hasn't made it over
03:25 🔗 xmc extrabold? shouldn't it be demibold?
03:26 🔗 yipdw ¯\_(ツ)_/¯
03:26 🔗 yipdw oh wait
03:26 🔗 yipdw you're using db1 ?
03:26 🔗 yipdw er db 1
03:26 🔗 xmc yeah, as in the instructions :)
03:26 🔗 yipdw hmm
03:27 🔗 yipdw all the tracker config data is in db 0
03:27 🔗 xmc relatedly, i added my systemd recipes to the wiki page
03:27 🔗 yipdw oh
03:27 🔗 xmc i'm treating this as a documentation validity check :)
03:27 🔗 yipdw so uh
03:27 🔗 Start has quit IRC (Read error: Connection reset by peer)
03:27 🔗 yipdw the old tracker uses db 1 for warriorhq
03:27 🔗 yipdw db 0 is where the tracker is
03:28 🔗 xmc these are different?
03:28 🔗 yipdw yes
03:28 🔗 Start has joined #archiveteam-bs
03:28 🔗 xmc huh
03:28 🔗 xmc where do i read more
03:28 🔗 yipdw Redis supports different databases
03:28 🔗 yipdw 16 by default
03:28 🔗 xmc i have *not* been paying attention to anything in archiveteam infrastructure for the past few years
03:28 🔗 yipdw one sec
03:29 🔗 xmc nice. a 4-bit field
03:29 🔗 xmc like a baws
03:29 🔗 yipdw so basically
03:29 🔗 yipdw http://redis.io/commands/select
03:29 🔗 xmc yeah i understnad the idea of multiple databases
03:29 🔗 xmc i mean i don't know what is the difference between tracker and warriorhq
03:29 🔗 yipdw oh
03:29 🔗 yipdw warriorhq is http://warriorhq.archiveteam.org/
03:30 🔗 yipdw it's the warrior map
03:30 🔗 xmc oh!
03:30 🔗 xmc huh, ok
03:30 🔗 xmc i'll change that 1 to a 0
03:30 🔗 yipdw done
03:30 🔗 xmc did you restart it
03:31 🔗 yipdw nope
03:31 🔗 yipdw I don't know how
03:31 🔗 xmc ok i will
03:31 🔗 yipdw service tracker restart?
03:31 🔗 yipdw (now we see the gulf between dev and ops)
03:31 🔗 xmc sudo systemctl restart nginx-tracker
03:31 🔗 xmc today i have also learned systemd
03:32 🔗 yipdw that's what I want AR glasses for
03:32 🔗 yipdw trophy/achievement notifications in the upper-right part of my vision
03:32 🔗 xmc ok now the global-admin thing wants me to auth
03:32 🔗 xmc hm
03:32 🔗 yipdw goo
03:32 🔗 yipdw d
03:32 🔗 xmc do i have an global-admin account?
03:32 🔗 yipdw I dunno
03:32 🔗 yipdw I can make one once I get in
03:32 🔗 * xmc nods
03:32 🔗 xmc 'd appreciate it
03:33 🔗 xmc i think i have one but forget what it is
03:33 🔗 yipdw if possible it'd be cool to have https access to tracker
03:33 🔗 xmc yeah i can make a cert in a bit
03:34 🔗 yipdw uh hmm
03:34 🔗 yipdw I can't update your password
03:34 🔗 yipdw that's cool
03:35 🔗 xmc it doesn't like it
03:35 🔗 xmc what's the username?
03:35 🔗 yipdw I haven't updated it yet
03:35 🔗 yipdw I got a 500 on password submit
03:35 🔗 xmc oh
03:35 🔗 xmc huh
03:35 🔗 yipdw username is chronomex
03:35 🔗 xmc are you working on tracker or zloty?
03:35 🔗 xmc it's a one-way sync
03:35 🔗 yipdw zloty
03:36 🔗 yipdw where's the nginx log?
03:36 🔗 xmc try doing the same thing on tracker 1
03:36 🔗 xmc since zloty is a follower, maybe the db rejects the update
03:36 🔗 yipdw ok updated
03:36 🔗 xmc wee
03:37 🔗 yipdw we gotta get rid of some of these projects
03:37 🔗 xmc clearly
03:38 🔗 xmc the websocket isn't really attaching, it seems
03:43 🔗 yipdw yeah
03:43 🔗 yipdw also stats.json is 500ing
03:43 🔗 xmc ok
03:44 🔗 xmc i'm going to take a victory lap
03:44 🔗 xmc back in a few minutes
03:52 🔗 yipdw oh
03:52 🔗 yipdw App 29838 stderr: RuntimeError - READONLY You can't write against a read only slave.:
03:53 🔗 yipdw yeah
03:53 🔗 yipdw we need to sever the connection before, like, anything'll work
03:56 🔗 yipdw xmc: once the slave connection is cut it looks like things are good
03:58 🔗 * xmc nods
03:58 🔗 xmc i'm not quite ready to cutover
03:58 🔗 xmc we'll need to repoint tracker.archiveteam.org which is under SketchCow's jurisdiction
03:58 🔗 xmc also i think i need to set up the urlteam stuff on zloty
04:01 🔗 yipdw ok
04:02 🔗 xmc so i think the order for cutover would be: stop handing out, wait for returns to die down, sever replication, make tracker2 writeable, repoint dns
04:02 🔗 xmc does this sound correct ish?
04:03 🔗 aaaaaaaaa has quit IRC (Leaving)
04:05 🔗 yipdw yeah
04:05 🔗 yipdw you'll lose maybe about a day of warrior work
04:06 🔗 yipdw sever replication and make tracker2 writeable are the same step
04:06 🔗 xmc ah interesting
04:06 🔗 xmc a day of lost worktime, but no data loss? ok
04:06 🔗 yipdw well
04:06 🔗 yipdw there may be some warrior that is very very slow
04:07 🔗 yipdw but aside from that you're fine
04:07 🔗 xmc right
04:07 🔗 xmc let's do that in a day or two
04:07 🔗 xmc i'll look into moving over the urlteam shiz now
04:07 🔗 ersi has quit IRC (Read error: Operation timed out)
04:09 🔗 yipdw as far as I know the urlteam tracker has much less complex dependency work
04:09 🔗 yipdw pip install et
04:09 🔗 yipdw c
04:09 🔗 xmc yet another package system!
04:10 🔗 xmc :D
04:10 🔗 yipdw gem pip npm apt yum
04:11 🔗 yipdw I hope there is a package system named YAPS
04:13 🔗 yipdw also mmm https://www.youtube.com/watch?v=YlEb3L1PIco
04:21 🔗 xmc the a/v sync on my machine is ever so slightly off
04:21 🔗 xmc irritating
04:21 🔗 xmc or maybe it's the video
04:21 🔗 yipdw it seems ok here
04:21 🔗 xmc what the heck am i watching
04:22 🔗 yipdw I'm not entirely sure but I do love the music
04:22 🔗 yipdw it's like a slightly darker version of Avan Lava
04:22 🔗 xmc ok
04:22 🔗 yipdw or something
04:57 🔗 ersi has joined #archiveteam-bs
04:57 🔗 swebb sets mode: +o ersi
05:19 🔗 pikhq has quit IRC (Ping timeout: 506 seconds)
05:44 🔗 Ctrl-S is there a best way to run youtube-dl?
05:44 🔗 Ctrl-S like a reccomended output structure and arguments?
05:45 🔗 dashcloud has quit IRC (Read error: Operation timed out)
05:46 🔗 yipdw youtube-dl URL usually does fine
05:46 🔗 Ctrl-S just sort by channelname or something?
05:49 🔗 dashcloud has joined #archiveteam-bs
05:52 🔗 Ctrl-S i think i've got it
05:56 🔗 pikhq has joined #archiveteam-bs
05:59 🔗 dashcloud has quit IRC (Read error: Operation timed out)
06:03 🔗 dashcloud has joined #archiveteam-bs
06:16 🔗 dashcloud has quit IRC (Read error: Operation timed out)
06:19 🔗 dashcloud has joined #archiveteam-bs
06:22 🔗 dashcloud has quit IRC (Read error: Operation timed out)
06:25 🔗 kyan has quit IRC (Remote host closed the connection)
06:25 🔗 dashcloud has joined #archiveteam-bs
07:38 🔗 kyan has joined #archiveteam-bs
07:43 🔗 primus104 has joined #archiveteam-bs
08:30 🔗 primus104 has quit IRC (Leaving.)
08:39 🔗 godane SketchCow: i got 2 things that i'm archiving that you may like
08:39 🔗 godane one is the ftp://lists.gnu.org
08:40 🔗 godane and other is The Electrical Worker Journal
09:01 🔗 kyan has quit IRC (Quit: Leaving)
09:15 🔗 schbirid has joined #archiveteam-bs
10:06 🔗 primus104 has joined #archiveteam-bs
10:40 🔗 vitzli has joined #archiveteam-bs
10:49 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
10:49 🔗 dashcloud has joined #archiveteam-bs
12:18 🔗 BlueMaxim has quit IRC (Read error: Connection reset by peer)
12:24 🔗 primus104 has quit IRC (Leaving.)
13:37 🔗 sankin has joined #archiveteam-bs
13:50 🔗 Start has quit IRC (Disconnected.)
13:50 🔗 Start has joined #archiveteam-bs
13:50 🔗 Start has quit IRC (Client Quit)
13:52 🔗 schbirid has quit IRC (Read error: Operation timed out)
14:03 🔗 schbirid has joined #archiveteam-bs
14:07 🔗 dashcloud has quit IRC (Read error: Operation timed out)
14:09 🔗 dashcloud has joined #archiveteam-bs
14:34 🔗 vitzli has quit IRC (Quit: Leaving)
14:37 🔗 Start has joined #archiveteam-bs
14:57 🔗 Start has quit IRC (Disconnected.)
14:57 🔗 winr4r has quit IRC (Read error: Operation timed out)
14:57 🔗 primus104 has joined #archiveteam-bs
15:01 🔗 Start has joined #archiveteam-bs
15:04 🔗 Start has quit IRC (Read error: Connection reset by peer)
15:09 🔗 Stary2001 has quit IRC (Quit: Going to explore the internet!)
15:18 🔗 primus104 has quit IRC (Leaving.)
15:20 🔗 toad1 has joined #archiveteam-bs
15:24 🔗 winr4r has joined #archiveteam-bs
15:26 🔗 toad2 has quit IRC (Read error: Operation timed out)
15:59 🔗 Start has joined #archiveteam-bs
16:00 🔗 primus104 has joined #archiveteam-bs
16:00 🔗 Start has quit IRC (Remote host closed the connection)
16:01 🔗 Start has joined #archiveteam-bs
16:02 🔗 Start has quit IRC (Client Quit)
16:06 🔗 Start has joined #archiveteam-bs
16:18 🔗 mistym has joined #archiveteam-bs
16:19 🔗 dashcloud has quit IRC (Read error: Operation timed out)
16:24 🔗 SimpBrain has joined #archiveteam-bs
16:24 🔗 Rotab has quit IRC (Ping timeout: 198 seconds)
16:26 🔗 dashcloud has joined #archiveteam-bs
16:31 🔗 Rotab has joined #archiveteam-bs
16:41 🔗 dashcloud has quit IRC (Read error: Operation timed out)
16:43 🔗 Start has quit IRC (Disconnected.)
16:45 🔗 dashcloud has joined #archiveteam-bs
16:54 🔗 Start has joined #archiveteam-bs
17:00 🔗 aaaaaaaaa has joined #archiveteam-bs
17:26 🔗 kyan has joined #archiveteam-bs
17:42 🔗 Start has quit IRC (Disconnected.)
17:53 🔗 tephra_ has joined #archiveteam-bs
18:02 🔗 balrog has quit IRC (Read error: Operation timed out)
18:07 🔗 primus104 has quit IRC (Leaving.)
18:19 🔗 balrog has joined #archiveteam-bs
18:19 🔗 swebb sets mode: +o balrog
18:22 🔗 schbirid so i still have 16000 jamendo albums i need to clean out. i want to delete everything that is still online. i used the api to get all "artistname"s and "albumnane"s, then did "rm artist - album *". any ideas how to do it better?
18:22 🔗 schbirid in terms of deleting more (yea yeah you have a funny idea now)
18:22 🔗 schbirid i cant believe that there would be 16k deleted albums since 2011
18:24 🔗 schbirid ah, lower/uppercase changes happened
18:24 🔗 schbirid Adragante - harpe celtique et flute
18:24 🔗 schbirid Adragante - Harpe celtique et flute
18:25 🔗 schbirid oh god, what do i do
18:25 🔗 schbirid can i hardlink and rename all links to lowercase without changing the original filename?
18:29 🔗 schbirid yeah, that should work
18:32 🔗 schbirid this gives me "ln: target ‘[www.jamendo.com].zip"’ is not a directory" though :(
18:32 🔗 schbirid for file in ../albums/*; do ln "${file}" $(basename "${file}"); done
18:34 🔗 schbirid not with \" around them either
18:34 🔗 schbirid works perfectly fine if i echo it into a file and run as bash script, wee
18:35 🔗 schbirid oh lol, i just rm'd a lot.
18:35 🔗 * schbirid learns hardlinks the right way
18:46 🔗 Start has joined #archiveteam-bs
18:48 🔗 schbirid wait, that's fine as it just removed one link. i dont get hardlinks after all
18:56 🔗 dashcloud has quit IRC (Read error: Operation timed out)
18:59 🔗 dashcloud has joined #archiveteam-bs
19:00 🔗 Start has quit IRC (Disconnected.)
19:01 🔗 mistym has quit IRC (Leaving)
19:05 🔗 joepie91 amazingly good footage: https://youtu.be/YqWmislcIRk?t=7m52s
19:08 🔗 primus104 has joined #archiveteam-bs
19:10 🔗 dashcloud has quit IRC (Read error: Operation timed out)
19:14 🔗 dashcloud has joined #archiveteam-bs
19:15 🔗 schbirid got it working
19:32 🔗 dashcloud has quit IRC (Read error: Operation timed out)
19:32 🔗 kyan has quit IRC (Quit: Leaving)
19:33 🔗 Start has joined #archiveteam-bs
19:35 🔗 dashcloud has joined #archiveteam-bs
19:40 🔗 schbirid still 15k :(
19:49 🔗 SN4T14__ has joined #archiveteam-bs
19:55 🔗 SN4T14_ has quit IRC (Ping timeout: 369 seconds)
20:18 🔗 SimpBrain has quit IRC (Quit: Leaving)
20:22 🔗 Start has quit IRC (Disconnected.)
20:28 🔗 mistym has joined #archiveteam-bs
20:29 🔗 Start has joined #archiveteam-bs
20:57 🔗 sankin has quit IRC (Leaving.)
21:12 🔗 schbirid has quit IRC (Leaving)
21:19 🔗 Start has quit IRC (Disconnected.)
21:50 🔗 kyan has joined #archiveteam-bs
22:24 🔗 dashcloud has quit IRC (Read error: Operation timed out)
22:27 🔗 dashcloud has joined #archiveteam-bs
22:30 🔗 ersi has quit IRC (Ping timeout: 240 seconds)
22:37 🔗 thechip has quit IRC (Read error: Connection reset by peer)
22:41 🔗 Start has joined #archiveteam-bs
22:42 🔗 Start-mob has joined #archiveteam-bs
22:44 🔗 ersi has joined #archiveteam-bs
22:44 🔗 swebb sets mode: +o ersi
22:51 🔗 Start-mob has quit IRC (Remote host closed the connection)
23:05 🔗 rolfb has joined #archiveteam-bs
23:26 🔗 rolfb has quit IRC (Leaving...)
23:33 🔗 dPhoenix has joined #archiveteam-bs
23:57 🔗 Ctrl-S has quit IRC (Read error: Operation timed out)
irclogger-viewer