#archiveteam-bs 2016-12-24,Sat

↑back Search

Time Nickname Message
00:07 πŸ”— jrwr has joined #archiveteam-bs
00:14 πŸ”— Frogging hook54321: youtube-dl can do it, look at that
00:15 πŸ”— hook54321 By just giving it the channel url?
00:15 πŸ”— Frogging yeah. IIRC there's an option to make it write out the list of videos
00:15 πŸ”— Frogging (it will also download all the videos on a channel if you want it to)
00:16 πŸ”— hook54321 I'm assuming it doesn't get unlisted videos, right?
00:18 πŸ”— Frogging It just scrapes the channel's uploads list, so no
00:19 πŸ”— Frogging youtube-dl can also handle playlist URLs. It's possible that unlisted videos show up in playlists, and if they do it would grab them
00:19 πŸ”— BlueMaxim has quit IRC (Quit: Leaving)
00:19 πŸ”— Frogging When I say possible I mean that I thought I saw it happen but I'm not sure
00:22 πŸ”— REiN^ has quit IRC (Max SendQ exceeded)
00:23 πŸ”— yipdw Frogging: yes, youtube-dl >= 2016.06.25 (probably earlier) handles playlist URLs as you'd expect
00:23 πŸ”— REiN^ has joined #archiveteam-bs
00:30 πŸ”— hook54321 The command options are confusing
00:49 πŸ”— ravetcofx has quit IRC (Ping timeout: 506 seconds)
00:50 πŸ”— yipdw hook54321: it's youtube-dl PLAYLIST_URL, not much to type
00:51 πŸ”— hook54321 I want to do a channel, not a playlist though
00:52 πŸ”— yipdw ok
00:52 πŸ”— yipdw youtube-dl CHANNEL_URL
00:52 πŸ”— yipdw same thing
00:53 πŸ”— yipdw youtube-dl generally does a good job of figuring out optimal settings; the options are there if you know what you need to tweak. don't pre-tweak
00:58 πŸ”— ravetcofx has joined #archiveteam-bs
01:33 πŸ”— VADemon has quit IRC (Quit: left4dead)
01:35 πŸ”— VADemon has joined #archiveteam-bs
01:49 πŸ”— mls_ has joined #archiveteam-bs
01:49 πŸ”— mls_ is now known as Kksmkrn
01:52 πŸ”— Kksmkrn has quit IRC (Client Quit)
02:26 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
02:27 πŸ”— Specular_ has joined #archiveteam-bs
02:28 πŸ”— BlueMaxim has joined #archiveteam-bs
03:12 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
03:13 πŸ”— Specular_ has joined #archiveteam-bs
03:50 πŸ”— kniffy is now known as xmaskniff
04:22 πŸ”— Start has quit IRC (Quit: Disconnected.)
04:24 πŸ”— Start has joined #archiveteam-bs
04:31 πŸ”— ndiddy has quit IRC (Quit: Leaving)
04:40 πŸ”— ndiddy has joined #archiveteam-bs
04:59 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
05:02 πŸ”— Specular_ has joined #archiveteam-bs
05:11 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
05:13 πŸ”— Specular_ has joined #archiveteam-bs
05:22 πŸ”— Sk1d has quit IRC (Ping timeout: 250 seconds)
05:29 πŸ”— Sk1d has joined #archiveteam-bs
05:48 πŸ”— ndiddy has quit IRC (Read error: Connection reset by peer)
06:17 πŸ”— ravetcofx has quit IRC (Ping timeout: 864 seconds)
06:27 πŸ”— Start has quit IRC (Quit: Disconnected.)
06:29 πŸ”— Start has joined #archiveteam-bs
06:34 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
06:34 πŸ”— ravetcofx has joined #archiveteam-bs
06:36 πŸ”— Specular_ has joined #archiveteam-bs
06:47 πŸ”— BlueMaxim has quit IRC (Read error: Operation timed out)
06:48 πŸ”— BlueMaxim has joined #archiveteam-bs
07:05 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
07:07 πŸ”— Specular_ has joined #archiveteam-bs
07:40 πŸ”— ae_g_i_s has quit IRC (Ping timeout: 260 seconds)
07:40 πŸ”— GE has joined #archiveteam-bs
07:46 πŸ”— ae_g_i_s has joined #archiveteam-bs
08:19 πŸ”— ravetcofx has quit IRC (Read error: Operation timed out)
08:58 πŸ”— schbirid has joined #archiveteam-bs
09:13 πŸ”— jrwr has quit IRC (Remote host closed the connection)
09:56 πŸ”— PurpleSym Jon: 25k remixes after deduplication left. I’ll add ID3 tags and upload batches of 100 files ordered by upload date to IA in the coming days. Creating one item per user would result in 8k items. That seems excessive.
09:59 πŸ”— DiscantX has joined #archiveteam-bs
10:20 πŸ”— schbirid every book has an item, 8k is absolutely reasonable
10:30 πŸ”— PurpleSym I’m not sure what’s the best option here. Many users uploaded just one, but there’s one user with 8k remixes too.
11:16 πŸ”— XPEric has joined #archiveteam-bs
11:17 πŸ”— XPEric has quit IRC (Client Quit)
11:18 πŸ”— AndroUser has joined #archiveteam-bs
11:19 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
11:22 πŸ”— Specular_ has joined #archiveteam-bs
11:26 πŸ”— GE has quit IRC (Quit: zzz)
12:31 πŸ”— BlueMaxim has quit IRC (Quit: Leaving)
12:51 πŸ”— AndroUser has quit IRC (AndroIRC - Android IRC Client ( http://www.androirc.com ))
12:55 πŸ”— GE has joined #archiveteam-bs
12:56 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
12:57 πŸ”— Specular_ has joined #archiveteam-bs
13:41 πŸ”— ranma can archivebot back this up? http://src.infinitewave.ca/
14:42 πŸ”— ndiddy has joined #archiveteam-bs
14:42 πŸ”— ndiddy has quit IRC (Read error: Connection reset by peer)
14:43 πŸ”— ndiddy has joined #archiveteam-bs
15:14 πŸ”— Specular_ has quit IRC (Ping timeout: 370 seconds)
15:33 πŸ”— fie has quit IRC (Read error: Operation timed out)
15:36 πŸ”— VADemon The question regarding Cyanogen Inc: is just their https://cyngn.com/ website shutting down or also everything related to cyanogenmod.org
15:40 πŸ”— Simpbrain the former
15:40 πŸ”— Simpbrain mod is staying it seems
15:40 πŸ”— VADemon has left ~bye
15:40 πŸ”— Simpbrain the inc operation is shutting down, the mod side of things will carry on
15:41 πŸ”— VADemon has joined #archiveteam-bs
15:41 πŸ”— Simpbrain the inc operation is shutting down, the mod side of things will carry on.
15:48 πŸ”— XPEric has joined #archiveteam-bs
15:53 πŸ”— fie has joined #archiveteam-bs
16:08 πŸ”— XPEric has quit IRC (Disconnected)
16:13 πŸ”— XPEric has joined #archiveteam-bs
16:33 πŸ”— VADemon "A big part of "next" is CM. It costs a lot of money to keep the servers running at this scale, and I figure we have about two months to GTFO."
16:33 πŸ”— VADemon http://www.androidpolice.com/2016/12/01/steve-kondik-blames-kirt-mcmaster-for-cyanogen-incs-failure-cyanogenmod-to-reorganize-and-regroup/#2
16:38 πŸ”— XPEric2 has joined #archiveteam-bs
16:39 πŸ”— XPEric2 has quit IRC (Client Quit)
16:49 πŸ”— XPEric Does anyone know if theres a reasonable archive of tribe.net?
17:23 πŸ”— DiscantX has quit IRC (Read error: Operation timed out)
17:30 πŸ”— HCross grabbing cyanogen downloads page. Its around 3TB
18:41 πŸ”— xmc fuck that's a lot, and to what end that grabbing the sources wouldn't accomplish
18:44 πŸ”— xmc i mean, go ahead
18:45 πŸ”— ravetcofx has joined #archiveteam-bs
18:46 πŸ”— VADemon HCross: you're on https://download.cyanogenmod.org/ right?
18:54 πŸ”— VADemon CM Wiki, ~8500 pages: https://wiki.cyanogenmod.org/w/Special:Statistics
18:54 πŸ”— VADemon CM Forums, 131k threads: https://forum.cyanogenmod.org/
18:56 πŸ”— VADemon Cyngn's website & landing page: https://cyngn.com/ & https://mod.life/
18:56 πŸ”— VADemon Cyngn's Forums, 2800 threads: http://community.cyngn.com/
18:59 πŸ”— Simpbrain has quit IRC (Remote host closed the connection)
19:02 πŸ”— Simpbrain has joined #archiveteam-bs
19:17 πŸ”— HCross VADemon, the download.cy....org page
19:47 πŸ”— RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue)
19:53 πŸ”— RichardG has joined #archiveteam-bs
20:14 πŸ”— dashcloud has quit IRC (Ping timeout: 264 seconds)
20:16 πŸ”— dashcloud has joined #archiveteam-bs
20:37 πŸ”— XPEric has left Quit message
20:37 πŸ”— XPEric has joined #archiveteam-bs
20:37 πŸ”— XPEric has left Quit message
20:58 πŸ”— Simpbrain https://www.cyanogenmod.org/blog/a-fork-in-the-road
21:07 πŸ”— jrwr has joined #archiveteam-bs
21:11 πŸ”— VADemon GOD DAMN IT. They took the forums offline
21:11 πŸ”— Simpbrain wow that was fast
21:12 πŸ”— Simpbrain cyanogen/mod is going down faster than a ship
21:12 πŸ”— HCross bashing through downloads as fast as their servers are letting me
21:15 πŸ”— Simpbrain lineage seems to be natural successor, git seems to have been copied over sources
21:15 πŸ”— VADemon The download servers *should* stay online until 31st
21:18 πŸ”— VADemon because they're hosted/paid for by Cyngn
21:23 πŸ”— DiscantX has joined #archiveteam-bs
21:49 πŸ”— xmc damn, forums down already?
21:49 πŸ”— xmc sUck
21:49 πŸ”— xmc fffff
21:51 πŸ”— fie has quit IRC (Read error: Connection reset by peer)
22:09 πŸ”— DiscantX has quit IRC (Ping timeout: 244 seconds)
22:24 πŸ”— BlueMaxim has joined #archiveteam-bs
22:28 πŸ”— wp494 has quit IRC (Read error: Connection reset by peer)
22:34 πŸ”— hook54321 wtf? The forums are down already?
22:37 πŸ”— hook54321 shit
22:39 πŸ”— hook54321 VADemon, HCross, VADemon, Simpbrain: There's a button to sign in, have any of you tried that. I tried logging in, guess I didn't have an account.
22:39 πŸ”— VADemon hook54321: still disabled
22:39 πŸ”— VADemon I have an old account
22:40 πŸ”— HCross stuff ive downloaded so far is https://archive.org/details/CyanogenWeb24121601
22:40 πŸ”— HCross Can someone with the right perms please shove that in the right place?
22:44 πŸ”— GE has quit IRC (Remote host closed the connection)
22:46 πŸ”— hook54321 I'm gonna try asking them to re-enable the forums
23:05 πŸ”— Igloo Even just read only owuld be good
23:08 πŸ”— HCross the downloads all are also on oss.reflected.net - so I am going after that
23:11 πŸ”— antonizoo I'm going to pick up the Cyanogenmod wiki
23:11 πŸ”— antonizoo But two backups is no problem so someone else should try too
23:13 πŸ”— Igloo It's in the archivebot antonizoo
23:14 πŸ”— antonizoo Awesome. Does the archivebot make wikiteam wikidumps these days
23:14 πŸ”— Igloo No idea.
23:14 πŸ”— Igloo Doubtful
23:14 πŸ”— antonizoo Hmm. I'll still do it
23:15 πŸ”— antonizoo Good that you'll pick up some warcs though
23:16 πŸ”— Igloo That way it's browsable in way back
23:16 πŸ”— Igloo But if you wnt the wikidump that's not a bad idea
23:20 πŸ”— antonizoo Scraping with XML and images now
23:22 πŸ”— antonizoo I'm looking through the archivebot logs but did someone already pick up the Cyanogenmod downloads
23:22 πŸ”— antonizoo Those are really, really important
23:22 πŸ”— antonizoo And probably big...
23:22 πŸ”— HCross all over the downloads
23:25 πŸ”— antonizoo So, crawling all over it now? I guess igloo started that job
23:25 πŸ”— HCross http://master.newsbuddy.net:29000 ive got the main site, just going back over the main file store
23:26 πŸ”— Igloo Ok HCross I won't pull downloads if you've got them
23:26 πŸ”— Igloo No harm leaving them in the bot though
23:26 πŸ”— HCross its TBs
23:26 πŸ”— HCross yea, leave them in the bot
23:26 πŸ”— Igloo Yeah I can handle TBs
23:26 πŸ”— Igloo But no point hitting it 3 times
23:26 πŸ”— Igloo For the same thing
23:27 πŸ”— antonizoo Oh yeah, nightlies are eventually deleted, so the site actually shouldn't be too huge
23:27 πŸ”— antonizoo Like hundreds of TB
23:28 πŸ”— Igloo Did someone say there was a github for it?
23:29 πŸ”— Igloo Should get that too
23:29 πŸ”— antonizoo There's a lot of source code hosted yes
23:29 πŸ”— antonizoo Probably with git
23:29 πŸ”— antonizoo And probably using their own infrastructure
23:37 πŸ”— yipdw "hundreds of TB" is pretty huge; if there's a job that gets there it's going the abort hole
23:38 πŸ”— yipdw builds of a phone OS getting to hundreds of terabytes is kinda weird, but then again we do live in a world of 300 MB printer and GPU drivers so I guess anything's possible
23:38 πŸ”— Igloo Depends how many there are
23:38 πŸ”— Igloo I doubt it's hundreds
23:38 πŸ”— Igloo Maybe one or two.
23:42 πŸ”— yipdw well at least when we're all off-Earth, Moon-bound archivists will look at this and wonder how people ever kept Android phones up-to-date
23:55 πŸ”— pikhq The answer is running data centers with money like you run steam locomotives with coal.
23:56 πŸ”— xmc https://twitter.com/shadytel/status/551646916715376641
23:56 πŸ”— xmc another shadytel innovation

irclogger-viewer