| Time |
Nickname |
Message |
|
00:07
🔗
|
|
jrwr has joined #archiveteam-bs |
|
00:14
🔗
|
Frogging |
hook54321: youtube-dl can do it, look at that |
|
00:15
🔗
|
hook54321 |
By just giving it the channel url? |
|
00:15
🔗
|
Frogging |
yeah. IIRC there's an option to make it write out the list of videos |
|
00:15
🔗
|
Frogging |
(it will also download all the videos on a channel if you want it to) |
|
00:16
🔗
|
hook54321 |
I'm assuming it doesn't get unlisted videos, right? |
|
00:18
🔗
|
Frogging |
It just scrapes the channel's uploads list, so no |
|
00:19
🔗
|
Frogging |
youtube-dl can also handle playlist URLs. It's possible that unlisted videos show up in playlists, and if they do it would grab them |
|
00:19
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
00:19
🔗
|
Frogging |
When I say possible I mean that I thought I saw it happen but I'm not sure |
|
00:22
🔗
|
|
REiN^ has quit IRC (Max SendQ exceeded) |
|
00:23
🔗
|
yipdw |
Frogging: yes, youtube-dl >= 2016.06.25 (probably earlier) handles playlist URLs as you'd expect |
|
00:23
🔗
|
|
REiN^ has joined #archiveteam-bs |
|
00:30
🔗
|
hook54321 |
The command options are confusing |
|
00:49
🔗
|
|
ravetcofx has quit IRC (Ping timeout: 506 seconds) |
|
00:50
🔗
|
yipdw |
hook54321: it's youtube-dl PLAYLIST_URL, not much to type |
|
00:51
🔗
|
hook54321 |
I want to do a channel, not a playlist though |
|
00:52
🔗
|
yipdw |
ok |
|
00:52
🔗
|
yipdw |
youtube-dl CHANNEL_URL |
|
00:52
🔗
|
yipdw |
same thing |
|
00:53
🔗
|
yipdw |
youtube-dl generally does a good job of figuring out optimal settings; the options are there if you know what you need to tweak. don't pre-tweak |
|
00:58
🔗
|
|
ravetcofx has joined #archiveteam-bs |
|
01:33
🔗
|
|
VADemon has quit IRC (Quit: left4dead) |
|
01:35
🔗
|
|
VADemon has joined #archiveteam-bs |
|
01:49
🔗
|
|
mls_ has joined #archiveteam-bs |
|
01:49
🔗
|
|
mls_ is now known as Kksmkrn |
|
01:52
🔗
|
|
Kksmkrn has quit IRC (Client Quit) |
|
02:26
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
02:27
🔗
|
|
Specular_ has joined #archiveteam-bs |
|
02:28
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
03:12
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
03:13
🔗
|
|
Specular_ has joined #archiveteam-bs |
|
03:50
🔗
|
|
kniffy is now known as xmaskniff |
|
04:22
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
04:24
🔗
|
|
Start has joined #archiveteam-bs |
|
04:31
🔗
|
|
ndiddy has quit IRC (Quit: Leaving) |
|
04:40
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
04:59
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
05:02
🔗
|
|
Specular_ has joined #archiveteam-bs |
|
05:11
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
05:13
🔗
|
|
Specular_ has joined #archiveteam-bs |
|
05:22
🔗
|
|
Sk1d has quit IRC (Ping timeout: 250 seconds) |
|
05:29
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
05:48
🔗
|
|
ndiddy has quit IRC (Read error: Connection reset by peer) |
|
06:17
🔗
|
|
ravetcofx has quit IRC (Ping timeout: 864 seconds) |
|
06:27
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
06:29
🔗
|
|
Start has joined #archiveteam-bs |
|
06:34
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
06:34
🔗
|
|
ravetcofx has joined #archiveteam-bs |
|
06:36
🔗
|
|
Specular_ has joined #archiveteam-bs |
|
06:47
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
|
06:48
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
07:05
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
07:07
🔗
|
|
Specular_ has joined #archiveteam-bs |
|
07:40
🔗
|
|
ae_g_i_s has quit IRC (Ping timeout: 260 seconds) |
|
07:40
🔗
|
|
GE has joined #archiveteam-bs |
|
07:46
🔗
|
|
ae_g_i_s has joined #archiveteam-bs |
|
08:19
🔗
|
|
ravetcofx has quit IRC (Read error: Operation timed out) |
|
08:58
🔗
|
|
schbirid has joined #archiveteam-bs |
|
09:13
🔗
|
|
jrwr has quit IRC (Remote host closed the connection) |
|
09:56
🔗
|
PurpleSym |
Jon: 25k remixes after deduplication left. I’ll add ID3 tags and upload batches of 100 files ordered by upload date to IA in the coming days. Creating one item per user would result in 8k items. That seems excessive. |
|
09:59
🔗
|
|
DiscantX has joined #archiveteam-bs |
|
10:20
🔗
|
schbirid |
every book has an item, 8k is absolutely reasonable |
|
10:30
🔗
|
PurpleSym |
I’m not sure what’s the best option here. Many users uploaded just one, but there’s one user with 8k remixes too. |
|
11:16
🔗
|
|
XPEric has joined #archiveteam-bs |
|
11:17
🔗
|
|
XPEric has quit IRC (Client Quit) |
|
11:18
🔗
|
|
AndroUser has joined #archiveteam-bs |
|
11:19
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
11:22
🔗
|
|
Specular_ has joined #archiveteam-bs |
|
11:26
🔗
|
|
GE has quit IRC (Quit: zzz) |
|
12:31
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
12:51
🔗
|
|
AndroUser has quit IRC (AndroIRC - Android IRC Client ( http://www.androirc.com )) |
|
12:55
🔗
|
|
GE has joined #archiveteam-bs |
|
12:56
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
12:57
🔗
|
|
Specular_ has joined #archiveteam-bs |
|
13:41
🔗
|
ranma |
can archivebot back this up? http://src.infinitewave.ca/ |
|
14:42
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
14:42
🔗
|
|
ndiddy has quit IRC (Read error: Connection reset by peer) |
|
14:43
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
15:14
🔗
|
|
Specular_ has quit IRC (Ping timeout: 370 seconds) |
|
15:33
🔗
|
|
fie has quit IRC (Read error: Operation timed out) |
|
15:36
🔗
|
VADemon |
The question regarding Cyanogen Inc: is just their https://cyngn.com/ website shutting down or also everything related to cyanogenmod.org |
|
15:40
🔗
|
Simpbrain |
the former |
|
15:40
🔗
|
Simpbrain |
mod is staying it seems |
|
15:40
🔗
|
|
VADemon has left ~bye |
|
15:40
🔗
|
Simpbrain |
the inc operation is shutting down, the mod side of things will carry on |
|
15:41
🔗
|
|
VADemon has joined #archiveteam-bs |
|
15:41
🔗
|
Simpbrain |
the inc operation is shutting down, the mod side of things will carry on. |
|
15:48
🔗
|
|
XPEric has joined #archiveteam-bs |
|
15:53
🔗
|
|
fie has joined #archiveteam-bs |
|
16:08
🔗
|
|
XPEric has quit IRC (Disconnected) |
|
16:13
🔗
|
|
XPEric has joined #archiveteam-bs |
|
16:33
🔗
|
VADemon |
"A big part of "next" is CM. It costs a lot of money to keep the servers running at this scale, and I figure we have about two months to GTFO." |
|
16:33
🔗
|
VADemon |
http://www.androidpolice.com/2016/12/01/steve-kondik-blames-kirt-mcmaster-for-cyanogen-incs-failure-cyanogenmod-to-reorganize-and-regroup/#2 |
|
16:38
🔗
|
|
XPEric2 has joined #archiveteam-bs |
|
16:39
🔗
|
|
XPEric2 has quit IRC (Client Quit) |
|
16:49
🔗
|
XPEric |
Does anyone know if theres a reasonable archive of tribe.net? |
|
17:23
🔗
|
|
DiscantX has quit IRC (Read error: Operation timed out) |
|
17:30
🔗
|
HCross |
grabbing cyanogen downloads page. Its around 3TB |
|
18:41
🔗
|
xmc |
fuck that's a lot, and to what end that grabbing the sources wouldn't accomplish |
|
18:44
🔗
|
xmc |
i mean, go ahead |
|
18:45
🔗
|
|
ravetcofx has joined #archiveteam-bs |
|
18:46
🔗
|
VADemon |
HCross: you're on https://download.cyanogenmod.org/ right? |
|
18:54
🔗
|
VADemon |
CM Wiki, ~8500 pages: https://wiki.cyanogenmod.org/w/Special:Statistics |
|
18:54
🔗
|
VADemon |
CM Forums, 131k threads: https://forum.cyanogenmod.org/ |
|
18:56
🔗
|
VADemon |
Cyngn's website & landing page: https://cyngn.com/ & https://mod.life/ |
|
18:56
🔗
|
VADemon |
Cyngn's Forums, 2800 threads: http://community.cyngn.com/ |
|
18:59
🔗
|
|
Simpbrain has quit IRC (Remote host closed the connection) |
|
19:02
🔗
|
|
Simpbrain has joined #archiveteam-bs |
|
19:17
🔗
|
HCross |
VADemon, the download.cy....org page |
|
19:47
🔗
|
|
RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) |
|
19:53
🔗
|
|
RichardG has joined #archiveteam-bs |
|
20:14
🔗
|
|
dashcloud has quit IRC (Ping timeout: 264 seconds) |
|
20:16
🔗
|
|
dashcloud has joined #archiveteam-bs |
|
20:37
🔗
|
|
XPEric has left Quit message |
|
20:37
🔗
|
|
XPEric has joined #archiveteam-bs |
|
20:37
🔗
|
|
XPEric has left Quit message |
|
20:58
🔗
|
Simpbrain |
https://www.cyanogenmod.org/blog/a-fork-in-the-road |
|
21:07
🔗
|
|
jrwr has joined #archiveteam-bs |
|
21:11
🔗
|
VADemon |
GOD DAMN IT. They took the forums offline |
|
21:11
🔗
|
Simpbrain |
wow that was fast |
|
21:12
🔗
|
Simpbrain |
cyanogen/mod is going down faster than a ship |
|
21:12
🔗
|
HCross |
bashing through downloads as fast as their servers are letting me |
|
21:15
🔗
|
Simpbrain |
lineage seems to be natural successor, git seems to have been copied over sources |
|
21:15
🔗
|
VADemon |
The download servers *should* stay online until 31st |
|
21:18
🔗
|
VADemon |
because they're hosted/paid for by Cyngn |
|
21:23
🔗
|
|
DiscantX has joined #archiveteam-bs |
|
21:49
🔗
|
xmc |
damn, forums down already? |
|
21:49
🔗
|
xmc |
sUck |
|
21:49
🔗
|
xmc |
fffff |
|
21:51
🔗
|
|
fie has quit IRC (Read error: Connection reset by peer) |
|
22:09
🔗
|
|
DiscantX has quit IRC (Ping timeout: 244 seconds) |
|
22:24
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
22:28
🔗
|
|
wp494 has quit IRC (Read error: Connection reset by peer) |
|
22:34
🔗
|
hook54321 |
wtf? The forums are down already? |
|
22:37
🔗
|
hook54321 |
shit |
|
22:39
🔗
|
hook54321 |
VADemon, HCross, VADemon, Simpbrain: There's a button to sign in, have any of you tried that. I tried logging in, guess I didn't have an account. |
|
22:39
🔗
|
VADemon |
hook54321: still disabled |
|
22:39
🔗
|
VADemon |
I have an old account |
|
22:40
🔗
|
HCross |
stuff ive downloaded so far is https://archive.org/details/CyanogenWeb24121601 |
|
22:40
🔗
|
HCross |
Can someone with the right perms please shove that in the right place? |
|
22:44
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
22:46
🔗
|
hook54321 |
I'm gonna try asking them to re-enable the forums |
|
23:05
🔗
|
Igloo |
Even just read only owuld be good |
|
23:08
🔗
|
HCross |
the downloads all are also on oss.reflected.net - so I am going after that |
|
23:11
🔗
|
antonizoo |
I'm going to pick up the Cyanogenmod wiki |
|
23:11
🔗
|
antonizoo |
But two backups is no problem so someone else should try too |
|
23:13
🔗
|
Igloo |
It's in the archivebot antonizoo |
|
23:14
🔗
|
antonizoo |
Awesome. Does the archivebot make wikiteam wikidumps these days |
|
23:14
🔗
|
Igloo |
No idea. |
|
23:14
🔗
|
Igloo |
Doubtful |
|
23:14
🔗
|
antonizoo |
Hmm. I'll still do it |
|
23:15
🔗
|
antonizoo |
Good that you'll pick up some warcs though |
|
23:16
🔗
|
Igloo |
That way it's browsable in way back |
|
23:16
🔗
|
Igloo |
But if you wnt the wikidump that's not a bad idea |
|
23:20
🔗
|
antonizoo |
Scraping with XML and images now |
|
23:22
🔗
|
antonizoo |
I'm looking through the archivebot logs but did someone already pick up the Cyanogenmod downloads |
|
23:22
🔗
|
antonizoo |
Those are really, really important |
|
23:22
🔗
|
antonizoo |
And probably big... |
|
23:22
🔗
|
HCross |
all over the downloads |
|
23:25
🔗
|
antonizoo |
So, crawling all over it now? I guess igloo started that job |
|
23:25
🔗
|
HCross |
http://master.newsbuddy.net:29000 ive got the main site, just going back over the main file store |
|
23:26
🔗
|
Igloo |
Ok HCross I won't pull downloads if you've got them |
|
23:26
🔗
|
Igloo |
No harm leaving them in the bot though |
|
23:26
🔗
|
HCross |
its TBs |
|
23:26
🔗
|
HCross |
yea, leave them in the bot |
|
23:26
🔗
|
Igloo |
Yeah I can handle TBs |
|
23:26
🔗
|
Igloo |
But no point hitting it 3 times |
|
23:26
🔗
|
Igloo |
For the same thing |
|
23:27
🔗
|
antonizoo |
Oh yeah, nightlies are eventually deleted, so the site actually shouldn't be too huge |
|
23:27
🔗
|
antonizoo |
Like hundreds of TB |
|
23:28
🔗
|
Igloo |
Did someone say there was a github for it? |
|
23:29
🔗
|
Igloo |
Should get that too |
|
23:29
🔗
|
antonizoo |
There's a lot of source code hosted yes |
|
23:29
🔗
|
antonizoo |
Probably with git |
|
23:29
🔗
|
antonizoo |
And probably using their own infrastructure |
|
23:37
🔗
|
yipdw |
"hundreds of TB" is pretty huge; if there's a job that gets there it's going the abort hole |
|
23:38
🔗
|
yipdw |
builds of a phone OS getting to hundreds of terabytes is kinda weird, but then again we do live in a world of 300 MB printer and GPU drivers so I guess anything's possible |
|
23:38
🔗
|
Igloo |
Depends how many there are |
|
23:38
🔗
|
Igloo |
I doubt it's hundreds |
|
23:38
🔗
|
Igloo |
Maybe one or two. |
|
23:42
🔗
|
yipdw |
well at least when we're all off-Earth, Moon-bound archivists will look at this and wonder how people ever kept Android phones up-to-date |
|
23:55
🔗
|
pikhq |
The answer is running data centers with money like you run steam locomotives with coal. |
|
23:56
🔗
|
xmc |
https://twitter.com/shadytel/status/551646916715376641 |
|
23:56
🔗
|
xmc |
another shadytel innovation |