[00:21] I like how Business Insider, a company owned by Amazon, runs a stroke piece on Amazon [00:22] er, hmm, actually i guess it's not owned by Amazon after all [00:22] Jeff Bezos just has "an investment stake" [00:22] close enough [00:27] Well, most of BI's pieces on big companies are puff pieces or clickbait. [00:28] In that regard, I suppose it is like most other media sources out of the US. [00:28] *** dashcloud has quit IRC (Read error: Operation timed out) [00:30] I like "The most important concept in cloud computing is "hyperscale."" [00:30] presumably that is higher than webscale [00:30] I'm not sure where it sits relative to roflscale, perhaps a cloud architect can clarify this [00:32] *** dashcloud has joined #archiveteam-bs [00:32] also it's pretty obvious that that is the most important concept to Amazon if you ever try to use their management interfaces, which you have to wrap with your own tools to get any useful answers like "what the fuck did my applications do from this date to this date" [00:32] but at least you can query across thousands of CloudWatch log streams in, uh, minutes [00:33] not exactly real time but at least you can run up your rate limit count with big numbers [00:56] *** bwn has joined #archiveteam-bs [00:59] curl -s 'https://kpfa.org/player/?audio=218248' | grep mp3 [01:01] i'm trying figure out if there is a way to make the downloads go faster [01:02] have you tried the tool called 'axel' [01:02] it downloads chunks of the same file in parallel [01:02] requires the remote server to support range requests thoguh [01:07] *** remsen has joined #archiveteam-bs [01:12] i don't think axel is faster then wget [01:12] i'm still stuck at 55kb [01:13] huh [01:14] http://archives.kpfa.org/data/20031104-Tue1530.mp3 [01:14] try downloading that faster then 60kbyes [01:21] xmc: figiured anything out [01:22] 15% [==============> ] 826,447 57.1KB/s eta 78s [01:26] aria2 wouldn't fall for my shit [01:27] they probably have a server limit programmed in, maybe doing multiple in parallel would help as they may have only made the limit per connection. [01:39] Didn't happen. [01:43] its limit to 60kbyes in total [01:43] this is not like when i was save the old WebStock videos [01:44] and i could run 12 consoles at one [01:44] I misunderstood then. [01:44] just a thought, archiveteam does have a way to get lots of ips to download stuff at once. [01:44] Lot of effort to get... podcast mp3s I happened to see. [01:50] *** vtyl has quit IRC (Read error: Operation timed out) [01:50] godane:are you grabbing kpfa preemptively or have they annouced something that's causing conern? [01:52] *** lytv has joined #archiveteam-bs [01:52] *** godane has quit IRC (Read error: Operation timed out) [01:53] *** dashcloud has quit IRC (Read error: Operation timed out) [01:54] *** godane has joined #archiveteam-bs [01:56] *** dashcloud has joined #archiveteam-bs [01:59] *** anomie has quit IRC (Ping timeout: 499 seconds) [02:02] *** anomie has joined #archiveteam-bs [02:08] godane: if you run multiple jobs in parallel for one of your infamous grabs, it can be handy to use https://www.gnu.org/software/parallel/ [02:10] *** JesseW has joined #archiveteam-bs [02:22] *** anomie has quit IRC (Read error: Connection reset by peer) [02:27] so 2003-07-01 of kpfa archives is going up [02:28] https://archive.org/details/kpfa-archives-radio-podcast-2003-07-01 [02:31] *** anomie has joined #archiveteam-bs [02:38] *** primus104 has quit IRC (Leaving.) [02:39] *** dashcloud has quit IRC (Read error: Operation timed out) [02:42] *** dashcloud has joined #archiveteam-bs [02:59] *** wednesday has joined #archiveteam-bs [02:59] *** deathy___ has joined #archiveteam-bs [02:59] *** deathy___ has quit IRC (Read error: Connection reset by peer) [03:00] *** JesseW has quit IRC (Leaving.) [03:01] *** Boltsie__ has joined #archiveteam-bs [03:02] *** deathy___ has joined #archiveteam-bs [03:03] *** JSharp___ has joined #archiveteam-bs [03:08] *** _desu___ has joined #archiveteam-bs [03:35] *** BlueMaxim has joined #archiveteam-bs [03:39] *** bwn has quit IRC (Read error: Operation timed out) [03:56] *** JesseW has joined #archiveteam-bs [04:03] *** bwn has joined #archiveteam-bs [04:17] *** diacope has joined #archiveteam-bs [04:18] *** JesseW1 has joined #archiveteam-bs [04:18] *** JesseW has quit IRC (Read error: Operation timed out) [04:24] *** aaaaaaaaa has quit IRC (Leaving) [04:26] Wait, it goes back to 2003? [04:28] OK, I've got FOS doing both 0 and 1, and it's also doing SCREENR [04:32] SketchCow: there is a patten with the mp3s [04:32] Right. [04:33] But I'm just asking - it's all the way back to 2003? That's how early it goes? [04:33] thats why i'm doing it by days [04:33] the site doesn't even have links on there pages that far back [04:34] https://kpfa.org/archives/2003/7/1/ [04:34] nothing is listed there but mp3s exist [04:35] i'm doing a if statement set with lots of -o [04:35] if [ "$d" == "01" -o "$d" == "08" -o "$d" == "15" -o "$d" == "22" -o "$d" == "29" ]; then [04:36] Let me know if you go back futher. [04:36] Further. [04:36] i="Tue" [04:36] will do [04:36] I mean, 12 years is pretty crazy [04:49] some more good news [04:50] there is a archive that was meant to be 1 week only but they kept them up [04:50] https://web.archive.org/web/20041213005740/http://www.kpfa.org/archives/music/archives.php?id=50 [04:51] that's ... very worth grabbing. :-) [05:08] *** zyphlar__ has joined #archiveteam-bs [05:28] https://transfer.sh/iKk8M/qtcreator.png <- I guess I at least have to give it props for using all vcpus [05:38] if anyone can give me a full txt file of free ip proxys that would be great [05:39] i will use it tommorrow cause right now i'm going to bed [05:49] yipdw: ha [05:49] joepie91: https://bugreports.qt.io/browse/QTCREATORBUG-14356 is supposedly related [05:49] I see the same calls in strace, at least [05:49] ~software~ [05:49] I'm still confused what systemd and qtcreator have to do with destroying my CPU? but ok [05:50] hahaha [05:50] yipdw: ~~~software~~~ [05:50] and ~systemd~ [05:50] *everything* has to do with systemd [05:50] yeah I wish this journalctl integration was better documented, like why is it in an IDE in the first place [05:54] oh it's for qDebug() [05:54] well this is some serious house of cards fuckery [06:02] yipdw: ? [06:03] journald support is in qt creator so that it can redirect + display qDebug() << "blah blah" output to the journald log [06:03] I can see that being useful [06:03] but my C++ program uses neither qDebug nor systemd in any way and I'm amused that an IDE feature is causing my program writing to go to hell [06:04] I am also confused why it needs to poll at such a mad frequency to get messages, but whatever [06:29] lol [07:18] *** vitzli has joined #archiveteam-bs [07:37] *** SmileyG has quit IRC (Read error: Operation timed out) [08:07] *** cvb has joined #archiveteam-bs [08:12] yipdw: Would http://synergy-project.org/ do what you want? It has shared clipboard [08:12] oops, got lost in the backlog [08:26] *** primus104 has joined #archiveteam-bs [08:28] *** JesseW1 has quit IRC (Leaving.) [08:28] *** primus105 has joined #archiveteam-bs [08:30] *** primus104 has quit IRC (Read error: Operation timed out) [08:59] *** JesseW has joined #archiveteam-bs [09:16] *** primus105 has quit IRC (Leaving.) [09:22] *** zenguy_pc has quit IRC (Read error: Operation timed out) [09:38] *** Smiley has joined #archiveteam-bs [09:45] *** bwn has quit IRC (Read error: Operation timed out) [09:46] *** zenguy_pc has joined #archiveteam-bs [09:49] *** vitzli has quit IRC (Quit: Leaving) [09:53] *** vitzli has joined #archiveteam-bs [10:03] *** vitzli has quit IRC (Quit: Leaving) [10:24] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [10:38] *** bwn has joined #archiveteam-bs [10:56] *** Start has quit IRC (Read error: Connection reset by peer) [10:59] *** Start has joined #archiveteam-bs [11:07] *** JesseW has quit IRC (Leaving.) [11:14] *** jspiros has joined #archiveteam-bs [11:26] *** vtyl has joined #archiveteam-bs [11:30] *** zyphlar__ has quit IRC (hub.se efnet.port80.se) [11:30] *** diacope has quit IRC (hub.se efnet.port80.se) [11:30] *** _desu___ has quit IRC (hub.se efnet.port80.se) [11:30] *** JSharp___ has quit IRC (hub.se efnet.port80.se) [11:30] *** deathy___ has quit IRC (hub.se efnet.port80.se) [11:30] *** Boltsie__ has quit IRC (hub.se efnet.port80.se) [11:30] *** lytv has quit IRC (hub.se efnet.port80.se) [12:06] *** primus104 has joined #archiveteam-bs [12:53] *** superkuh has quit IRC (Remote host closed the connection) [12:54] i'm using 5 proxies to grab kpfa faster [13:09] *** vitzli has joined #archiveteam-bs [14:02] *** pgoetz has quit IRC (Remote host closed the connection) [14:23] *** schbirid has joined #archiveteam-bs [14:35] *** cvb has quit IRC (Quit: Leaving) [14:53] *** SN4T14 has quit IRC (Quit: Leaving) [14:56] some good news and bad news [14:56] good news is i found another radio called KPFK [14:59] bad news? [15:01] they don't keep everything [15:01] maybe only a few months worth at best [15:01] Bummer. [15:09] *** Start has quit IRC (Quit: Disconnected.) [15:38] *** Start has joined #archiveteam-bs [15:48] i'm uploading more of KPFA [15:49] *** Start has quit IRC (Quit: Disconnected.) [15:52] are these jobs suitable for splitting up with the warrior? I don't have a good sense of that stuff [15:53] yes, I talked with godane about that and we're going to write something for that [15:58] *** vitzli has quit IRC (Quit: Leaving) [15:59] -rw-r--r-- 1 slacker users 5044271 Jun 15 2006 20030731-Thu1500.mp3 [15:59] this one mp3 timestamp is off [15:59] everything else is from 2003 [16:00] or at least timestamped that way [16:16] here is the cookie that i get from httpfox on kpfa: _ga=GA1.2.746882092.1447089857; _gat=1 [16:16] whats funny is that i can't even stream mp3 in there audio player [16:17] https://kpfa.org/player/?audio=218286 [16:18] MAYBE if someone can get it to stream we can see it download faster then 60kbytes [16:32] *** primus104 has quit IRC (Leaving.) [16:35] *** primus104 has joined #archiveteam-bs [16:40] *** primus104 has quit IRC (Leaving.) [16:43] *** JesseW has joined #archiveteam-bs [16:47] *** diacope has joined #archiveteam-bs [17:01] *** diacope has quit IRC (Ping timeout: 295 seconds) [17:05] *** deathy___ has joined #archiveteam-bs [17:06] *** Ctrl-S___ has joined #archiveteam-bs [17:08] godane: the player in your link works for me with Firefox 42 (my ISP is CenturyLink) [17:15] *** _desu___ has joined #archiveteam-bs [17:18] *** zyphlar__ has joined #archiveteam-bs [17:19] *** JSharp___ has joined #archiveteam-bs [17:22] *** JesseW has quit IRC (Leaving.) [17:30] *** SN4T14 has joined #archiveteam-bs [17:38] *** SN4T14 has quit IRC (Quit: Leaving) [17:52] *** remsen has quit IRC (Read error: Operation timed out) [17:55] *** vtyl has quit IRC (Ping timeout: 252 seconds) [17:56] *** Rye has quit IRC (hub.dk irc.underworld.no) [17:59] *** lytv has joined #archiveteam-bs [18:00] *** jspiros has quit IRC (Read error: Operation timed out) [18:00] *** godane has quit IRC (Read error: Operation timed out) [18:00] *** jspiros has joined #archiveteam-bs [18:01] *** godane has joined #archiveteam-bs [18:01] *** ohhdemgir has quit IRC (Read error: Operation timed out) [18:01] *** chazchaz has quit IRC (Read error: Operation timed out) [18:02] *** atlogbot has quit IRC (Read error: Operation timed out) [18:11] *** diacope has joined #archiveteam-bs [18:17] *** atlogbot has joined #archiveteam-bs [18:23] *** chazchaz has joined #archiveteam-bs [18:26] *** Rotab has joined #archiveteam-bs [18:26] *** Boppen has joined #archiveteam-bs [18:45] *** primus104 has joined #archiveteam-bs [18:56] *** RedType_ has quit IRC (Read error: Operation timed out) [18:57] *** RedType has joined #archiveteam-bs [18:57] *** diacope has quit IRC (Ping timeout: 252 seconds) [19:02] *** cvb has joined #archiveteam-bs [19:02] *** remsen has joined #archiveteam-bs [19:11] *** zenguy_pc has quit IRC (Ping timeout: 258 seconds) [19:16] *** wacky has quit IRC (Read error: Operation timed out) [19:17] *** MrRadar_ has joined #archiveteam-bs [19:17] *** lbft has joined #archiveteam-bs [19:17] *** logan has joined #archiveteam-bs [19:17] *** Infreq_ has joined #archiveteam-bs [19:18] *** MrRadar has quit IRC (Read error: Operation timed out) [19:18] *** lbft_ has quit IRC (Ping timeout: 258 seconds) [19:18] *** Infreq has quit IRC (Ping timeout: 258 seconds) [19:18] *** logan2 has quit IRC (Read error: Operation timed out) [19:19] *** MrRadar_ has quit IRC (Client Quit) [19:19] *** Infreq_ has quit IRC (Read error: Operation timed out) [19:20] *** MrRadar has joined #archiveteam-bs [19:20] *** Infreq has joined #archiveteam-bs [19:21] *** atlogbot has quit IRC (Read error: Operation timed out) [19:24] *** chazchaz has quit IRC (Ping timeout: 369 seconds) [19:46] *** godane has quit IRC (Ping timeout: 258 seconds) [19:46] *** remsen has quit IRC (Read error: Operation timed out) [19:48] *** atlogbot has joined #archiveteam-bs [19:49] *** godane has joined #archiveteam-bs [19:54] *** chazchaz has joined #archiveteam-bs [20:00] *** bwn has quit IRC (Read error: Operation timed out) [20:20] *** schbirid has quit IRC (Quit: Leaving) [20:30] *** bwn has joined #archiveteam-bs [20:53] *** Start has joined #archiveteam-bs [21:00] *** yakfish has quit IRC (Read error: Operation timed out) [21:00] *** kniffy_ has joined #archiveteam-bs [21:00] *** twrist has joined #archiveteam-bs [21:01] *** goekesmi_ has joined #archiveteam-bs [21:01] *** kvieta has quit IRC (Write error: Broken pipe) [21:01] *** Sanqui has quit IRC (Write error: Broken pipe) [21:02] i'm uploading the rest of 2003-07 kpfa archives [21:02] *** useretail has quit IRC (Read error: Operation timed out) [21:02] *** sep332 has quit IRC (Read error: Operation timed out) [21:02] *** phuzion has quit IRC (Read error: Operation timed out) [21:02] *** kniffy has quit IRC (Read error: Operation timed out) [21:02] *** will has quit IRC (Read error: Operation timed out) [21:02] *** antonizoo has quit IRC (Read error: Operation timed out) [21:02] *** lysobit has quit IRC (Read error: Operation timed out) [21:02] *** kniffy_ is now known as kniffy [21:02] *** goekesmi has quit IRC (Read error: Operation timed out) [21:02] *** xmc has quit IRC (Read error: Operation timed out) [21:02] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [21:02] *** achip has quit IRC (Write error: Broken pipe) [21:02] *** myself has quit IRC (Write error: Broken pipe) [21:02] *** beardicus has quit IRC (Write error: Broken pipe) [21:02] *** nico_32 has quit IRC (Write error: Broken pipe) [21:02] *** GLaDOS has quit IRC (Write error: Broken pipe) [21:02] *** Jordan_ has quit IRC (Write error: Broken pipe) [21:02] *** lbft has quit IRC (Write error: Broken pipe) [21:02] *** pwnsrv has quit IRC (Write error: Broken pipe) [21:02] *** midas has quit IRC (Write error: Broken pipe) [21:02] *** twrist is now known as GLaDOS [21:02] *** marvinw has quit IRC (Read error: Operation timed out) [21:02] *** cvb has quit IRC (Read error: Operation timed out) [21:02] *** dxrt has quit IRC (Read error: Operation timed out) [21:02] *** phuzion has joined #archiveteam-bs [21:02] *** xmc has joined #archiveteam-bs [21:02] *** dxrt has joined #archiveteam-bs [21:02] *** cvb has joined #archiveteam-bs [21:02] *** Sanqui has joined #archiveteam-bs [21:03] *** balrog has quit IRC (Read error: Operation timed out) [21:03] *** lbft has joined #archiveteam-bs [21:03] *** wp494 has quit IRC (Write error: Broken pipe) [21:03] *** lysobit has joined #archiveteam-bs [21:04] *** botpie91 has quit IRC (Write error: Broken pipe) [21:04] *** Baljem_ has quit IRC (Read error: Connection reset by peer) [21:05] *** marvinw has joined #archiveteam-bs [21:05] *** beardicus has joined #archiveteam-bs [21:05] *** botpie91 has joined #archiveteam-bs [21:05] *** Baljem has joined #archiveteam-bs [21:05] *** kvieta has joined #archiveteam-bs [21:05] *** useretail has joined #archiveteam-bs [21:05] *** lrkj_ has joined #archiveteam-bs [21:05] *** achip has joined #archiveteam-bs [21:05] *** SimpBrain has quit IRC (Read error: Operation timed out) [21:05] *** Jordan_ has joined #archiveteam-bs [21:06] *** SimpBrain has joined #archiveteam-bs [21:06] *** yakfish has joined #archiveteam-bs [21:06] *** sep332 has joined #archiveteam-bs [21:07] *** kniffy has quit IRC (Quit: :^)) [21:07] *** kniffy has joined #archiveteam-bs [21:07] *** myself has joined #archiveteam-bs [21:08] *** lrkj has quit IRC (Read error: Operation timed out) [21:10] *** Lord_Nigh has joined #archiveteam-bs [21:13] *** balrog has joined #archiveteam-bs [21:14] *** ersi has quit IRC (Ping timeout: 969 seconds) [21:15] *** ersi has joined #archiveteam-bs [21:27] *** midas has joined #archiveteam-bs [21:30] *** bwn has quit IRC (Read error: Operation timed out) [21:31] *** Rye has joined #archiveteam-bs [21:35] *** Rye has quit IRC (Ping timeout: 252 seconds) [21:35] *** nico_32 has joined #archiveteam-bs [21:35] *** wp494_ has joined #archiveteam-bs [21:35] *** Rye has joined #archiveteam-bs [21:37] *** Lord_Nigh has quit IRC (ZNC - http://znc.in) [21:41] *** wacky has joined #archiveteam-bs [21:42] *** Lord_Nigh has joined #archiveteam-bs [21:43] *** aaaaaaaaa has joined #archiveteam-bs [21:45] *** Start has quit IRC (Quit: Disconnected.) [21:45] *** Start has joined #archiveteam-bs [21:49] *** Start has quit IRC (Client Quit) [21:49] *** Start has joined #archiveteam-bs [21:54] *** Start has quit IRC (Client Quit) [21:56] *** Start has joined #archiveteam-bs [21:56] ops please [21:57] Sent arkiver a nice thing [21:59] It is always nice to know your effort is appreciated. [22:03] *** Lord_Nigh has quit IRC (hub.dk irc.underworld.no) [22:03] *** Rye has quit IRC (hub.dk irc.underworld.no) [22:03] *** nico_32 has quit IRC (hub.dk irc.underworld.no) [22:05] *** nico_32_ has joined #archiveteam-bs [22:07] *** LordNigh2 has joined #archiveteam-bs [22:15] *** LordNigh2 has quit IRC (Quit: ZNC - http://znc.in) [22:17] *** Start has quit IRC (Quit: Disconnected.) [22:20] *** Lord_Nigh has joined #archiveteam-bs [22:21] SketchCow: thank you! great to read that! [22:47] SketchCow: KPFA collection so far: https://archive.org/details/godaneinbox?and[]=creator%3A%22KPFA%22 [22:49] *** zenguy_pc has joined #archiveteam-bs [22:51] It's interesting what survived and what didn't. [23:04] you may get 2 more months worth of KPFA [23:05] i have 2003-08 almost done and i have 2003-09 [23:17] this is the old robots.txt file for archives.kpfa.org: https://web.archive.org/web/20110722140854/http://archives.kpfa.org/robots.txt [23:17] now it would give a forbidden error [23:20] *** toad1 has joined #archiveteam-bs [23:22] *** BlueMaxim has joined #archiveteam-bs [23:30] *** Start has joined #archiveteam-bs [23:33] *** cvb has quit IRC (Read error: Operation timed out) [23:53] *** toad1 has quit IRC (Read error: Operation timed out) [23:58] *** bwn has joined #archiveteam-bs