[00:01] *** Jonimus has quit IRC (Ping timeout: 370 seconds) [00:01] *** sep332 has joined #archiveteam-bs [00:01] *** Aranje has quit IRC (Read error: Connection reset by peer) [00:02] *** Aranje has joined #archiveteam-bs [00:04] *** Jonimus has joined #archiveteam-bs [00:11] *** Stiletto is now known as Stilett0 [00:12] *** BlueMaxim has joined #archiveteam-bs [00:27] *** mistym has joined #archiveteam-bs [00:39] *** Aranje has quit IRC (Read error: Connection reset by peer) [00:40] *** Aranje has joined #archiveteam-bs [00:40] *** dashcloud has quit IRC (Read error: Operation timed out) [00:42] *** BlueMaxim has quit IRC (Quit: Leaving) [00:44] *** dashcloud has joined #archiveteam-bs [00:49] *** mistym has quit IRC (Read error: Connection reset by peer) [00:54] *** mistym has joined #archiveteam-bs [01:03] *** BlueMaxim has joined #archiveteam-bs [01:10] *** Aranje has quit IRC (Read error: Connection reset by peer) [01:10] *** Aranje has joined #archiveteam-bs [01:16] *** primus105 has quit IRC (Leaving.) [01:26] *** JesseW has joined #archiveteam-bs [01:33] *** mistym_ has joined #archiveteam-bs [01:33] *** mistym has quit IRC (Read error: Connection reset by peer) [01:38] *** mistym has joined #archiveteam-bs [01:38] *** mistym_ has quit IRC (Read error: Connection reset by peer) [01:52] *** mistym has quit IRC (Remote host closed the connection) [01:54] *** mistym has joined #archiveteam-bs [01:56] *** dashcloud has quit IRC (Read error: Operation timed out) [01:59] *** dashcloud has joined #archiveteam-bs [01:59] *** mistym has quit IRC (Read error: Connection reset by peer) [02:03] *** mistym has joined #archiveteam-bs [02:05] *** kyan has quit IRC (Remote host closed the connection) [02:18] *** zenguy_pc has joined #archiveteam-bs [02:24] *** mistym_ has joined #archiveteam-bs [02:24] *** mistym has quit IRC (Read error: Connection reset by peer) [02:27] *** mistym has joined #archiveteam-bs [02:27] *** mistym_ has quit IRC (Read error: Connection reset by peer) [02:50] *** vitzli has joined #archiveteam-bs [03:00] *** mistym_ has joined #archiveteam-bs [03:00] *** mistym has quit IRC (Read error: Connection reset by peer) [03:04] *** mistym has joined #archiveteam-bs [03:04] *** mistym_ has quit IRC (Read error: Connection reset by peer) [03:12] *** mistym_ has joined #archiveteam-bs [03:12] *** mistym has quit IRC (Read error: Connection reset by peer) [03:14] *** JesseW has quit IRC (Leaving.) [03:17] *** zenguy_pc has quit IRC (Read error: Connection reset by peer) [03:32] *** mistym_ has quit IRC (Read error: Connection reset by peer) [03:33] *** zenguy_pc has joined #archiveteam-bs [03:36] *** mistym has joined #archiveteam-bs [03:48] *** JesseW has joined #archiveteam-bs [03:51] *** kyan has joined #archiveteam-bs [03:52] *** bzc6p_ has joined #archiveteam-bs [03:57] *** bzc6p has quit IRC (Read error: Operation timed out) [04:00] *** vitzli has quit IRC (Quit: Leaving) [04:01] *** mistym has quit IRC (Read error: Connection reset by peer) [04:01] *** kyan has quit IRC (Remote host closed the connection) [04:01] *** mistym has joined #archiveteam-bs [04:06] *** pikhq has joined #archiveteam-bs [04:12] *** mistym_ has joined #archiveteam-bs [04:12] *** mistym has quit IRC (Read error: Connection reset by peer) [04:13] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [04:21] *** xtr-201 has quit IRC (Ping timeout: 370 seconds) [04:28] *** Sk1d has quit IRC (Ping timeout: 265 seconds) [04:28] *** JesseW has quit IRC (Leaving.) [04:29] *** aaaaaaaaa has quit IRC (Leaving) [04:30] *** Sk1d has joined #archiveteam-bs [04:36] IA is so slow today.. [04:37] i blame the ui redesign for being 'modern' [04:37] :( [04:37] (whether this has anything to do with it or not. I just don't like the redesign.) [04:41] A shame [04:41] We needed the redesign quite a bit. [04:42] it's pretty fast here [04:42] *** mistym_ has quit IRC (Remote host closed the connection) [04:42] *** BlueMaxim has joined #archiveteam-bs [04:42] wyatt8740: upload's slow [04:42] UI is fine [04:42] :P [04:42] well, upload and deriving are both slow, it seems [04:43] small videos seem to derive slower than normally, the upload API latency is crazy, and I've been spotting some 1-50KB/sec speeds intermittently for the past few hours or so [04:43] (think 1-2 seconds response latency for a 1KB file) [04:43] I just dont like the UI :P [04:43] the UI is fine, as far as I'm concerned :) [04:43] certainly a lot better than the old one anyway [04:44] hmm, archivebot-fetch2 -> fos is pretty slow [04:44] * joepie91 looks at weathermap [04:44] zoocasa WARC uploading at 168 kB/s, typically we do at least 3-5 MB/s [04:44] yeah, seems about right [04:44] fos isn't doing much disk I/O [04:44] yipdw: think it's a network issue, even though the network isn't particularly loaded [04:44] https://monitor.archive.org/weathermap/weathermap.html [04:45] yeah [04:45] I'm gonna blame The Cloud [04:45] (assuming the % are accurate) [04:45] and it might actually be on-point [04:45] heh [04:45] I blame hitler. [04:45] all things bad can be traced to hitler if you don't know what the real problem is [04:45] things outside hitler's light cone cannot be traced to hitler [04:46] yipdw: getting about 9mbps now [04:46] but it fluctuates *heavily* [04:46] like, dropping to 1-2mbps [04:46] doesn't stop some people :P [04:46] yeah I'm hoping -fetch2 doesn't run out of space before this WARC is offloaded [04:46] :) [04:47] fwiw, I'm clearing out my archival folders [04:47] https://archive.org/details/HeerlenExplosion-20_April_2015 [04:47] collections of videos of noteworthy events and such [04:47] https://archive.org/details/AltonTowersSmilerCrash [04:49] Oh right, I should go start my warrior up again. [04:53] SketchCow: btw, the HTML5 upl;oader is shoving a 'reCache' metadata item into my face, and I can't upload a thing until I remove it [04:53] SketchCow: that's probably a bug, and it's probably confusing uploaders if it also happens for others [04:53] :P [04:53] (that is, it adds it to the custom metadata by default) [04:58] bah, 2mbps... [05:16] yeah I got that recache thing too [05:23] *** JesseW has joined #archiveteam-bs [05:25] *** mistym has joined #archiveteam-bs [05:33] man, looks like IA is *really* backed up [05:33] "X tasks queued" is going crazy and it has been sitting there for like 20 minutes now... [05:40] Where is that? [05:40] I have a dev on the line who wants to know where that is shown. [05:40] SketchCow: the reCache? in the beta uploader, immediately after selecting files [05:40] it pre-adds a reCache: 1 metadata value [05:40] I've tested with video files, not sure if it's specific to that [05:41] well, idk if it's still beta, the HTML5 uploader anyway [05:41] via /upload [05:41] Not that beta [05:41] In unrelated news, https://archive.org/details/mecc is loading up with great shit [05:41] SketchCow: http://i.imgur.com/QuAcvJp.png [05:41] screenie [05:42] it prevents upload because the metadata key must be lowercase alphanumeric with dashes, or something along those lines [05:42] (so I've just been removing it entirely) [05:42] huh, MECC is interesting [06:03] *** mistym has quit IRC (Leaving...) [06:15] *** xtr-201 has joined #archiveteam-bs [06:56] *** JesseW has quit IRC (Quit: Leaving.) [07:15] *** primus104 has joined #archiveteam-bs [07:17] *** garyrh has quit IRC (Remote host closed the connection) [07:49] *** SketchCow has quit IRC (Read error: Connection reset by peer) [07:51] *** lrkj has quit IRC (ny.us.hub west.us.hub) [07:51] *** dan- has quit IRC (ny.us.hub west.us.hub) [07:51] *** zhongfu has quit IRC (ny.us.hub west.us.hub) [07:51] *** espes__ has quit IRC (ny.us.hub west.us.hub) [07:51] *** xmc has quit IRC (ny.us.hub west.us.hub) [07:55] I was surpirsed how closely my additudes towards smoking match the survey result in the smoking test. [07:56] The only one way out of line is that I don,t want to hang around smokers. [08:04] seems IA has picked itself back up again [08:04] pushing 70mbps now :) [08:08] *** schbirid has joined #archiveteam-bs [08:18] *** RichardG has quit IRC (Remote host closed the connection) [08:29] *** xmc has joined #archiveteam-bs [08:29] *** espes__ has joined #archiveteam-bs [08:29] *** zhongfu has joined #archiveteam-bs [08:29] *** dan- has joined #archiveteam-bs [08:29] *** lrkj has joined #archiveteam-bs [08:29] *** west.us.hub sets mode: +o xmc [08:30] *** garyrh has joined #archiveteam-bs [08:33] *** dashcloud has quit IRC (Read error: Operation timed out) [08:33] *** dashcloud has joined #archiveteam-bs [09:39] *** w0rp has quit IRC (Read error: Operation timed out) [09:46] *** primus104 has quit IRC (Leaving.) [09:58] *** ripvanwin has quit IRC (Read error: Operation timed out) [10:51] *** bzc6p_ is now known as bzc6p [10:54] urgh [10:54] I can see this becoming a problem for archiving [10:54] http://www.wired.com/2015/04/computers-can-now-tell-feel-face/ [10:54] movies that adapt based on emotion tracking [11:02] um does anyone have an example implimentation of saving to WARC in python in a multithreaded program? i.e. multiple threads grabbing web resources at once [11:03] or should i use one of those proxy things to just MITM my traffic to warc? [11:05] Ctrl-S: probably not related, but wpull supports concurrent downloads [11:06] I'm trying to add WARC output to something i've already written [11:06] wait that means it probably does what i asked for, thanks [11:19] threads :( [11:19] basically i dont want write conflicts and stuff like that [11:44] *** primus104 has joined #archiveteam-bs [11:50] *** BlueMaxim has quit IRC (Quit: Leaving) [12:25] *** brayden has joined #archiveteam-bs [12:25] *** GLaDOS has quit IRC (Ping timeout: 252 seconds) [12:45] *** primus104 has quit IRC (Leaving.) [12:53] *** GLaDOS has joined #archiveteam-bs [13:09] SketchCow: 2008 urls of metro.co.uk are uploaded [13:20] *** ripvanwin has joined #archiveteam-bs [14:10] *** RichardG has joined #archiveteam-bs [14:17] *** godane has quit IRC (Ping timeout: 252 seconds) [14:33] *** mistym has joined #archiveteam-bs [14:49] *** mistym has quit IRC (Remote host closed the connection) [15:02] *** mistym has joined #archiveteam-bs [15:08] *** primus104 has joined #archiveteam-bs [15:23] *** lrkj has quit IRC (Ping timeout: 512 seconds) [15:28] *** lrkj has joined #archiveteam-bs [15:52] *** mistym has quit IRC (Remote host closed the connection) [15:53] *** JesseW has joined #archiveteam-bs [16:01] *** bzc6p_ has joined #archiveteam-bs [16:06] *** bzc6p has quit IRC (Ping timeout: 600 seconds) [16:09] *** godane has joined #archiveteam-bs [16:11] *** mistym has joined #archiveteam-bs [16:17] *** primus104 has quit IRC (Leaving.) [16:17] *** JesseW has quit IRC (Quit: Leaving.) [16:19] *** JesseW has joined #archiveteam-bs [16:19] *** JesseW has quit IRC (Client Quit) [16:22] *** Muad-Dib has joined #archiveteam-bs [16:25] *** mistym has quit IRC (Leaving...) [16:35] *** mistym has joined #archiveteam-bs [16:35] *** primus104 has joined #archiveteam-bs [16:40] *** dashcloud has quit IRC (Read error: Operation timed out) [16:43] *** dashcloud has joined #archiveteam-bs [16:48] *** SketchCow has joined #archiveteam-bs [16:49] *** SketchCow has quit IRC (Quit: leaving) [16:50] *** SketchCow has joined #archiveteam-bs [16:52] *** Aranje has quit IRC (Read error: Connection reset by peer) [16:53] *** Aranje has joined #archiveteam-bs [16:56] *** Aranje has quit IRC (Read error: Connection reset by peer) [16:56] *** Aranje has joined #archiveteam-bs [16:59] *** Aranje has quit IRC (Read error: Connection reset by peer) [16:59] *** Aranje has joined #archiveteam-bs [17:09] *** aaaaaaaaa has joined #archiveteam-bs [17:21] *** SimpBrain has joined #archiveteam-bs [17:22] *** godane has quit IRC (Ping timeout: 265 seconds) [17:26] *** Aranje has quit IRC (Read error: Connection reset by peer) [17:26] *** Aranje has joined #archiveteam-bs [17:28] *** bzc6p_ is now known as bzc6p [17:37] *** wacky has joined #archiveteam-bs [17:37] *** dashcloud has quit IRC (Read error: Operation timed out) [17:42] *** dashcloud has joined #archiveteam-bs [17:43] *** godane has joined #archiveteam-bs [18:16] *** dashcloud has quit IRC (Read error: Connection reset by peer) [18:16] *** dashcloud has joined #archiveteam-bs [18:28] yahoo https://www.youtube.com/watch?v=6zbsUtQL4nY [18:34] *** chfoo has quit IRC (Quit: chfoo) [18:41] *** chfoo has joined #archiveteam-bs [18:44] *** primus104 has quit IRC (Read error: Operation timed out) [18:44] *** primus104 has joined #archiveteam-bs [18:54] Hi Jason, [18:54] I hope you're doing well. I am emailing about your collection of WIRED magazines. We are not a museum, but, well, we are WIRED. Believe it or not, we don't have an endless supply of the old issues. When we see them, we try to snap them up. [18:54] If you'd be willing to entrust those to us, we'd take extra-special good care of them. We'd put them in our newly redesigned office library, where visitors could interact with them. That said, I should disclose that we do not have a huge amount of visitors.a few per day. So if you were looking for a place with higher foot traffic, I totally get it. [18:54] Let me know if you'd like me to take these off your hands. [18:54] File that under "unexpected" [19:01] wow, cool [19:01] get them to scan them? \o/ [19:02] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:02] *** Aranje has joined #archiveteam-bs [19:03] They likely will not. [19:03] On the other hand, I am not afraid of Wireds not being scanned. [19:04] That's why I'm getting them out of my life [19:11] nice [19:13] ah, gotcha :) [19:18] *** arkiver sets mode: +o SketchCow [19:30] To be able to dump these out of the container will make a big, big difference in there. [19:31] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:32] *** Aranje has joined #archiveteam-bs [19:35] *nods* [19:38] how many do you have? [19:40] all of them [19:40] yo [19:40] every copy of every issue ever made [19:41] Anyone know reasonable priced places to buy SSD's in bulk? Packs of 24? 48? [19:41] there are literally no wired magazines outside his box [19:42] LOL [19:45] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:45] *** Aranje has joined #archiveteam-bs [19:51] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:52] *** Aranje has joined #archiveteam-bs [19:52] I have a lot of issues. [19:52] Not THAT many. [20:03] I have a lot of issues. [20:10] *** SketchCow changes topic to: Archive Team: After Five Years, You'd Think We'd Know What We're Doing | I have a lot of issues. [20:12] maybe you need one of those famous joepie91 hug-fest hugs. [20:13] Those never stop [20:13] And he doesn't take mmmmph for an answer [20:25] *** RichardG has quit IRC (Remote host closed the connection) [20:25] *** schbirid has quit IRC (Leaving) [20:26] *** RichardG has joined #archiveteam-bs [20:30] *** RichardG has quit IRC (Remote host closed the connection) [20:31] *** RichardG has joined #archiveteam-bs [20:31] *** w0rp has joined #archiveteam-bs [20:34] *** McGEE has joined #archiveteam-bs [20:37] *** RichardG has quit IRC (Remote host closed the connection) [20:38] *** RichardG has joined #archiveteam-bs [20:44] *** godane has quit IRC (Ping timeout: 252 seconds) [20:59] *** godane has joined #archiveteam-bs [21:05] *** SimpBrai1 has joined #archiveteam-bs [21:09] *** SimpBrain has quit IRC (Ping timeout: 258 seconds) [21:10] SketchCow: this maybe useful in grabbing github: https://github.com/metamesh/useful-scripts [22:11] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:12] *** Aranje has joined #archiveteam-bs [22:15] * phillipsj needs moar disk space..or something. [22:17] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:17] *** Aranje has joined #archiveteam-bs [22:19] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:20] *** Aranje has joined #archiveteam-bs [22:20] so i got archiveteam-fire collection up to 3k items [22:21] also btw i have uploaded 2802 items to the archiveteam-fire collection [23:30] *** BlueMaxim has joined #archiveteam-bs