[00:13] *** onyxlynx has quit IRC (Leaving) [00:24] *** ndiddy has quit IRC (Read error: Operation timed out) [00:44] *** JesseW has joined #archiveteam [00:54] *** ats has quit IRC (Read error: Operation timed out) [01:05] *** JesseW has quit IRC (Read error: Operation timed out) [01:13] *** Emcy has quit IRC (Read error: Operation timed out) [01:19] *** ats has joined #archiveteam [01:27] *** ats has quit IRC (Read error: Operation timed out) [02:10] *** DFJustin has quit IRC (Read error: Operation timed out) [02:15] *** VADemon has quit IRC (Quit: left4dead) [02:17] *** maseck_ has quit IRC (Remote host closed the connection) [02:41] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [03:11] *** ats has joined #archiveteam [03:26] *** JesseW has joined #archiveteam [03:51] *** JesseW has quit IRC (Read error: Operation timed out) [04:00] *** maseck has joined #archiveteam [04:27] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [04:30] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:39] *** Sk1d has joined #archiveteam [04:41] *** DFJustin has joined #archiveteam [04:41] *** swebb sets mode: +o DFJustin [04:58] *** JesseW has joined #archiveteam [05:16] voltagex: Have you updated your warriors with the new version of python? It looks like you may not have -- if so, please do. [05:24] Fuck, I'll tear them down immediately [05:24] I'm very sorry [05:26] JesseW: Did I do any damage? I was building them with https://gist.github.com/voltagex/6511a43b75d0eca3224c07cf6d3ec53a but on Ubuntu 14.04 (whatever the LTS is on Amazon) [05:27] damage, no [05:28] you don't need to tear them down [05:29] it's just that is.gd recently switched to https only, which requires a newer version of python than is built into the virtual machine we are distributing, so [05:29] we (well, chfoo) made a hacky separate warrior project just to upgrade the version of python [05:30] and running the old version doesn't do any damage -- the jobs just fail [05:30] it's just that you are (very helpfully) running a lot of instances, so if you upgrade, we should get a lot fewer failed jobs than if you don't [05:34] Okay. I'm not running the warrior, I'm using pipeline directly [05:34] I have "free" instances for another two days or so via AWS credits so I'd like to be as helpful as possible [05:35] My concern was submitting bad data to you guys [05:36] thanks for being concerned, but no worries on that score [05:36] can you check what version of python it is running? [05:37] They're stopped until I have a chance to look into it. I never actually log into the boxes - most of it is automated. I suspect the Ubuntu version is too old [05:38] eh, feel free to turn them back on -- they are doing useful work on all the *other* shorteners [05:39] I panicked :p they'll be back in half an hour or so haha [05:39] and they weren't doing any harm on isgd -- just being a large contingent of a general problem [05:39] sorry for encouraging your panic [05:39] Yes, I don't want to create any more work for you. Can you provide details of what I need to check? [05:40] Urlteam is pretty safe -- the sites we poke at generally don't die quickly, and if we get bad data, we can just check the links again [05:40] sure [05:40] Would it be worth making the script warn / fail if the Python version is old? [05:40] You may want to add a warning about that to the wiki somewhere [05:41] yeah, that would probably be good [05:41] Although I might be one of the few not using the warrior, and I'm definitely the only one who got bored and spun up 80x4 grabbers for fun :p [05:41] Most of the people running lots of grabbers aren't using the warrior [05:42] All you need to check is whether the scripts are running on python 2.7 or python 2.6 [05:42] 2.7 is good, 2.6 is not. [05:42] (just for isgd_6 -- the rest work fine on 2.6) [05:48] okay, let me have a look [05:50] -_- it looks like it should be using 2.7.6 [05:51] hm [05:52] once you get them back up, could you look at the console on a few, and see whether they work with isgd_6 jobs? [05:53] actually, I'm just going to turn off isgd for now; so you can just fire up all your grabbers and not have to worry about it [05:53] we can try figuring out isgd again later in June [05:55] I can help [05:55] let me know what output you need [05:56] The tweak from my end should be easyh [05:56] I'm putting one single grabber with 4 threads now [05:57] eh, I don't feel like investigating it more right now -- and it was pretty clearly not your grabbers that were having a problem, if they were on py2.7 [05:57] *** Start has quit IRC (Quit: Disconnected.) [05:57] I'm still working that out [05:57] 2.7.5 is "default [05:57] I'll run the build script and see what version I get [05:57] if you want to be sure your grabbers aren't making trouble, just keep an eye on http://tracker.archiveteam.org:1337/ and make sure your total keeps going up. :-) [05:58] I was - I actually wish I could query the tracker for more info [05:58] or at least see more info on the console / web UI [05:58] the dream would be an API for the web UI so I could do my own totals and keep an eye on it [05:58] but I don't often have $100 to spend on EC2 like I do now :P [05:59] the tracker code is open source, and patches are welcome :-) [05:59] yep [06:00] an API would be a useful enough addition [06:00] *** pintoch has joined #archiveteam [06:01] in any case, g'night for now [06:01] damnit, timezones. [06:01] okay, see ya [06:01] For next time you're on, can you poke the maintainer of https://github.com/ArchiveTeam/arto-grab/ to look at https://github.com/ArchiveTeam/arto-grab/issues/2? [06:03] confirming my grabbers are using 2.7.6... [06:07] *** JesseW has quit IRC (Ping timeout: 370 seconds) [06:18] *** Start has joined #archiveteam [06:44] *** WinterFox has joined #archiveteam [06:48] arkiver: ^^^^ [07:07] *** Tomcat_ has joined #archiveteam [07:56] *** bsmith093 has quit IRC (Ping timeout: 370 seconds) [08:11] *** schbirid has joined #archiveteam [08:17] *** atlogbot has quit IRC (Ping timeout: 370 seconds) [08:18] *** bsmith093 has joined #archiveteam [08:50] *** Honno has joined #archiveteam [08:54] *** swebb has quit IRC (Ping timeout: 246 seconds) [08:55] *** ariscop has quit IRC (Read error: Operation timed out) [08:57] *** BlueMaxim has quit IRC (Quit: Leaving) [09:24] You might be interested in this.. https://gist.github.com/johtso/49f2c9c485c264f851ba42c75c513590 [09:24] voltagex [09:30] Hahaha [09:31] There's no way I'll catch up to you [09:32] *** MMovie has quit IRC (Read error: Operation timed out) [09:33] nice, thanks [09:34] currently knee-deep trying to work out wget-lua [09:48] *** ariscop has joined #archiveteam [09:52] *** metalcamp has joined #archiveteam [10:41] *** MMovie has joined #archiveteam [10:47] *** r3c0d3x has quit IRC (Ping timeout: 260 seconds) [10:57] *** r3c0d3x has joined #archiveteam [11:16] *** MMovie1 has joined #archiveteam [11:18] *** MMovie has quit IRC (Read error: Operation timed out) [12:50] *** Tomcat_ has quit IRC (Remote host closed the connection) [13:31] *** Emcy has joined #archiveteam [13:48] voltagex: that wget-lua build error is caused by the documentation failing to build [13:48] If the actual executable built you can just ignore it [13:49] (the error, that is) [13:50] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [13:50] Yeah [13:51] *** RichardG has quit IRC (Ping timeout: 260 seconds) [13:51] I've been trying to create Debian / Ubuntu packages for it [13:57] *** BartoCH has joined #archiveteam [14:02] *** RichardG has joined #archiveteam [14:09] *** swebb has joined #archiveteam [14:18] *** JesseW has joined #archiveteam [14:21] *** atlogbot has joined #archiveteam [14:21] *** Honno has quit IRC (Read error: Operation timed out) [14:29] *** Honno has joined #archiveteam [14:30] *** Start has quit IRC (Quit: Disconnected.) [14:39] *** JesseW has quit IRC (Ping timeout: 370 seconds) [14:40] *** WinterFox has quit IRC (Remote host closed the connection) [14:41] *** RichardG has quit IRC (Read error: Connection reset by peer) [14:41] *** RichardG has joined #archiveteam [14:52] *** RichardG has quit IRC (Ping timeout: 499 seconds) [14:53] wait, does it actually build the executable with the error? [14:53] i manually edited the documentation so it would build properly.. but maybe that wasnt needed then :D [14:55] *** RichardG has joined #archiveteam [15:29] *** ariscop has quit IRC (Read error: Operation timed out) [16:33] *** Start has joined #archiveteam [16:54] *** fie has quit IRC (Read error: Operation timed out) [16:56] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [16:57] *** fie has joined #archiveteam [17:29] *** Start has quit IRC (Quit: Disconnected.) [17:34] *** pfallenop has quit IRC (Ping timeout: 260 seconds) [17:47] *** pfallenop has joined #archiveteam [17:55] Rotab would you mind making patchfile? [17:55] i'm sure you can like submit that to chfoo or archiver [17:55] i didnt fix it [17:55] ah [17:55] ok [17:55] i just made it build [17:56] ok [18:05] *** BartoCH has joined #archiveteam [18:16] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [18:32] *** Start has joined #archiveteam [18:33] *** BartoCH has joined #archiveteam [18:54] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [19:10] After nearly 7 years of operation, the time has come to retire [19:10] openstreetview.org. [19:14] *** tomwsmf-a has joined #archiveteam [19:17] TIL that existed [19:21] *** Emcy_ has joined #archiveteam [19:24] *** Emcy has quit IRC (Read error: Operation timed out) [19:32] https://wazaonline.com/en/article/goodbye-waza-hello-this-is-africa [19:32] All journeys have to reach an end at some point, and this article marks the official end of the journey for Wazaonline’s publications in English. [19:45] *** Start has quit IRC (Quit: Disconnected.) [19:50] *** VADemon has joined #archiveteam [20:10] *** BartoCH has joined #archiveteam [20:22] *** atrocity has quit IRC (Read error: Operation timed out) [20:27] *** tfgbd has joined #archiveteam [20:27] Hello there [20:28] Anyone home? [20:28] What happened to Archive.org? [20:28] tfgbd: what do you mean? [20:28] It seems like they removed half of the features it had on the old site [20:29] They updated the site a while back, not that familiar with the old design though.. [20:29] It used to let you look into archives [20:29] Without downloading [20:30] Now you need to download a 4tb+ tar or zip just to get one file [20:30] *** Muad-Dib has quit IRC (Quit: ZNC - http://znc.in) [20:32] tfgbd: they still have that [20:33] just put a / after the file's download url and it should list it [20:33] Thanks [20:34] It's not documented anywhere, though [20:34] Before it was right on the page [20:35] It should be right on the page, don't you think? [20:35] yeah, probably [20:35] like ISO IMAGE [browse] [20:35] Why did they change the site, anyway? [20:35] Yeah, I see it still works [20:36] because the old one was from 1998 and didn't look good at all on big monitors [20:36] woop woop woop off-topic siren [20:36] also other reasons like it was unmaintainable, they changed a lot of stuff [20:38] Ok, it works: https://ia601407.us.archive.org/zipview.php?zip=/6/items/SurfaceRT80_201411/Surface%20RT%208.0%20Asia.zip/ [20:39] yes [20:43] Does the python uploader still work? [20:43] This one? https://github.com/jjjake/internetarchive/ [20:44] Yes, that one should still work [20:45] Has archiveteam downsized? I don't see much newer stuff listed when I click the archiveteam tag [20:47] please move this conversation to #archiveteam-bs unless it's urgent [20:48] Sorry [20:54] *** schbirid has quit IRC (Quit: Leaving) [21:13] So I see [21:13] So waza is shutting down [21:15] schbirid: what is the source of that retirement message of openstreetview? [21:21] waza? Do you mean waze? [21:21] see the logs https://wazaonline.com/en/article/goodbye-waza-hello-this-is-africa [21:22] I see, it was posted here before you came online [21:25] Oh, okay [21:25] I wish I knew about you guys some years back. [21:26] I found a really interesting forum that was hanging on a thread a little while back [21:26] It's gone now, though [21:26] take it to #archiveteam-bs [21:43] *** mutoso has quit IRC (Read error: Operation timed out) [21:44] *** mutoso has joined #archiveteam [22:16] *** ploop_ has joined #archiveteam [22:23] *** ploop has quit IRC (Ping timeout: 961 seconds) [22:29] *** wyatt8740 has quit IRC (Read error: Operation timed out) [22:34] *** ariscop has joined #archiveteam [22:39] *** wyatt8740 has joined #archiveteam [23:09] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [23:12] *** Honno has quit IRC (Read error: Operation timed out) [23:17] *** WinterFox has joined #archiveteam