| Time |
Nickname |
Message |
|
00:13
🔗
|
|
onyxlynx has quit IRC (Leaving) |
|
00:24
🔗
|
|
ndiddy has quit IRC (Read error: Operation timed out) |
|
00:44
🔗
|
|
JesseW has joined #archiveteam |
|
00:54
🔗
|
|
ats has quit IRC (Read error: Operation timed out) |
|
01:05
🔗
|
|
JesseW has quit IRC (Read error: Operation timed out) |
|
01:13
🔗
|
|
Emcy has quit IRC (Read error: Operation timed out) |
|
01:19
🔗
|
|
ats has joined #archiveteam |
|
01:27
🔗
|
|
ats has quit IRC (Read error: Operation timed out) |
|
02:10
🔗
|
|
DFJustin has quit IRC (Read error: Operation timed out) |
|
02:15
🔗
|
|
VADemon has quit IRC (Quit: left4dead) |
|
02:17
🔗
|
|
maseck_ has quit IRC (Remote host closed the connection) |
|
02:41
🔗
|
|
metalcamp has quit IRC (Ping timeout: 244 seconds) |
|
03:11
🔗
|
|
ats has joined #archiveteam |
|
03:26
🔗
|
|
JesseW has joined #archiveteam |
|
03:51
🔗
|
|
JesseW has quit IRC (Read error: Operation timed out) |
|
04:00
🔗
|
|
maseck has joined #archiveteam |
|
04:27
🔗
|
|
tomwsmf-a has quit IRC (Read error: Operation timed out) |
|
04:30
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
04:39
🔗
|
|
Sk1d has joined #archiveteam |
|
04:41
🔗
|
|
DFJustin has joined #archiveteam |
|
04:41
🔗
|
|
swebb sets mode: +o DFJustin |
|
04:58
🔗
|
|
JesseW has joined #archiveteam |
|
05:16
🔗
|
JesseW |
voltagex: Have you updated your warriors with the new version of python? It looks like you may not have -- if so, please do. |
|
05:24
🔗
|
voltagex |
Fuck, I'll tear them down immediately |
|
05:24
🔗
|
voltagex |
I'm very sorry |
|
05:26
🔗
|
voltagex |
JesseW: Did I do any damage? I was building them with https://gist.github.com/voltagex/6511a43b75d0eca3224c07cf6d3ec53a but on Ubuntu 14.04 (whatever the LTS is on Amazon) |
|
05:27
🔗
|
JesseW |
damage, no |
|
05:28
🔗
|
JesseW |
you don't need to tear them down |
|
05:29
🔗
|
JesseW |
it's just that is.gd recently switched to https only, which requires a newer version of python than is built into the virtual machine we are distributing, so |
|
05:29
🔗
|
JesseW |
we (well, chfoo) made a hacky separate warrior project just to upgrade the version of python |
|
05:30
🔗
|
JesseW |
and running the old version doesn't do any damage -- the jobs just fail |
|
05:30
🔗
|
JesseW |
it's just that you are (very helpfully) running a lot of instances, so if you upgrade, we should get a lot fewer failed jobs than if you don't |
|
05:34
🔗
|
voltagex |
Okay. I'm not running the warrior, I'm using pipeline directly |
|
05:34
🔗
|
voltagex |
I have "free" instances for another two days or so via AWS credits so I'd like to be as helpful as possible |
|
05:35
🔗
|
voltagex |
My concern was submitting bad data to you guys |
|
05:36
🔗
|
JesseW |
thanks for being concerned, but no worries on that score |
|
05:36
🔗
|
JesseW |
can you check what version of python it is running? |
|
05:37
🔗
|
voltagex |
They're stopped until I have a chance to look into it. I never actually log into the boxes - most of it is automated. I suspect the Ubuntu version is too old |
|
05:38
🔗
|
JesseW |
eh, feel free to turn them back on -- they are doing useful work on all the *other* shorteners |
|
05:39
🔗
|
voltagex |
I panicked :p they'll be back in half an hour or so haha |
|
05:39
🔗
|
JesseW |
and they weren't doing any harm on isgd -- just being a large contingent of a general problem |
|
05:39
🔗
|
JesseW |
sorry for encouraging your panic |
|
05:39
🔗
|
voltagex |
Yes, I don't want to create any more work for you. Can you provide details of what I need to check? |
|
05:40
🔗
|
JesseW |
Urlteam is pretty safe -- the sites we poke at generally don't die quickly, and if we get bad data, we can just check the links again |
|
05:40
🔗
|
JesseW |
sure |
|
05:40
🔗
|
voltagex |
Would it be worth making the script warn / fail if the Python version is old? |
|
05:40
🔗
|
voltagex |
You may want to add a warning about that to the wiki somewhere |
|
05:41
🔗
|
JesseW |
yeah, that would probably be good |
|
05:41
🔗
|
voltagex |
Although I might be one of the few not using the warrior, and I'm definitely the only one who got bored and spun up 80x4 grabbers for fun :p |
|
05:41
🔗
|
JesseW |
Most of the people running lots of grabbers aren't using the warrior |
|
05:42
🔗
|
JesseW |
All you need to check is whether the scripts are running on python 2.7 or python 2.6 |
|
05:42
🔗
|
JesseW |
2.7 is good, 2.6 is not. |
|
05:42
🔗
|
JesseW |
(just for isgd_6 -- the rest work fine on 2.6) |
|
05:48
🔗
|
voltagex |
okay, let me have a look |
|
05:50
🔗
|
voltagex |
-_- it looks like it should be using 2.7.6 |
|
05:51
🔗
|
JesseW |
hm |
|
05:52
🔗
|
JesseW |
once you get them back up, could you look at the console on a few, and see whether they work with isgd_6 jobs? |
|
05:53
🔗
|
JesseW |
actually, I'm just going to turn off isgd for now; so you can just fire up all your grabbers and not have to worry about it |
|
05:53
🔗
|
JesseW |
we can try figuring out isgd again later in June |
|
05:55
🔗
|
voltagex |
I can help |
|
05:55
🔗
|
voltagex |
let me know what output you need |
|
05:56
🔗
|
voltagex |
The tweak from my end should be easyh |
|
05:56
🔗
|
voltagex |
I'm putting one single grabber with 4 threads now |
|
05:57
🔗
|
JesseW |
eh, I don't feel like investigating it more right now -- and it was pretty clearly not your grabbers that were having a problem, if they were on py2.7 |
|
05:57
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
05:57
🔗
|
voltagex |
I'm still working that out |
|
05:57
🔗
|
voltagex |
2.7.5 is "default |
|
05:57
🔗
|
voltagex |
I'll run the build script and see what version I get |
|
05:57
🔗
|
JesseW |
if you want to be sure your grabbers aren't making trouble, just keep an eye on http://tracker.archiveteam.org:1337/ and make sure your total keeps going up. :-) |
|
05:58
🔗
|
voltagex |
I was - I actually wish I could query the tracker for more info |
|
05:58
🔗
|
voltagex |
or at least see more info on the console / web UI |
|
05:58
🔗
|
voltagex |
the dream would be an API for the web UI so I could do my own totals and keep an eye on it |
|
05:58
🔗
|
voltagex |
but I don't often have $100 to spend on EC2 like I do now :P |
|
05:59
🔗
|
JesseW |
the tracker code is open source, and patches are welcome :-) |
|
05:59
🔗
|
voltagex |
yep |
|
06:00
🔗
|
JesseW |
an API would be a useful enough addition |
|
06:00
🔗
|
|
pintoch has joined #archiveteam |
|
06:01
🔗
|
JesseW |
in any case, g'night for now |
|
06:01
🔗
|
voltagex |
damnit, timezones. |
|
06:01
🔗
|
voltagex |
okay, see ya |
|
06:01
🔗
|
voltagex |
For next time you're on, can you poke the maintainer of https://github.com/ArchiveTeam/arto-grab/ to look at https://github.com/ArchiveTeam/arto-grab/issues/2? |
|
06:03
🔗
|
voltagex |
confirming my grabbers are using 2.7.6... |
|
06:07
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
|
06:18
🔗
|
|
Start has joined #archiveteam |
|
06:44
🔗
|
|
WinterFox has joined #archiveteam |
|
06:48
🔗
|
HCross2 |
arkiver: ^^^^ |
|
07:07
🔗
|
|
Tomcat_ has joined #archiveteam |
|
07:56
🔗
|
|
bsmith093 has quit IRC (Ping timeout: 370 seconds) |
|
08:11
🔗
|
|
schbirid has joined #archiveteam |
|
08:17
🔗
|
|
atlogbot has quit IRC (Ping timeout: 370 seconds) |
|
08:18
🔗
|
|
bsmith093 has joined #archiveteam |
|
08:50
🔗
|
|
Honno has joined #archiveteam |
|
08:54
🔗
|
|
swebb has quit IRC (Ping timeout: 246 seconds) |
|
08:55
🔗
|
|
ariscop has quit IRC (Read error: Operation timed out) |
|
08:57
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
09:24
🔗
|
johtso |
You might be interested in this.. https://gist.github.com/johtso/49f2c9c485c264f851ba42c75c513590 |
|
09:24
🔗
|
johtso |
voltagex |
|
09:30
🔗
|
voltagex |
Hahaha |
|
09:31
🔗
|
voltagex |
There's no way I'll catch up to you |
|
09:32
🔗
|
|
MMovie has quit IRC (Read error: Operation timed out) |
|
09:33
🔗
|
voltagex |
nice, thanks |
|
09:34
🔗
|
voltagex |
currently knee-deep trying to work out wget-lua |
|
09:48
🔗
|
|
ariscop has joined #archiveteam |
|
09:52
🔗
|
|
metalcamp has joined #archiveteam |
|
10:41
🔗
|
|
MMovie has joined #archiveteam |
|
10:47
🔗
|
|
r3c0d3x has quit IRC (Ping timeout: 260 seconds) |
|
10:57
🔗
|
|
r3c0d3x has joined #archiveteam |
|
11:16
🔗
|
|
MMovie1 has joined #archiveteam |
|
11:18
🔗
|
|
MMovie has quit IRC (Read error: Operation timed out) |
|
12:50
🔗
|
|
Tomcat_ has quit IRC (Remote host closed the connection) |
|
13:31
🔗
|
|
Emcy has joined #archiveteam |
|
13:48
🔗
|
MrRadar |
voltagex: that wget-lua build error is caused by the documentation failing to build |
|
13:48
🔗
|
MrRadar |
If the actual executable built you can just ignore it |
|
13:49
🔗
|
MrRadar |
(the error, that is) |
|
13:50
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
13:50
🔗
|
voltagex |
Yeah |
|
13:51
🔗
|
|
RichardG has quit IRC (Ping timeout: 260 seconds) |
|
13:51
🔗
|
voltagex |
I've been trying to create Debian / Ubuntu packages for it |
|
13:57
🔗
|
|
BartoCH has joined #archiveteam |
|
14:02
🔗
|
|
RichardG has joined #archiveteam |
|
14:09
🔗
|
|
swebb has joined #archiveteam |
|
14:18
🔗
|
|
JesseW has joined #archiveteam |
|
14:21
🔗
|
|
atlogbot has joined #archiveteam |
|
14:21
🔗
|
|
Honno has quit IRC (Read error: Operation timed out) |
|
14:29
🔗
|
|
Honno has joined #archiveteam |
|
14:30
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
14:39
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
|
14:40
🔗
|
|
WinterFox has quit IRC (Remote host closed the connection) |
|
14:41
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
|
14:41
🔗
|
|
RichardG has joined #archiveteam |
|
14:52
🔗
|
|
RichardG has quit IRC (Ping timeout: 499 seconds) |
|
14:53
🔗
|
Rotab |
wait, does it actually build the executable with the error? |
|
14:53
🔗
|
Rotab |
i manually edited the documentation so it would build properly.. but maybe that wasnt needed then :D |
|
14:55
🔗
|
|
RichardG has joined #archiveteam |
|
15:29
🔗
|
|
ariscop has quit IRC (Read error: Operation timed out) |
|
16:33
🔗
|
|
Start has joined #archiveteam |
|
16:54
🔗
|
|
fie has quit IRC (Read error: Operation timed out) |
|
16:56
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
16:57
🔗
|
|
fie has joined #archiveteam |
|
17:29
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
17:34
🔗
|
|
pfallenop has quit IRC (Ping timeout: 260 seconds) |
|
17:47
🔗
|
|
pfallenop has joined #archiveteam |
|
17:55
🔗
|
luckcolor |
Rotab would you mind making patchfile? |
|
17:55
🔗
|
luckcolor |
i'm sure you can like submit that to chfoo or archiver |
|
17:55
🔗
|
Rotab |
i didnt fix it |
|
17:55
🔗
|
luckcolor |
ah |
|
17:55
🔗
|
luckcolor |
ok |
|
17:55
🔗
|
Rotab |
i just made it build |
|
17:56
🔗
|
luckcolor |
ok |
|
18:05
🔗
|
|
BartoCH has joined #archiveteam |
|
18:16
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
18:32
🔗
|
|
Start has joined #archiveteam |
|
18:33
🔗
|
|
BartoCH has joined #archiveteam |
|
18:54
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
19:10
🔗
|
schbirid |
After nearly 7 years of operation, the time has come to retire |
|
19:10
🔗
|
schbirid |
openstreetview.org. |
|
19:14
🔗
|
|
tomwsmf-a has joined #archiveteam |
|
19:17
🔗
|
Frogging |
TIL that existed |
|
19:21
🔗
|
|
Emcy_ has joined #archiveteam |
|
19:24
🔗
|
|
Emcy has quit IRC (Read error: Operation timed out) |
|
19:32
🔗
|
Medowar |
https://wazaonline.com/en/article/goodbye-waza-hello-this-is-africa |
|
19:32
🔗
|
Medowar |
All journeys have to reach an end at some point, and this article marks the official end of the journey for Wazaonline’s publications in English. |
|
19:45
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
19:50
🔗
|
|
VADemon has joined #archiveteam |
|
20:10
🔗
|
|
BartoCH has joined #archiveteam |
|
20:22
🔗
|
|
atrocity has quit IRC (Read error: Operation timed out) |
|
20:27
🔗
|
|
tfgbd has joined #archiveteam |
|
20:27
🔗
|
tfgbd |
Hello there |
|
20:28
🔗
|
tfgbd |
Anyone home? |
|
20:28
🔗
|
tfgbd |
What happened to Archive.org? |
|
20:28
🔗
|
johtso |
tfgbd: what do you mean? |
|
20:28
🔗
|
tfgbd |
It seems like they removed half of the features it had on the old site |
|
20:29
🔗
|
johtso |
They updated the site a while back, not that familiar with the old design though.. |
|
20:29
🔗
|
tfgbd |
It used to let you look into archives |
|
20:29
🔗
|
tfgbd |
Without downloading |
|
20:30
🔗
|
tfgbd |
Now you need to download a 4tb+ tar or zip just to get one file |
|
20:30
🔗
|
|
Muad-Dib has quit IRC (Quit: ZNC - http://znc.in) |
|
20:32
🔗
|
xmc |
tfgbd: they still have that |
|
20:33
🔗
|
xmc |
just put a / after the file's download url and it should list it |
|
20:33
🔗
|
tfgbd |
Thanks |
|
20:34
🔗
|
tfgbd |
It's not documented anywhere, though |
|
20:34
🔗
|
tfgbd |
Before it was right on the page |
|
20:35
🔗
|
tfgbd |
It should be right on the page, don't you think? |
|
20:35
🔗
|
xmc |
yeah, probably |
|
20:35
🔗
|
xmc |
like ISO IMAGE [browse] |
|
20:35
🔗
|
tfgbd |
Why did they change the site, anyway? |
|
20:35
🔗
|
tfgbd |
Yeah, I see it still works |
|
20:36
🔗
|
xmc |
because the old one was from 1998 and didn't look good at all on big monitors |
|
20:36
🔗
|
xmc |
woop woop woop off-topic siren |
|
20:36
🔗
|
xmc |
also other reasons like it was unmaintainable, they changed a lot of stuff |
|
20:38
🔗
|
tfgbd |
Ok, it works: https://ia601407.us.archive.org/zipview.php?zip=/6/items/SurfaceRT80_201411/Surface%20RT%208.0%20Asia.zip/ |
|
20:39
🔗
|
xmc |
yes |
|
20:43
🔗
|
tfgbd |
Does the python uploader still work? |
|
20:43
🔗
|
MrRadar |
This one? https://github.com/jjjake/internetarchive/ |
|
20:44
🔗
|
MrRadar |
Yes, that one should still work |
|
20:45
🔗
|
tfgbd |
Has archiveteam downsized? I don't see much newer stuff listed when I click the archiveteam tag |
|
20:47
🔗
|
xmc |
please move this conversation to #archiveteam-bs unless it's urgent |
|
20:48
🔗
|
tfgbd |
Sorry |
|
20:54
🔗
|
|
schbirid has quit IRC (Quit: Leaving) |
|
21:13
🔗
|
arkiver |
So I see |
|
21:13
🔗
|
arkiver |
So waza is shutting down |
|
21:15
🔗
|
arkiver |
schbirid: what is the source of that retirement message of openstreetview? |
|
21:21
🔗
|
tfgbd |
waza? Do you mean waze? |
|
21:21
🔗
|
arkiver |
see the logs https://wazaonline.com/en/article/goodbye-waza-hello-this-is-africa |
|
21:22
🔗
|
arkiver |
I see, it was posted here before you came online |
|
21:25
🔗
|
tfgbd |
Oh, okay |
|
21:25
🔗
|
tfgbd |
I wish I knew about you guys some years back. |
|
21:26
🔗
|
tfgbd |
I found a really interesting forum that was hanging on a thread a little while back |
|
21:26
🔗
|
tfgbd |
It's gone now, though |
|
21:26
🔗
|
xmc |
take it to #archiveteam-bs |
|
21:43
🔗
|
|
mutoso has quit IRC (Read error: Operation timed out) |
|
21:44
🔗
|
|
mutoso has joined #archiveteam |
|
22:16
🔗
|
|
ploop_ has joined #archiveteam |
|
22:23
🔗
|
|
ploop has quit IRC (Ping timeout: 961 seconds) |
|
22:29
🔗
|
|
wyatt8740 has quit IRC (Read error: Operation timed out) |
|
22:34
🔗
|
|
ariscop has joined #archiveteam |
|
22:39
🔗
|
|
wyatt8740 has joined #archiveteam |
|
23:09
🔗
|
|
metalcamp has quit IRC (Ping timeout: 244 seconds) |
|
23:12
🔗
|
|
Honno has quit IRC (Read error: Operation timed out) |
|
23:17
🔗
|
|
WinterFox has joined #archiveteam |