#urlteam 2017-11-30,Thu

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
Somebody2Jusque: we have error messages -- let me print them out for you: [02:58]
....... (idle for 32mn)
Jusque: hm, tinyurl seems to be working again. IDK
if it starts breaking, I'll be sure and paste the error messages here
Jusque: OK, got them:
Traceback (most recent call last):
File "scraper.py", line 42, in main
result = scraper_client.run()
File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/client/scraper.py", line 61, in run
result = self.service.scrape_one(item)
File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/services/base.py", line 56, in scrape_one
url_status, result_url, encoding = self.process_response(response)
File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/services/base.py", line 96, in process_response
return self.process_redirect(response)
File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/services/tinyurl.py", line 30, in process_redirect
self.current_shortcode, response.headers['Location']
File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/services/tinyurl.py", line 124, in _preview
raise UnexpectedNoResult("Unexpected HTTP status %i on preview page %s" % (response.status_code, response.url))
UnexpectedNoResult: Unexpected HTTP status 301 on preview page http://tinyurl.com/preview.php?num=pzpi9az

Also this one: UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe5 in position 86: invalid continuation byte
full traceback here: https://hastebin.com/ozojajimig.sql
[03:30]
..... (idle for 22mn)
arkiverarkiver has some bad experience with 'invalid' continuation bytes and python [03:59]
Somebody2Haven't we all... :-(
The errors are absolutely intermittent across different URLs, but do seem consistent with particular URLs.
[04:06]
So there are two URLs that are unexpectedly returning 301 -- that's easy enough to work around, at least...
http://tinyurl.com/preview.php?num=pzpi9az
http://tinyurl.com/preview.php?num=kk5rtj7
[04:12]
.... (idle for 16mn)
And the other two failing items are the ones generating the Unicode error:
which *DOES* seem to be intermittent at the same item, so we don't need to worry about it for now.
OK, it's an easy enough fix. The tinyurl code includes a hardcoded http: url that needs to be changed to https:
I *think* I have sufficient rights to commit the fix, but not to deploy it. chfoo?
[04:28]
chfooyeah, i can do that right now [04:38]
Somebody2Cool, thanks.
The tracker is complaining about https errors itself, now...
I presume because you are re-deploying?
I'll let you hit the Merge button.
[04:39]
chfooi'm trying to log in right now [04:42]
Somebody2seems to be working again for me [04:42]
chfoooh, i think it was redis dumping the database file. it hasn't gotten maintenance in a long time i suppose [04:43]
Somebody2Ha. [04:43]
***GitHub127 has joined #urlteam
GitHub127 has left
[04:46]
chfooit might take a few more minutes. it's not responding for periods of time [04:48]
should be ok now [04:58]
Somebody2Will try. [05:02]
Cool, tinyurl is fixed!
and turned back on
[05:12]
................................. (idle for 2h41mn)
***Aerochrom has joined #urlteam [07:53]
...................... (idle for 1h46mn)
medowar has joined #urlteam [09:39]
JusqueYay. Happy to help. What else can I ask questions about? :P [09:53]
***yuitimoth has quit IRC (se.hub irc.efnet.nl)
SmileyG has quit IRC (se.hub irc.efnet.nl)
Fusl has quit IRC (se.hub irc.efnet.nl)
yuitimoth has joined #urlteam
SmileyG has joined #urlteam
Fusl has joined #urlteam
[10:07]
................................ (idle for 2h35mn)
marvinw has quit IRC (Leaving)
marvinw has joined #urlteam
dashcloud has quit IRC (Quit: No Ping reply in 180 seconds.)
dashcloud has joined #urlteam
[12:44]
..................................... (idle for 3h3mn)
Aerochrom has quit IRC (Ping timeout: 248 seconds)
Aerochrom has joined #urlteam
[15:52]
.............................. (idle for 2h25mn)
CoolCanuk has joined #urlteam [18:17]
phuzion has quit IRC (Remote host closed the connection) [18:22]
........................................ (idle for 3h18mn)
figpucker has quit IRC (Read error: Connection reset by peer) [21:40]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)