Jusque: we have error messages -- let me print them out for you:
Jusque: hm, tinyurl seems to be working again. IDK
if it starts breaking, I'll be sure and paste the error messages here
Jusque: OK, got them:
Traceback (most recent call last):
  File "scraper.py", line 42, in main
    result = scraper_client.run()
  File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/client/scraper.py", line 61, in run
    result = self.service.scrape_one(item)
  File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/services/base.py", line 56, in scrape_one
    url_status, result_url, encoding = self.process_response(response)
  File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/services/base.py", line 96, in process_response
    return self.process_redirect(response)
  File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/services/tinyurl.py", line 30, in process_redirect
    self.current_shortcode, response.headers['Location']
  File "/home/ts/terroroftinytown-client-grab/terroroftinytown/terroroftinytown/services/tinyurl.py", line 124, in _preview
    raise UnexpectedNoResult("Unexpected HTTP status %i on preview page %s" % (response.status_code, response.url))
UnexpectedNoResult: Unexpected HTTP status 301 on preview page http://tinyurl.com/preview.php?num=pzpi9az
 
Also this one: UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe5 in position 86: invalid continuation byte
full traceback here: https://hastebin.com/ozojajimig.sql
Haven't we all... :-(
The errors are absolutely intermittent across different URLs, but do seem consistent with particular URLs.
So there are two URLs that are unexpectedly returning 301 -- that's easy enough to work around, at least...
http://tinyurl.com/preview.php?num=pzpi9az
http://tinyurl.com/preview.php?num=kk5rtj7
And the other two failing items are the ones generating the Unicode error:
which *DOES* seem to be intermittent at the same item, so we don't need to worry about it for now.
OK, it's an easy enough fix. The tinyurl code includes a hardcoded http: url that needs to be changed to https:
I *think* I have sufficient rights to commit the fix, but not to deploy it. chfoo?
yeah, i can do that right now
Cool, thanks.
The tracker is complaining about https errors itself, now...
I presume because you are re-deploying?
I'll let you hit the Merge button.
i'm trying to log in right now
seems to be working again for me
oh, i think it was redis dumping the database file. it hasn't gotten maintenance in a long time i suppose
Ha.
it might take a few more minutes. it's not responding for periods of time
should be ok now
Will try.
Cool, tinyurl is fixed!
and turned back on
Yay. Happy to help. What else can I ask questions about? :P