#archiveteam-bs 2013-09-30,Mon

↑back Search

Time Nickname Message
05:45 πŸ”— ersi http://kajjan.bloggo.nu/robots.txt
05:45 πŸ”— ersi User-agent: ia_archiver
05:45 πŸ”— ersi Disallow: /
05:45 πŸ”— omf_ :(
05:45 πŸ”— ersi I don't get why people do that
05:45 πŸ”— ersi Assholes
05:46 πŸ”— omf_ because fuck history?
05:46 πŸ”— ersi I guess
05:46 πŸ”— ersi Well, I'll force download the whole thing sooner or later
05:46 πŸ”— ersi because, fuck your settings etc :D
06:01 πŸ”— yipdw ersi: that doesn't look that big
06:03 πŸ”— ersi nah, that's just one blog of several at *.bloggo.nu*
06:03 πŸ”— ersi It's some kind of blog hosting provider
06:03 πŸ”— yipdw oh
06:03 πŸ”— joepie92 ersi: so apparently Alexa also uses ia_archiver or something?
06:03 πŸ”— joepie92 as useragent
06:04 πŸ”— yipdw !abort 636acsp7a8xu71hzpze43l6di
06:04 πŸ”— ersi It does? I guess it wouldn't be super strange, seeing how Brewster Kahle made Alexa and all
06:04 πŸ”— ATBot yipdw: Initiated abort for http://kajjan.bloggo.nu/.
06:04 πŸ”— yipdw wait wtf
06:04 πŸ”— yipdw oh right
06:04 πŸ”— yipdw I forgot that bot was in here
06:04 πŸ”— ersi haha
06:04 πŸ”— joepie92 also, ia_archiver is also in a bunch of 'unsafe robot' lists
06:04 πŸ”— joepie92 such as http://www.yellowpipe.com/yis/tools/robots.txt/unsafe-robots.php
06:04 πŸ”— joepie92 unrelated
06:05 πŸ”— joepie92 if anyone has a bunch of idle wget-warcs
06:05 πŸ”— joepie92 here's your todo list: https://www.google.nl/search?q=%22User-agent%3A+ia_archiver%22&oq=%22User-agent%3A+ia_archiver%22&aqs=chrome..69i57.1129j0&sourceid=chrome&ie=UTF-8#q=%22User-agent%3A+ia_archiver%22+inurl%3A%22robots.txt%22+-how
06:05 πŸ”— ersi "unsafe robots" o_o
06:05 πŸ”— joepie92 :)
06:05 πŸ”— ersi How would they be.. unsafe..
06:05 πŸ”— yipdw they violate the Three Laws
06:05 πŸ”— ersi hah
06:06 πŸ”— yipdw My Spouse Was Killed by The Googlebot
06:06 πŸ”— yipdw " User-agent: grub"
06:06 πŸ”— yipdw haha what
06:08 πŸ”— yipdw I wonder if website operators still do user-agent bans on server side
06:08 πŸ”— yipdw if they do maybe I should change ATBot's user-agent
06:08 πŸ”— ersi Yeah, they still do I think
06:08 πŸ”— yipdw hmm
06:08 πŸ”— ersi Because there's still retarded robots, which sometimes are nice enough to stop being retarded if you block them with a robots.txt
06:08 πŸ”— joepie92 yipdw: that's a very grubby bootloader scraper there!
06:09 πŸ”— ersi By the way, ever seen a GoogleBot crawl in action? I worked at a shared-hosting company.. and it was a bit amazing
06:09 πŸ”— joepie92 ersi: how do you mean?
06:09 πŸ”— yipdw ersi: I've seen a couple, but only on small sites like mine
06:10 πŸ”— ersi joepie92: They launch.. a lot, of connections and pull really quickly. I'm not sure if they think "Hey, these are all on the same IP/IP-range" or just "Let's load a million jobs up at once" - but damn :)
06:10 πŸ”— ersi I mean, that shared-hosting company had.. a lot of customers. And they hit, quite many, at the same time ;D
06:14 πŸ”— joepie92 ah, in that sense
06:14 πŸ”— joepie92 well, I've seen from my own access logs that Googlebot doesn't seem very good at distributing load
06:14 πŸ”— joepie92 then again, not sure if you can expect them to
06:15 πŸ”— joepie92 with such a large operation
06:17 πŸ”— ersi I think they're okay with a few failures ;)
07:37 πŸ”— joepie92 http://owely.com/413eo2F
07:37 πŸ”— joepie92 this is just... no.
07:37 πŸ”— joepie92 Nokia, this is NOT how you handle disappearing pages
07:43 πŸ”— GLaDOS I LIVE AGAIN AFTER BARELY MAKING IT THROUGH A SCHOOL CAMP
07:50 πŸ”— joepie92 welcome back to the land of the living, GLaDOS
09:25 πŸ”— ersi joepie92: Hah.. well.. better than nothing (ie HTTP 404)I guess
09:32 πŸ”— joepie92 ersi: not much difference in practice
09:32 πŸ”— joepie92 "HAHA SUCKER ARTICLE IS GONE, GO LOOK FOR IT YOURSELF"
09:32 πŸ”— joepie92 is pretty much what it comes down to
09:32 πŸ”— joepie92 :|
09:32 πŸ”— ersi Sure, but at least it points.. somewhere.
09:35 πŸ”— brayden It is a little treasure hunt.
09:35 πŸ”— GLaDOS I love treasure hunts!
09:36 πŸ”— GLaDOS Especially when the outcome is 04,01death
09:37 πŸ”— * ersi backs away slowly
09:38 πŸ”— joepie92 GLaDOS: well, that killed the atmosphere there
09:38 πŸ”— joepie92 hehe
09:38 πŸ”— GLaDOS hue
09:39 πŸ”— ersi huehuehue
09:39 πŸ”— ersi http://huehuehuehue.com/
09:40 πŸ”— omf_ （x_x；）
09:40 πŸ”— GLaDOS whyyyyyyyyy
09:43 πŸ”— * joepie92 blinks
09:44 πŸ”— joepie92 a Qt QThread doesn't have an 'abort' signal, just a 'finished' signal that doesn't fire when it's aborted?
09:44 πŸ”— joepie92 what
09:44 πŸ”— brayden aahhaahahahahahah
09:44 πŸ”— brayden what the hell
09:44 πŸ”— joepie92 waaaait
09:45 πŸ”— joepie92 never mind
09:45 πŸ”— * brayden likes Qt, other than that thing
09:45 πŸ”— joepie92 just misunderstanding something
09:45 πŸ”— GLaDOS That can only end well.
09:45 πŸ”— brayden Pfft
09:45 πŸ”— brayden You doubted it!
09:45 πŸ”— joepie92 all the Qt examples on the net use "sys.exit(app.exec_())"
09:45 πŸ”— joepie92 which makes sense
09:45 πŸ”— joepie92 EXCEPT WHEN YOU WANT TO HANDLE THREAD ABORST
09:45 πŸ”— joepie92 ABORTS *
09:45 πŸ”— joepie92 derp
09:46 πŸ”— brayden PyQt?
09:48 πŸ”— joepie92 brayden: yes
09:48 πŸ”— brayden ah neat
09:48 πŸ”— joepie92 pyqt threads are mostly an undocumented mess
09:49 πŸ”— brayden Yeah :(
09:49 πŸ”— joepie92 I kinda implemented thread-safely correct thread subclassing
09:49 πŸ”— brayden Tried to learn them and went "fuck it"
09:49 πŸ”— joepie92 but I'm having trouble with the shutdown bit
09:49 πŸ”— joepie92 that is
09:49 πŸ”— brayden But I do like PyQt a lot
09:49 πŸ”— joepie92 cleanly running shutdown functions
09:49 πŸ”— joepie92 before pyqt goes
09:49 πŸ”— omf_ I always read the official QT docs first. They are complete and well maintained
09:49 πŸ”— joepie92 HAHAHAHA IMA BURN EVERYTHING IN THIS PROCESS DOWN TO THE GROUND
09:49 πŸ”— joepie92 which is kind of what I want to avoid
09:49 πŸ”— joepie92 lol
09:49 πŸ”— brayden It works great on Windows/Linux, unlike Java swing which looks like crap on anything :(
09:50 πŸ”— joepie92 omf_: the official Qt docs describe Qt, not PyQt
09:50 πŸ”— joepie92 they're not much help when trying to figure out "hey how do I do threads sanely in Python with Qt"
09:50 πŸ”— joepie92 brayden: heh.
09:50 πŸ”— omf_ but they have forums and have you tried searching their forums?
09:51 πŸ”— joepie92 omf_: I google
09:51 πŸ”— joepie92 I am assuming their forums are Google-indexed
09:51 πŸ”— joepie92 (I avoid forum-specific search functionality, it almost always sucks balls)
09:59 πŸ”— joepie92 k
09:59 πŸ”— joepie92 starting to get seriously annoyed now
10:01 πŸ”— joepie92 brayden: help
10:01 πŸ”— joepie92 lol
10:01 πŸ”— joepie92 http://pastie.org/private/y5kwulqaf7tneqyrhfyfua
10:02 πŸ”— joepie92 t = ApplicationThread()
10:02 πŸ”— joepie92 however, t.shutdown() won't actually properly emit the shutdown signal
10:02 πŸ”— joepie92 it reaches that shutdown function defined in BaseThread, but self.worker.shutdown is never called
10:02 πŸ”— joepie92 what am I fucking up?
10:06 πŸ”— brayden ..I don't know!
10:06 πŸ”— * brayden never did threads with PyQt, embarrassingly.
10:07 πŸ”— joepie92 :(
11:43 πŸ”— godane Famicoman: i found high res episodes of the first 2 episodes of rev3gazette
11:44 πŸ”— godane it only puts the first episode a 41mb and the 2nd episode at 36mb
13:23 πŸ”— godane Rev3 Gazette collection is starting: https://archive.org/details/Rev3_Gazette_1
13:24 πŸ”— godane i also found better video for the first 2 epsiodes
13:26 πŸ”— godane if anything there bigger then the youtube rips Famicoman grab and there from rev3 bitgravity
13:26 πŸ”— godane serives
13:26 πŸ”— godane *servers
15:41 πŸ”— yipdw_ joepie92: it's not possible for Qt (or any threading system) to emit finished() in all cases
15:41 πŸ”— yipdw_ if the thread abnormally terminates, the signal/slot system may not get a chance to emit it
15:41 πŸ”— yipdw_ if you want to send a message to terminate a thread, you almost always want to use a sentinel check, e.g. "if running"
15:41 πŸ”— joepie92 yipdw_: intention was a clean shutdown, but Qt appears to throw the baby out with the bathwater upon closing the main application window
15:42 πŸ”— yipdw_ ?
15:42 πŸ”— yipdw_ I've not encountered that, and I've used QThread a lot
15:42 πŸ”— joepie92 idk what's causing it
15:42 πŸ”— yipdw_ I guess I need to see the code you're working on
15:42 πŸ”— joepie92 either way, I somehow kinda fixed it and it's only for a testing thing
15:42 πŸ”— joepie92 and I kind of don't want to think about it
15:42 πŸ”— joepie92 anymore
15:42 πŸ”— joepie92 lol
15:42 πŸ”— yipdw_ hmm ok
15:42 πŸ”— yipdw_ well
15:42 πŸ”— joepie92 but if it keeps occurring again, I'll certainly poke you about it :P
15:42 πŸ”— yipdw_ I just wanted to throw in there that QThread's behavior is actually not insane
15:43 πŸ”— joepie92 oh, not saying it is
15:43 πŸ”— joepie92 was just unclear how to use it
19:59 πŸ”— ersi http://jgc.org/nocarrier.html
19:59 πŸ”— ersi o_o
19:59 πŸ”— ersi whyy
20:12 πŸ”— xmc it
20:12 πŸ”— xmc what
irclogger-viewer