#warrior 2013-01-14,Mon

↑back Search

Time Nickname Message
12:07 🔗 chazchaz My warrior is poping up an out of memory error, after which it seems to stop working properly until I reboot it.
12:08 🔗 chazchaz This has happened twice in the past few days working on the Yahoo Blogs grab
21:20 🔗 chfoo anyone know how i can see what urls the warrior is accessing? i'm seeing lots of requests to vi.wikipedia.org in wireshark while running yahoo blogs.
21:24 🔗 chfoo also i'm running low on memory as well
21:25 🔗 ersi chfoo: Log onto the Warrior over SSH or via the console and tail the wget log. Most projects are based on wget, and they'll log each request
21:29 🔗 chfoo ersi, i found the log and it's filled with wikipedia urls. probably not a good thing right?
21:29 🔗 ersi I don't know, I guess it depends on the project.
21:30 🔗 ersi chfoo: Go to #yahooblah for Yahoo Blog project :)
21:30 🔗 ersi they probably know more than me regarding if visiting wikipedia is a good thing for your runners to do ^_^
21:30 🔗 chfoo ok, sure

irclogger-viewer