#warrior 2019-12-09,Mon

↑back Search

Time Nickname Message
01:38 πŸ”— d5f4a3622 has joined #warrior
01:44 πŸ”— atbk_ has joined #warrior
01:48 πŸ”— atbk has quit IRC (Ping timeout: 745 seconds)
02:14 πŸ”— d5f4a3622 has quit IRC (Read error: Connection reset by peer)
02:25 πŸ”— d5f4a3622 has joined #warrior
02:42 πŸ”— Decobus has joined #warrior
04:19 πŸ”— thelounge has joined #warrior
04:20 πŸ”— thelounge has left
04:34 πŸ”— WooWoo289 has joined #warrior
05:17 πŸ”— Craigle has quit IRC ()
05:17 πŸ”— WooWoo289 is now known as Craigle
05:54 πŸ”— bilboed has joined #warrior
08:55 πŸ”— vicarage_ What's the optimal number of threads on Warrior for Yahoo Groups?
08:57 πŸ”— britm0b has joined #warrior
08:58 πŸ”— Atom-- has joined #warrior
08:58 πŸ”— yano_ has joined #warrior
08:59 πŸ”— markedL I run 20, most the items are tiny
08:59 πŸ”— dxrt- has joined #warrior
09:00 πŸ”— markedL We'll be starting plays.tv today, and more workers are needed on Youtube also
09:01 πŸ”— vicarage_ Ah, my UI says it must be 6 or fewer. Getting lots of 'don't want to overload server' messages, perhaps I should go for YouTub manually
09:02 πŸ”— Dj-Wawa_ has joined #warrior
09:02 πŸ”— Craigle has quit IRC (Quit: The Lounge - https://thelounge.chat)
09:04 πŸ”— markedL 6 is better than 0. 20 is better than 6? *shrug*
09:07 πŸ”— bilboed some tasks get throttled at the central level
09:07 πŸ”— bilboed ex: the yahoogroups one
09:08 πŸ”— vicarage_ YouTube running 6 full loaded. Feeling useful!
09:12 πŸ”— kiska has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— Flashfire has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— Atom__ has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— britmob_ has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— britmob has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— Dj-Wawa has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— jrayhawk has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— seatsea has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— dxrt has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— yano has quit IRC (se.hub irc.underworld.no)
09:12 πŸ”— coderobe has quit IRC (se.hub irc.underworld.no)
09:18 πŸ”— vicarage_ As a general point, it is frustrating to pick a project and find its idle or throttling. Modifying the project page to show status Idle/Fully booked/Needs Help would be very useful
09:20 πŸ”— vicarage_ And having the tracker leaderbord having a position, as everyone loves to know they've moved up from 312 to 311th
09:20 πŸ”— markedL someone mentioned that yesterday. oh someone is you
09:25 πŸ”— vicarage_ I love the work you do, but do find the outreach to casual users rather frustrating
09:25 πŸ”— Medowar has joined #warrior
09:28 πŸ”— britmob has joined #warrior
09:28 πŸ”— markedL maybe there's a secret agenda to make casual users more active
09:37 πŸ”— dxrt- is now known as dxrt
09:37 πŸ”— dxrt has quit IRC (ZNC - http://znc.sourceforge.net)
09:37 πŸ”— dxrt has joined #warrior
10:12 πŸ”— jrayhawk has joined #warrior
10:35 πŸ”— vicarage_ has quit IRC (Ping timeout: 260 seconds)
10:48 πŸ”— vicarage has joined #warrior
11:13 πŸ”— Kaz One thing I noticed from the HN post is that we don't link to the docker container on the warrior wiki page, we still try to point people to the VM
11:13 πŸ”— Kaz ..that needs to change
11:13 πŸ”— Kaz If anyone wants to go ahead and fix that (and maybe tidy that page up in the process) that'd be grand & much appreciated
11:51 πŸ”— kiska has joined #warrior
13:05 πŸ”— Ajay Is there a way to increase the thread count if you aren't using the warrior? For the YouTube one for example. I tried just running multiple instances but it fails since it is running a web UI on a port already
13:07 πŸ”— kiska Use --port <port>
13:09 πŸ”— Ajay Ah, thanks. I was looking in pipeline.py and for some reason couldn't find anything.
13:27 πŸ”— yano_ is now known as yano
13:29 πŸ”— yano has quit IRC (WeeChat, The Better IRC Client, https://weechat.org/)
13:32 πŸ”— yano has joined #warrior
14:10 πŸ”— Kaz Ajay: easier is just --disable-web-server
14:18 πŸ”— Ajay That's even better, thanks!
14:27 πŸ”— Kaz Can go a step further too.. https://hub.docker.com/u/warcforceone if you want to run the script themselves without the warrior
14:27 πŸ”— Kaz it's just docker.. allll the way down
15:12 πŸ”— jrwr I've updated the wiki page to shove the docker link super high in the list
15:29 πŸ”— MaximeleG has joined #warrior
15:51 πŸ”— JAA Kaz: "The HN post" link?
15:53 πŸ”— markedL there were/are two https://news.ycombinator.com/item?id=21737696
15:55 πŸ”— markedL https://news.ycombinator.com/item?id=21739196
15:55 πŸ”— markedL #21 and #33 at the moment. Was #1 and #2 on Sunday night
15:56 πŸ”— bilboed When an item group fails, does it inform the tracker (to pop it off the list of "out" tasks) ?
15:59 πŸ”— Kaz No (sadly)
15:59 πŸ”— bilboed ouch
15:59 πŸ”— Kaz Though sometimes that’s useful, rather than repeatedly failing the same task
16:00 πŸ”— bilboed or at least report the failure reason
16:00 πŸ”— JAA Thanks
16:02 πŸ”— markedL the youtube grab reports fails due to error to a separate dashboard, so it's getting close
16:38 πŸ”— coderobe has joined #warrior
16:49 πŸ”— phiresky has joined #warrior
17:18 πŸ”— Craigle has joined #warrior
18:15 πŸ”— Medowar has quit IRC (Quit: Connection closed for inactivity)
19:14 πŸ”— bilboed :( Process WgetDownload returned exit code -6 for Item group:awsomegoths
19:14 πŸ”— bilboed afaics from the logs, it had a ton of messages too
19:41 πŸ”— jc86035 has joined #warrior
19:54 πŸ”— DogsRNice has joined #warrior
20:00 πŸ”— pukkie has joined #warrior
20:27 πŸ”— MaximeleG has quit IRC (Quit: MaximeleG)
21:12 πŸ”— Decobus has quit IRC (Read error: Operation timed out)
21:15 πŸ”— pukkie has left
21:16 πŸ”— Decobus has joined #warrior
21:18 πŸ”— Decobus_ has joined #warrior
21:18 πŸ”— Decobus has quit IRC (Read error: Connection reset by peer)
23:27 πŸ”— britm0b has quit IRC (Read error: Connection reset by peer)
23:27 πŸ”— britmob has quit IRC (Read error: Connection reset by peer)
23:31 πŸ”— britmob has joined #warrior
23:58 πŸ”— jc86035 has quit IRC (Quit: Connection closed for inactivity)

irclogger-viewer