| Time |
Nickname |
Message |
|
02:41
🔗
|
|
Fletcher has joined #urlteam |
|
04:19
🔗
|
|
odemg has quit IRC (Ping timeout: 615 seconds) |
|
04:26
🔗
|
|
odemg has joined #urlteam |
|
05:00
🔗
|
|
treora_ has quit IRC (Remote host closed the connection) |
|
05:01
🔗
|
|
treora has joined #urlteam |
|
09:30
🔗
|
|
LFlare has quit IRC (Quit: Ping timeout (120 seconds)) |
|
09:31
🔗
|
|
LFlare has joined #urlteam |
|
14:19
🔗
|
|
Mayonaise has joined #urlteam |
|
16:42
🔗
|
|
zhongfu_ has joined #urlteam |
|
16:44
🔗
|
|
zhongfu has quit IRC (Read error: Connection reset by peer) |
|
18:49
🔗
|
|
kiska1 has quit IRC (Ping timeout (120 seconds)) |
|
18:50
🔗
|
|
kiska1 has joined #urlteam |
|
18:56
🔗
|
|
kiska1 has quit IRC (Ping timeout (120 seconds)) |
|
19:02
🔗
|
Somebody2 |
Yep. The solution is for people to suggest specific shorterners to be turned on. |
|
19:04
🔗
|
|
kiska1 has joined #urlteam |
|
19:28
🔗
|
|
evul has joined #urlteam |
|
19:28
🔗
|
t3 |
evul: I'm sorry for pushing you around. |
|
19:29
🔗
|
evul |
its fine, just trying to understand what is and is not working... |
|
19:31
🔗
|
t3 |
evul: In summary, the limitation is that only a few URL shorteners are active, and the queue sizes for them are small to prevent getting banned or overloading the servers. |
|
19:33
🔗
|
t3 |
The tracker also stalls for some reason. |
|
19:34
🔗
|
t3 |
But I don't think it is currently stalling. |
|
19:53
🔗
|
evul |
t3 File "scraper.py", line 8, in <module> |
|
19:55
🔗
|
t3 |
evul: Uh... So I'm guessing it didn't work? |
|
19:55
🔗
|
evul |
Not quite. |
|
19:56
🔗
|
evul |
The path its looking for to import doesn't exist |
|
19:56
🔗
|
evul |
the "terroroftinytown" folder is blank? |
|
19:56
🔗
|
t3 |
Do you happen to have Python 3? |
|
19:57
🔗
|
t3 |
Delete the repo and use `git clone --recurse-submodules https://github.com/ArchiveTeam/terroroftinytown-client-grab.git`. |
|
19:57
🔗
|
evul |
I have both 2.7 and 3.7 |
|
19:58
🔗
|
evul |
ok |
|
19:58
🔗
|
evul |
Now i'm getting the same as before. |
|
19:58
🔗
|
evul |
So how do I work on projects now? |
|
19:59
🔗
|
evul |
same as before, as in the "Error communicating with tracker: 512 Server Error: EXPORTING OUR SHIT for url: http://tracker.archiveteam.org:1337/api/get." which is what I was getting in the warrior. |
|
19:59
🔗
|
t3 |
evul: Oh. That's normal. |
|
19:59
🔗
|
t3 |
That means the Tracker server is exporting stuff, and so it is temporarily stalled. |
|
20:00
🔗
|
evul |
I was under the impression there was stuff I could work on through this script lol. |
|
20:01
🔗
|
t3 |
evul: I'm sorry if I didn't make it clear. That message is normal and it is because of the URLTeam tracker server, not your setup. |
|
20:01
🔗
|
evul |
How do people archive the tasks in the NewsGrabber list? |
|
20:01
🔗
|
t3 |
However, the Python scripts are more lightweight. |
|
20:01
🔗
|
t3 |
Hmm... |
|
20:02
🔗
|
evul |
I mean, yeah because you don't have to dedicate resources, but that wasn't the issue ;P |
|
20:03
🔗
|
t3 |
So I tried to get the NewsGrabber project running a while ago, but because I am using macOS, I wasn't able to make it work. However, the setup should be very similar to this URLTeam project. |
|
20:03
🔗
|
t3 |
evul: Join #newsgrabber. |
|
20:03
🔗
|
evul |
What is so different that it doesn't work? |
|
20:03
🔗
|
evul |
I'm also on osx |
|
20:04
🔗
|
mr_archiv |
exit |
|
20:04
🔗
|
|
Hani has quit IRC (Read error: Operation timed out) |
|
20:04
🔗
|
mr_archiv |
Woops sorry, I was trying to close my IRC client, ignore that. |
|
20:05
🔗
|
|
mr_archiv has quit IRC (WeeChat 1.6) |
|
20:07
🔗
|
|
mr_archiv has joined #urlteam |
|
20:42
🔗
|
|
Hani has joined #urlteam |
|
22:03
🔗
|
|
LFlare has quit IRC (west.us.hub irc.mzima.net) |
|
22:03
🔗
|
|
SmileyG has quit IRC (west.us.hub irc.mzima.net) |
|
22:03
🔗
|
|
Fusl has quit IRC (west.us.hub irc.mzima.net) |
|
22:03
🔗
|
|
svchfoo3 has quit IRC (west.us.hub irc.mzima.net) |
|
22:07
🔗
|
|
LFlare has joined #urlteam |
|
22:07
🔗
|
|
SmileyG has joined #urlteam |
|
22:07
🔗
|
|
Fusl has joined #urlteam |
|
22:07
🔗
|
|
svchfoo3 has joined #urlteam |
|
22:07
🔗
|
|
irc.mzima.net sets mode: +o svchfoo3 |
|
22:15
🔗
|
JAA |
t3, evul: Re #warrior: Just for the sake of completeness, the "EXPORTING OUR SHIT" error has nothing to do with too few shorteners; it's when the tracker has to export the results into text files for upload to IA. There's no way to do that while results are being generated currently apparently, so everything stops while that happens. |
|
22:16
🔗
|
JAA |
That's probably something we need to keep in mind for the future also. If we do add more shorteners, the export will be running more frequently, blocking all progress for a longer time. |
|
22:17
🔗
|
JAA |
If that becomes too much of a time sink, we might need to make changes to the tracker so it can export the data without having to pause everything. |
|
22:49
🔗
|
|
Flashfire has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
z00nx has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
kiska has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
zhongfu_ has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
odemg has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Jens has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
phuz has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
arkiver has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Jusque has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
t3 has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
gandalf has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
hook54321 has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
jornane has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
horkermon has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Fusl_ has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
chr1sm has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
HCross has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
pnJay has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
diggan has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
JSharp has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
bakJAA has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Ctrl-S_ has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
deathy has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
kpcyrd has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Hecatz has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Muad-Dib has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Kagee has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
LFlare has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
SmileyG has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Fusl has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
svchfoo3 has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Fletcher has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Hani has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
treora has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Frogging has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
jodizzle has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
N4Y has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
MrRadar2 has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
BnAboyZ has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
ivan has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
joepie91 has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
JAA has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
svchfoo1 has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
hiiva has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
mr_archiv has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
evul has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
MrRadar has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
swebb has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
covesthur has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
chfoo has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Somebody2 has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Cameron_D has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Soulflare has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
kiska1 has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Mayonaise has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
yano has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
mtntmnky has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
TigerbotH has quit IRC (efnet.portlane.se se.hub) |
|
22:49
🔗
|
|
Boppen has quit IRC (efnet.portlane.se se.hub) |
|
22:50
🔗
|
|
svchfoo3 has joined #urlteam |
|
22:50
🔗
|
|
Fusl has joined #urlteam |
|
22:50
🔗
|
|
SmileyG has joined #urlteam |
|
22:50
🔗
|
|
LFlare has joined #urlteam |
|
22:50
🔗
|
|
Hani has joined #urlteam |
|
22:50
🔗
|
|
mr_archiv has joined #urlteam |
|
22:50
🔗
|
|
evul has joined #urlteam |
|
22:50
🔗
|
|
kiska1 has joined #urlteam |
|
22:50
🔗
|
|
zhongfu_ has joined #urlteam |
|
22:50
🔗
|
|
Mayonaise has joined #urlteam |
|
22:50
🔗
|
|
treora has joined #urlteam |
|
22:50
🔗
|
|
odemg has joined #urlteam |
|
22:50
🔗
|
|
Fletcher has joined #urlteam |
|
22:50
🔗
|
|
Flashfire has joined #urlteam |
|
22:50
🔗
|
|
kiska has joined #urlteam |
|
22:50
🔗
|
|
z00nx has joined #urlteam |
|
22:50
🔗
|
|
Jens has joined #urlteam |
|
22:50
🔗
|
|
Kagee has joined #urlteam |
|
22:50
🔗
|
|
Muad-Dib has joined #urlteam |
|
22:50
🔗
|
|
Hecatz has joined #urlteam |
|
22:50
🔗
|
|
kpcyrd has joined #urlteam |
|
22:50
🔗
|
|
deathy has joined #urlteam |
|
22:50
🔗
|
|
Ctrl-S_ has joined #urlteam |
|
22:50
🔗
|
|
bakJAA has joined #urlteam |
|
22:50
🔗
|
|
HCross has joined #urlteam |
|
22:50
🔗
|
|
se.hub sets mode: +oooo svchfoo3 Flashfire bakJAA HCross |
|
22:50
🔗
|
|
chr1sm has joined #urlteam |
|
22:50
🔗
|
|
diggan has joined #urlteam |
|
22:50
🔗
|
|
pnJay has joined #urlteam |
|
22:50
🔗
|
|
JSharp has joined #urlteam |
|
22:50
🔗
|
|
Fusl_ has joined #urlteam |
|
22:50
🔗
|
|
horkermon has joined #urlteam |
|
22:50
🔗
|
|
jornane has joined #urlteam |
|
22:50
🔗
|
|
hook54321 has joined #urlteam |
|
22:50
🔗
|
|
gandalf has joined #urlteam |
|
22:50
🔗
|
|
t3 has joined #urlteam |
|
22:50
🔗
|
|
Jusque has joined #urlteam |
|
22:50
🔗
|
|
arkiver has joined #urlteam |
|
22:50
🔗
|
|
phuz has joined #urlteam |
|
22:50
🔗
|
|
yano has joined #urlteam |
|
22:50
🔗
|
|
hiiva has joined #urlteam |
|
22:50
🔗
|
|
mtntmnky has joined #urlteam |
|
22:50
🔗
|
|
TigerbotH has joined #urlteam |
|
22:50
🔗
|
|
BnAboyZ has joined #urlteam |
|
22:50
🔗
|
|
MrRadar2 has joined #urlteam |
|
22:50
🔗
|
|
N4Y has joined #urlteam |
|
22:50
🔗
|
|
jodizzle has joined #urlteam |
|
22:50
🔗
|
|
se.hub sets mode: +oo hook54321 arkiver |
|
22:50
🔗
|
|
Frogging has joined #urlteam |
|
22:50
🔗
|
|
ivan has joined #urlteam |
|
22:50
🔗
|
|
joepie91 has joined #urlteam |
|
22:50
🔗
|
|
JAA has joined #urlteam |
|
22:50
🔗
|
|
MrRadar has joined #urlteam |
|
22:50
🔗
|
|
Boppen has joined #urlteam |
|
22:50
🔗
|
|
Somebody2 has joined #urlteam |
|
22:50
🔗
|
|
Soulflare has joined #urlteam |
|
22:50
🔗
|
|
Cameron_D has joined #urlteam |
|
22:50
🔗
|
|
chfoo has joined #urlteam |
|
22:50
🔗
|
|
se.hub sets mode: +oooo ivan JAA Somebody2 chfoo |
|
22:50
🔗
|
|
covesthur has joined #urlteam |
|
22:50
🔗
|
|
swebb has joined #urlteam |
|
22:50
🔗
|
|
svchfoo1 has joined #urlteam |
|
22:50
🔗
|
|
se.hub sets mode: +o svchfoo1 |