| Time |
Nickname |
Message |
|
00:02
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
|
00:06
🔗
|
|
BlueMax has joined #archiveteam-ot |
|
03:34
🔗
|
|
odemg has quit IRC (Ping timeout: 615 seconds) |
|
03:40
🔗
|
|
odemg has joined #archiveteam-ot |
|
04:09
🔗
|
|
dhyan_nat has joined #archiveteam-ot |
|
05:53
🔗
|
|
svchfoo1 has left |
|
05:53
🔗
|
|
deevious has joined #archiveteam-ot |
|
06:09
🔗
|
|
BnAboyZ has quit IRC (Read error: Operation timed out) |
|
06:11
🔗
|
|
legoktm has quit IRC (Ping timeout: 268 seconds) |
|
06:11
🔗
|
|
VoynichCr has quit IRC (Ping timeout: 268 seconds) |
|
06:11
🔗
|
|
VoynichCr has joined #archiveteam-ot |
|
06:14
🔗
|
|
noirscape has quit IRC (Ping timeout: 268 seconds) |
|
06:14
🔗
|
|
BnAboyZ has joined #archiveteam-ot |
|
06:15
🔗
|
|
dhyan_nat has quit IRC (Ping timeout: 268 seconds) |
|
06:15
🔗
|
|
legoktm has joined #archiveteam-ot |
|
06:16
🔗
|
|
VoynichCr has quit IRC (Ping timeout: 268 seconds) |
|
06:16
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 268 seconds) |
|
06:16
🔗
|
|
Mateon1 has joined #archiveteam-ot |
|
06:17
🔗
|
|
asie has quit IRC (Ping timeout: 268 seconds) |
|
06:17
🔗
|
|
VoynichCr has joined #archiveteam-ot |
|
06:19
🔗
|
|
BnAboyZ has quit IRC (Ping timeout: 268 seconds) |
|
06:19
🔗
|
|
Ravenloft has quit IRC (Read error: Connection reset by peer) |
|
06:19
🔗
|
|
BlueMaxim has joined #archiveteam-ot |
|
06:20
🔗
|
|
BlueMax has quit IRC (Read error: Connection reset by peer) |
|
06:21
🔗
|
|
noirscape has joined #archiveteam-ot |
|
06:21
🔗
|
|
dashcloud has quit IRC (Ping timeout: 268 seconds) |
|
06:22
🔗
|
|
dashcloud has joined #archiveteam-ot |
|
06:22
🔗
|
|
asie has joined #archiveteam-ot |
|
06:22
🔗
|
|
BnAboyZ has joined #archiveteam-ot |
|
06:23
🔗
|
|
dhyan_nat has joined #archiveteam-ot |
|
06:31
🔗
|
|
dhyan_nat has quit IRC (Read error: Operation timed out) |
|
07:04
🔗
|
|
ColdIce has quit IRC (Remote host closed the connection) |
|
07:04
🔗
|
|
ColdIce has joined #archiveteam-ot |
|
07:04
🔗
|
|
Madbrad has joined #archiveteam-ot |
|
07:28
🔗
|
|
Madbrad has quit IRC (Ping timeout: 615 seconds) |
|
08:11
🔗
|
|
Zerote has joined #archiveteam-ot |
|
09:02
🔗
|
JAA |
VoynichCr: Sorting seems to work correctly now, thanks. :-) |
|
09:15
🔗
|
VoynichCr |
\o/ |
|
09:20
🔗
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
|
09:26
🔗
|
|
deevious has quit IRC (Quit: deevious) |
|
09:40
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
09:50
🔗
|
|
Verified_ has joined #archiveteam-ot |
|
10:17
🔗
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
|
10:24
🔗
|
|
Verified_ has joined #archiveteam-ot |
|
10:47
🔗
|
|
deevious has joined #archiveteam-ot |
|
12:08
🔗
|
|
icedice has joined #archiveteam-ot |
|
12:11
🔗
|
|
icedice has quit IRC (Client Quit) |
|
12:31
🔗
|
|
dhyan_nat has joined #archiveteam-ot |
|
12:55
🔗
|
|
icedice has joined #archiveteam-ot |
|
13:03
🔗
|
VoynichCr |
Wiki pages by country help to keep a log of small projects: |
|
13:04
🔗
|
VoynichCr |
- Brazil https://www.archiveteam.org/index.php?title=Brazil |
|
13:04
🔗
|
VoynichCr |
- Sri Lanka https://www.archiveteam.org/index.php?title=Sri_Lanka |
|
13:04
🔗
|
VoynichCr |
- Venezuela https://www.archiveteam.org/index.php?title=Venezuela |
|
13:11
🔗
|
|
icedice has quit IRC (Remote host closed the connection) |
|
13:13
🔗
|
|
icedice has joined #archiveteam-ot |
|
13:16
🔗
|
|
katocala has joined #archiveteam-ot |
|
13:31
🔗
|
|
Oddly has joined #archiveteam-ot |
|
13:46
🔗
|
|
icedice2 has joined #archiveteam-ot |
|
13:50
🔗
|
|
icedice has quit IRC (Ping timeout: 252 seconds) |
|
14:01
🔗
|
|
icedice2 has quit IRC (Read error: Connection reset by peer) |
|
14:01
🔗
|
|
icedice2 has joined #archiveteam-ot |
|
14:05
🔗
|
|
Oddly has quit IRC (Remote host closed the connection) |
|
14:05
🔗
|
|
icedice has joined #archiveteam-ot |
|
14:06
🔗
|
|
icedice has quit IRC (Remote host closed the connection) |
|
14:07
🔗
|
|
Oddly has joined #archiveteam-ot |
|
14:09
🔗
|
|
Oddly has quit IRC (Remote host closed the connection) |
|
14:13
🔗
|
|
Zerote has quit IRC (Ping timeout: 260 seconds) |
|
14:14
🔗
|
|
icedice2 has quit IRC (Read error: Operation timed out) |
|
14:43
🔗
|
|
Zerote has joined #archiveteam-ot |
|
15:21
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
|
15:22
🔗
|
|
cfarquhar has joined #archiveteam-ot |
|
16:45
🔗
|
|
Zerote has quit IRC (Ping timeout: 261 seconds) |
|
17:06
🔗
|
|
godane has quit IRC (Quit: Leaving.) |
|
17:30
🔗
|
|
schbirid has quit IRC (Remote host closed the connection) |
|
17:54
🔗
|
|
chferfa has quit IRC (Quit: Connection closed for inactivity) |
|
18:04
🔗
|
JAA |
Trying to get my highly parallelised archival tool that I've been talking about so many times into shape now. (For the unaware, that's the code I used to retrieve Storify (~100 million URLs), Outpost (same), AMO (~50 million), and others within just a few days from a single machine.) |
|
18:05
🔗
|
JAA |
I still don't have a good name, but I'm thinking of epat or epwat right now, short for "embarassingly parallel (web) archival tool". |
|
18:05
🔗
|
JAA |
Any thoughts? |
|
18:10
🔗
|
VoynichCr |
its a good name |
|
18:14
🔗
|
ivan |
fastcrawl |
|
18:15
🔗
|
JAA |
ivan: It's not a crawler though, just a framework for managing work items and making requests/writing them to WARC. There is no recursion or link extraction whatsoever in it. |
|
18:17
🔗
|
ivan |
qwarc |
|
18:17
🔗
|
Fusl |
fark |
|
18:18
🔗
|
|
Stiletto has joined #archiveteam-ot |
|
18:18
🔗
|
Fusl |
fark archiver ¯\_(ツ)_/¯ |
|
18:18
🔗
|
Fusl |
fast* |
|
18:18
🔗
|
Fusl |
hell what do i know i'm bad with naming projects lol |
|
18:18
🔗
|
|
Stiletto has quit IRC (Client Quit) |
|
18:18
🔗
|
|
Stiletto has joined #archiveteam-ot |
|
18:25
🔗
|
JAA |
I like qwarc because it sounds like quark and I like modern physics. I also like fark because that's what you'll probably say when you realise just how large the site you're trying to archive is. |
|
18:28
🔗
|
JAA |
fark's not exactly unique though. Unsurprisingly, there are several projects on GitHub with that name already. |
|
18:29
🔗
|
astrid |
casting a vote for qwarc |
|
18:30
🔗
|
astrid |
it's also fairly unique on google, which is impressive for five characters that are pronounceable |
|
18:30
🔗
|
JAA |
Yeah indeed. |
|
18:31
🔗
|
ivan |
#archiveteam-branding |
|
18:31
🔗
|
JAA |
Haha |
|
18:33
🔗
|
|
JAA sets mode: +oo astrid ivan |
|
18:37
🔗
|
kiska |
I fully expect this channel to be a thing |
|
18:43
🔗
|
astrid |
i don't ... |
|
20:04
🔗
|
marked |
does it do useful things for people who aren't targeting .warc output? |
|
20:07
🔗
|
JAA |
Nope, because creating WARCs is literally what I wrote it for, and 90 % of the code complexity comes from that. |
|
20:13
🔗
|
|
tuluu has quit IRC (Ping timeout: 265 seconds) |
|
20:16
🔗
|
marked |
qwarc is appropriate then, and cute |
|
20:17
🔗
|
marked |
it might end up referred to as JAA's archival tool, if you don't end up naming it |
|
20:18
🔗
|
|
dhyan_nat has quit IRC (Read error: Operation timed out) |
|
20:18
🔗
|
kiska |
*sigh* Lots of election propaganda, and its 1 month from the federal election(in Australia) |
|
20:19
🔗
|
kiska |
I guess this is why they call it a campaign trail, it leaves ads EVERYWHERE |
|
20:20
🔗
|
marked |
the US is 1.5 years away |
|
20:20
🔗
|
JAA |
Yes, I'm using qwarc. Sorry, thought I had mentioned that earlier. Thanks for the suggestion, ivan. (Also, after naming both snscrape and qwarc, you know I'll ping you whenever I need a name now. :-) ) |
|
20:22
🔗
|
JAA |
kiska: Yeah, look at https://en.wikipedia.org/wiki/2019_national_electoral_calendar . There are so many more elections to do... :-/ |
|
20:23
🔗
|
* |
kiska bashes head against wall |
|
20:24
🔗
|
marked |
more dictatorships would simplify this |
|
20:25
🔗
|
kiska |
Isn't the campaign trail for the US started?4 |
|
20:25
🔗
|
kiska |
Also you guys don't have mandatory voting we do. And the fine for not voting is $150 and it grows exponentially |
|
20:26
🔗
|
kiska |
I guess thats revenue for the government xD |
|
20:28
🔗
|
JAA |
Of course it is. Trump started his reelection campaign pretty much the moment he took office I believe, and various Democrats have announced their candidacy already as well. |
|
21:00
🔗
|
|
Kaz has quit IRC (Ping timeout: 265 seconds) |
|
21:01
🔗
|
|
revi has quit IRC (Read error: Connection reset by peer) |
|
21:04
🔗
|
|
Medowar has quit IRC (Ping timeout: 615 seconds) |
|
21:07
🔗
|
|
Kaz has joined #archiveteam-ot |
|
21:08
🔗
|
|
Medowar has joined #archiveteam-ot |
|
21:09
🔗
|
|
revi has joined #archiveteam-ot |
|
21:23
🔗
|
|
marked has quit IRC (Read error: Operation timed out) |
|
22:55
🔗
|
|
BlueMax has joined #archiveteam-ot |