| Time |
Nickname |
Message |
|
01:27
🔗
|
|
Dj-Wawa has quit IRC (Quit: Connection closed for inactivity) |
|
02:17
🔗
|
agris |
How can I increase the concurrency on my warrior beyond 6? |
|
02:18
🔗
|
agris |
I've allocated 100 megabits to it and it's only using 1 megabit |
|
02:19
🔗
|
agris |
it's also on a carrier grade fiber internet connection. It can handle way more TCP sessions than it's currently using |
|
02:19
🔗
|
agris |
Is there an easier way then modifying the warrior's code to increase the concurrency? |
|
03:08
🔗
|
Kaz |
more warriors |
|
03:08
🔗
|
Kaz |
or just run the scripts manually |
|
03:24
🔗
|
|
fennec has quit IRC (Quit: %quiet%) |
|
03:28
🔗
|
|
fennec has joined #warrior |
|
04:23
🔗
|
t3 |
agris: Use scripts. |
|
04:30
🔗
|
agris |
whoever wrote the tumblr projects scripts, you should take into account the default ram for warriors is only 2G |
|
04:42
🔗
|
agris |
nvm it's just line 212 in warrior.py |
|
06:25
🔗
|
|
Flashfire has joined #warrior |
|
06:25
🔗
|
|
Ryz has joined #warrior |
|
06:26
🔗
|
Ryz |
Heya, I have an ArchiveWarrior idea - Writing.com - https://www.writing.com/main/ ; |
|
06:27
🔗
|
Ryz |
Past 2-3 years, browsing content (mainly interactive stories) is restricted notably, coughing up these "Due to resource limitations, Interactive Stories are temporarily unavailable to guest visitors." messages even though the server is still up |
|
06:28
🔗
|
Ryz |
Website's been up since 2000, and recently from the last time I checked, the main page https://www.writing.com/ doesn't truly show what usermade contents are offered to cut down the amount of people checking out the content |
|
06:29
🔗
|
Ryz |
For proper archiving to happen, ArchiveWarrior bots needs to have a free account to make those 'resource limitations' messages go away, but I'm not sure if they truly go away even with using a free account |
|
06:30
🔗
|
Ryz |
Currently, "1,373,353 members and 2,078,122 literary items" to archive, there's probably a forum too |
|
06:32
🔗
|
|
Fusl has joined #warrior |
|
08:09
🔗
|
|
Ryz has quit IRC (Remote host closed the connection) |
|
08:25
🔗
|
|
revi has joined #warrior |
|
08:40
🔗
|
|
ivan` is now known as ivan_ |
|
09:03
🔗
|
astrid |
hmmmm |
|
09:03
🔗
|
astrid |
that sounds like a worthwhile project |
|
09:06
🔗
|
nikow |
yeah, sounds like fun |
|
09:06
🔗
|
nikow |
We had similar site in Poland… it dissapeared without a warning. |
|
09:56
🔗
|
agris |
the pole people |
|
10:11
🔗
|
|
adinbied has quit IRC (Read error: Connection reset by peer) |
|
10:13
🔗
|
|
adinbied has joined #warrior |
|
11:21
🔗
|
|
Dj-Wawa has joined #warrior |
|
14:20
🔗
|
JAA |
For the record, we had an ArchiveBot job for writing.com. Not sure how complete that grab is though. |
|
17:06
🔗
|
kiska |
Alright I'll see about writing.com when I get home |
|
18:03
🔗
|
|
mtntmnky has quit IRC (Remote host closed the connection) |
|
18:04
🔗
|
|
mtntmnky has joined #warrior |
|
18:12
🔗
|
|
noora has quit IRC (Ping timeout: 268 seconds) |
|
18:18
🔗
|
|
noora has joined #warrior |
|
18:31
🔗
|
|
Ryz has joined #warrior |
|
18:32
🔗
|
|
tomaspark has joined #warrior |
|
18:43
🔗
|
Ryz |
Reading the logs, it appears Writing.com is accepted and will be worked on soon, hooray o: |
|
18:45
🔗
|
Ryz |
Probably scrape a bunch of results from search engines incase the website's contents has dead-end stems when it's being archived |
|
20:12
🔗
|
|
Odd0002 has quit IRC (Ping timeout: 1212 seconds) |
|
21:27
🔗
|
|
JL421 has joined #warrior |
|
21:40
🔗
|
|
bithippo has joined #warrior |
|
21:46
🔗
|
|
bithippo has quit IRC (Textual IRC Client: www.textualapp.com) |