Time |
Nickname |
Message |
03:49
🔗
|
|
odemg has quit IRC (Read error: Operation timed out) |
04:04
🔗
|
|
odemg has joined #urlteam |
08:32
🔗
|
|
BnAboyZ has quit IRC (Read error: Operation timed out) |
08:41
🔗
|
|
BnAboyZ has joined #urlteam |
13:28
🔗
|
|
Calvin_ has joined #urlteam |
13:28
🔗
|
Calvin_ |
heya web archivists! |
13:29
🔗
|
Calvin_ |
just wanted to jump in to see if any initiatives have been started to see if goo.gl links can start being archived? They announced they're discontinuing goo.gl a few weeks ago. |
13:33
🔗
|
JAA |
Hi Calvin_. Yeah, we're aware of it. We'll archive it next year when no new links will get created anymore. |
13:33
🔗
|
JAA |
(So we don't have to do it twice.) |
13:34
🔗
|
Calvin_ |
@JAA, good point. Any idea how goo.gl links will be archived? same scraping tools as for bit.ly and other shorteners? |
13:34
🔗
|
Calvin_ |
good to hear you are on top of things <£ |
13:34
🔗
|
Calvin_ |
<3* |
13:34
🔗
|
JAA |
I haven't looked into it at all yet, but yeah, we'll use this project for it. |
13:36
🔗
|
Calvin_ |
awesome! I'd love to contribute to that archiving project when it rolls around. |
13:36
🔗
|
JAA |
Run a warrior (or the scripts directly) on URLTeam, and you will. :-) |
13:39
🔗
|
Calvin_ |
Will do! I'm setting up an old desktop to act as a script running machine, that should be up and running in a few weeks. I'm planning on getting a warrior on it once it's up ;) |
13:39
🔗
|
JAA |
Sweet! |
13:40
🔗
|
Calvin_ |
Do you actually have any recommendations of what OS to use on hardware with that purpose? I was thinking of just getting Linux installed on it, but maybe some server software might be better if my goal is to run it 24/7? Like FreeNAS or something similar, although I don't really know how you can then run scripts on that. |
13:40
🔗
|
JAA |
I'm a fan of Debian, but yeah, any decent Linux-based system will work perfectly. |
13:41
🔗
|
Calvin_ |
interesting! and you run that 24/7? |
13:41
🔗
|
JAA |
Sure |
13:41
🔗
|
JAA |
The main userbase of Debian are servers which run continuously for weeks to years. :-) |
13:42
🔗
|
Calvin_ |
awesome. I'll look into Debian! |
13:43
🔗
|
JAA |
You may want to run it without a graphical interface though. Or at least not Gnome or a derivative. |
13:43
🔗
|
JAA |
Gnome has a lot of bugs and memory leaks and whatnot, so it's not too stable in the long term in my experience. |
13:44
🔗
|
JAA |
And yeah, if you use a Linux-based OS, you can just run the scripts directly rather than using the warrior VM. |
13:45
🔗
|
Calvin_ |
gotcha, good tips |
13:45
🔗
|
JAA |
It's a bit more work since you have to set up new projects manually, but it takes a lot less resources and can run multiple projects in parallel (without running multiple VMs, which eats even more resources). |
13:46
🔗
|
Calvin_ |
running multiple projects sounds like a good idea. |
13:46
🔗
|
Calvin_ |
Are you saying I could just get a warrior on a Windows-based system and have that run continuously as well? |
13:46
🔗
|
JAA |
Yeah, I guess so. |
13:47
🔗
|
Calvin_ |
haha don't worry, that won't happen, just interesting that that works as well |
13:47
🔗
|
JAA |
Yeah, the warrior VM is just a Debian-based VM which runs the project code, essentially. |
13:47
🔗
|
Calvin_ |
cool, thanks for the tips! I'll get back to this space when I have my hardware up and running. I'll probably have a bunch more questions then. |
13:48
🔗
|
JAA |
Cheers. Check out #archiveteam-bs and #warrior as well. The former for general discussion on ArchiveTeam, the latter for warrior-related stuff. |
13:48
🔗
|
Calvin_ |
I see, it's indeed much more logical to just install Debian instead of installing another OS and then getting a VM to run in that. |
13:48
🔗
|
JAA |
And #archiveteam, which is our announcement channel. |
13:48
🔗
|
Calvin_ |
Will do! Leave a comment at https://www.wikidata.org/wiki/User:CalvinBall if you want to get to me when I'm not in IRC :D |
13:49
🔗
|
Calvin_ |
0/ |
13:49
🔗
|
JAA |
Noted. Cya |
13:49
🔗
|
|
Calvin_ has quit IRC (Quit: Page closed) |
18:27
🔗
|
|
Somebody2 has quit IRC (Read error: Operation timed out) |
21:26
🔗
|
|
dashcloud has joined #urlteam |
21:45
🔗
|
|
Aerochrom has quit IRC (Read error: Connection reset by peer) |
23:19
🔗
|
|
Kaz has quit IRC (Ping timeout: 260 seconds) |
23:23
🔗
|
|
Kaz has joined #urlteam |
23:23
🔗
|
|
Kaz has quit IRC (Excess Flood) |
23:24
🔗
|
|
Kaz has joined #urlteam |