#urlteam 2018-04-18,Wed

↑back Search

Time Nickname Message
03:49 🔗 odemg has quit IRC (Read error: Operation timed out)
04:04 🔗 odemg has joined #urlteam
08:32 🔗 BnAboyZ has quit IRC (Read error: Operation timed out)
08:41 🔗 BnAboyZ has joined #urlteam
13:28 🔗 Calvin_ has joined #urlteam
13:28 🔗 Calvin_ heya web archivists!
13:29 🔗 Calvin_ just wanted to jump in to see if any initiatives have been started to see if goo.gl links can start being archived? They announced they're discontinuing goo.gl a few weeks ago.
13:33 🔗 JAA Hi Calvin_. Yeah, we're aware of it. We'll archive it next year when no new links will get created anymore.
13:33 🔗 JAA (So we don't have to do it twice.)
13:34 🔗 Calvin_ @JAA, good point. Any idea how goo.gl links will be archived? same scraping tools as for bit.ly and other shorteners?
13:34 🔗 Calvin_ good to hear you are on top of things <£
13:34 🔗 Calvin_ <3*
13:34 🔗 JAA I haven't looked into it at all yet, but yeah, we'll use this project for it.
13:36 🔗 Calvin_ awesome! I'd love to contribute to that archiving project when it rolls around.
13:36 🔗 JAA Run a warrior (or the scripts directly) on URLTeam, and you will. :-)
13:39 🔗 Calvin_ Will do! I'm setting up an old desktop to act as a script running machine, that should be up and running in a few weeks. I'm planning on getting a warrior on it once it's up ;)
13:39 🔗 JAA Sweet!
13:40 🔗 Calvin_ Do you actually have any recommendations of what OS to use on hardware with that purpose? I was thinking of just getting Linux installed on it, but maybe some server software might be better if my goal is to run it 24/7? Like FreeNAS or something similar, although I don't really know how you can then run scripts on that.
13:40 🔗 JAA I'm a fan of Debian, but yeah, any decent Linux-based system will work perfectly.
13:41 🔗 Calvin_ interesting! and you run that 24/7?
13:41 🔗 JAA Sure
13:41 🔗 JAA The main userbase of Debian are servers which run continuously for weeks to years. :-)
13:42 🔗 Calvin_ awesome. I'll look into Debian!
13:43 🔗 JAA You may want to run it without a graphical interface though. Or at least not Gnome or a derivative.
13:43 🔗 JAA Gnome has a lot of bugs and memory leaks and whatnot, so it's not too stable in the long term in my experience.
13:44 🔗 JAA And yeah, if you use a Linux-based OS, you can just run the scripts directly rather than using the warrior VM.
13:45 🔗 Calvin_ gotcha, good tips
13:45 🔗 JAA It's a bit more work since you have to set up new projects manually, but it takes a lot less resources and can run multiple projects in parallel (without running multiple VMs, which eats even more resources).
13:46 🔗 Calvin_ running multiple projects sounds like a good idea.
13:46 🔗 Calvin_ Are you saying I could just get a warrior on a Windows-based system and have that run continuously as well?
13:46 🔗 JAA Yeah, I guess so.
13:47 🔗 Calvin_ haha don't worry, that won't happen, just interesting that that works as well
13:47 🔗 JAA Yeah, the warrior VM is just a Debian-based VM which runs the project code, essentially.
13:47 🔗 Calvin_ cool, thanks for the tips! I'll get back to this space when I have my hardware up and running. I'll probably have a bunch more questions then.
13:48 🔗 JAA Cheers. Check out #archiveteam-bs and #warrior as well. The former for general discussion on ArchiveTeam, the latter for warrior-related stuff.
13:48 🔗 Calvin_ I see, it's indeed much more logical to just install Debian instead of installing another OS and then getting a VM to run in that.
13:48 🔗 JAA And #archiveteam, which is our announcement channel.
13:48 🔗 Calvin_ Will do! Leave a comment at https://www.wikidata.org/wiki/User:CalvinBall if you want to get to me when I'm not in IRC :D
13:49 🔗 Calvin_ 0/
13:49 🔗 JAA Noted. Cya
13:49 🔗 Calvin_ has quit IRC (Quit: Page closed)
18:27 🔗 Somebody2 has quit IRC (Read error: Operation timed out)
21:26 🔗 dashcloud has joined #urlteam
21:45 🔗 Aerochrom has quit IRC (Read error: Connection reset by peer)
23:19 🔗 Kaz has quit IRC (Ping timeout: 260 seconds)
23:23 🔗 Kaz has joined #urlteam
23:23 🔗 Kaz has quit IRC (Excess Flood)
23:24 🔗 Kaz has joined #urlteam

irclogger-viewer