#archiveteam 2016-05-25,Wed

↑back Search

Time Nickname Message
00:39 🔗 mismatch has joined #archiveteam
00:55 🔗 ndiddy has quit IRC (Ping timeout: 250 seconds)
01:11 🔗 JesseW has joined #archiveteam
01:17 🔗 acridAxid has quit IRC (marauder)
01:18 🔗 acridAxid has joined #archiveteam
01:52 🔗 schbirid has quit IRC (Ping timeout: 258 seconds)
01:57 🔗 tomwsmf-a has quit IRC (Read error: Operation timed out)
02:05 🔗 schbirid has joined #archiveteam
03:23 🔗 tomwsmf-a has joined #archiveteam
03:36 🔗 dashcloud has quit IRC (Read error: Operation timed out)
03:39 🔗 dashcloud has joined #archiveteam
03:42 🔗 vOYtEC has quit IRC (Read error: Connection reset by peer)
03:43 🔗 vOYtEC has joined #archiveteam
04:08 🔗 SketchCow There is an argument for us grabbing the articles linked from Longform and other "long-journalism" link blogs
04:10 🔗 SketchCow Also, Arlo on FOS (and therefore FOS) is pushed out, that means the machine is back down to 15% or so capacity, good times.
04:10 🔗 SketchCow (It never gets lower than 11%, for various reasons of in-process projects or archivebot or so on)
04:14 🔗 dashcloud has quit IRC (Read error: Operation timed out)
04:15 🔗 balrog has quit IRC (Read error: Operation timed out)
04:15 🔗 balrog has joined #archiveteam
04:15 🔗 swebb sets mode: +o balrog
04:15 🔗 dashcloud has joined #archiveteam
04:31 🔗 Sk1d has quit IRC (Ping timeout: 194 seconds)
04:33 🔗 vitzli has joined #archiveteam
04:37 🔗 Sk1d has joined #archiveteam
05:01 🔗 kris33 has joined #archiveteam
05:21 🔗 dashcloud has quit IRC (Read error: Operation timed out)
05:25 🔗 dashcloud has joined #archiveteam
05:41 🔗 mismatch has quit IRC (Ping timeout: 633 seconds)
06:00 🔗 philpem has quit IRC (Ping timeout: 260 seconds)
06:09 🔗 JesseW has quit IRC (Read error: Operation timed out)
06:13 🔗 Honno_ has joined #archiveteam
06:24 🔗 vitzli has quit IRC (Quit: Leaving)
06:31 🔗 Honno_ has quit IRC (Read error: Operation timed out)
06:47 🔗 tomwsmf-a has quit IRC (Read error: Operation timed out)
07:00 🔗 WinterFox has joined #archiveteam
07:06 🔗 metalcamp has joined #archiveteam
07:08 🔗 DFJustin has quit IRC (Ping timeout: 260 seconds)
07:25 🔗 vOYtEC has quit IRC (ny.us.hub west.us.hub)
07:25 🔗 fie has quit IRC (ny.us.hub west.us.hub)
07:25 🔗 redlob has quit IRC (ny.us.hub west.us.hub)
07:25 🔗 K4k has quit IRC (ny.us.hub west.us.hub)
07:25 🔗 edsu has quit IRC (ny.us.hub west.us.hub)
07:25 🔗 wp494 has quit IRC (ny.us.hub west.us.hub)
07:42 🔗 vOYtEC has joined #archiveteam
07:42 🔗 fie has joined #archiveteam
07:42 🔗 redlob has joined #archiveteam
07:42 🔗 K4k has joined #archiveteam
07:42 🔗 edsu has joined #archiveteam
07:42 🔗 wp494 has joined #archiveteam
07:42 🔗 west.us.hub sets mode: +oo edsu wp494
07:42 🔗 swebb sets mode: +o edsu
08:07 🔗 vOYtEC has quit IRC (ny.us.hub west.us.hub)
08:07 🔗 fie has quit IRC (ny.us.hub west.us.hub)
08:07 🔗 redlob has quit IRC (ny.us.hub west.us.hub)
08:07 🔗 K4k has quit IRC (ny.us.hub west.us.hub)
08:08 🔗 edsu has quit IRC (ny.us.hub west.us.hub)
08:08 🔗 wp494 has quit IRC (ny.us.hub west.us.hub)
08:08 🔗 vOYtEC has joined #archiveteam
08:08 🔗 fie has joined #archiveteam
08:08 🔗 redlob has joined #archiveteam
08:08 🔗 K4k has joined #archiveteam
08:08 🔗 edsu has joined #archiveteam
08:08 🔗 wp494 has joined #archiveteam
08:08 🔗 west.us.hub sets mode: +oo edsu wp494
08:08 🔗 swebb sets mode: +o edsu
08:15 🔗 MMovie1 has quit IRC (Read error: Connection reset by peer)
08:15 🔗 vitzli has joined #archiveteam
08:19 🔗 BartoCH has quit IRC (Ping timeout: 260 seconds)
08:21 🔗 ariscop has quit IRC (Read error: Operation timed out)
08:26 🔗 BartoCH has joined #archiveteam
08:28 🔗 atomotic has joined #archiveteam
08:57 🔗 Coderjoe has quit IRC (Read error: Operation timed out)
09:12 🔗 Coderjoe has joined #archiveteam
09:21 🔗 vitzli has quit IRC (Quit: Leaving)
09:38 🔗 voltagex has joined #archiveteam
09:39 🔗 voltagex hey all, anyone awake?
09:39 🔗 Atluxity indeed
09:39 🔗 Atluxity just finished my lunch actually
09:39 🔗 Atluxity what can I do for you voltagex
09:40 🔗 voltagex I've got $100+ of AWS credit expiring soon and I want to help.
09:40 🔗 voltagex I'm running 2x t2 mediums with TTT right now, but the setup has been tricky and manual so far
09:40 🔗 Atluxity cool
09:41 🔗 Atluxity I dont know how much $100+ aws credit is, in terms of what you get
09:41 🔗 Atluxity but anyway
09:41 🔗 Atluxity you got two options, depending on how involved you wish to be
09:41 🔗 Atluxity you can either run one or more warriors
09:41 🔗 voltagex quite a lot when I can get hours and hours of server time for cents - if you bid on instances that can be turned off at any time
09:42 🔗 Atluxity the pre-packaged archiving vm, container, whatever
09:42 🔗 Atluxity or you can run the pipeline-script for projects directly
09:42 🔗 voltagex I've already raised a bug on https://github.com/ArchiveTeam/arto-grab/issues/2
09:43 🔗 voltagex so what's the priority
09:43 🔗 voltagex arto seemed to be returning more 403s than anything else and it's definitely grabbing a lot of duplicate files
09:43 🔗 Atluxity nice bug, with patch and everything. One of the better patches to that issue
09:44 🔗 Atluxity then you perhaps know about http://tracker.archiveteam.org/
09:44 🔗 Atluxity there is listed all the active grabs we have going on now
09:44 🔗 Atluxity urlteam is always going to need power
09:45 🔗 Atluxity not all grabs are running, as you can probably tell
09:45 🔗 Atluxity there are different reasons for this
09:47 🔗 voltagex ooh ooh wikiteam
09:47 🔗 voltagex I'd still like to get an automated build for URLTeam on EC2 but I won't be able to pay for AMI hosting long term
09:49 🔗 voltagex what I can't work out how much processing power / bandwidth the URLTeam grabber needs
09:58 🔗 ariscop has joined #archiveteam
10:06 🔗 Atluxity it does not need much
10:30 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
10:33 🔗 DFJustin has joined #archiveteam
10:33 🔗 swebb sets mode: +o DFJustin
11:03 🔗 voltagex I got an Ansible playbook to sort of launch the Terror of Tiny Town grabber
11:03 🔗 voltagex it's still too fiddly
11:03 🔗 voltagex I'm now running something silly like 8 EC2 instances
11:05 🔗 BlueMaxim has quit IRC (Quit: Leaving)
11:08 🔗 voltagex 16 soon :D
11:11 🔗 murk better to run them on boxes that are idle anyway.
11:26 🔗 voltagex spot instances are idle EC2 capacity ;)
12:04 🔗 Atluxity voltagex: hope you can be able to publish how you got it to play with ansible. I do not know if we got that noted down anywhere
12:09 🔗 atomotic has joined #archiveteam
12:17 🔗 voltagex yes, but someone will totally shoot themselves in the face/credit card with this (probably me) https://gist.github.com/voltagex/6511a43b75d0eca3224c07cf6d3ec53a
12:19 🔗 voltagex and you'll all bid up my spot instance prices
12:21 🔗 Atluxity :P
12:22 🔗 Atluxity a race for the top
12:22 🔗 * voltagex begins leaderboard climb
12:22 🔗 Atluxity :)
12:22 🔗 Atluxity welcome to the club
12:23 🔗 voltagex thanks
12:23 🔗 voltagex I may delete that gist, I'm really worried someone will run up a huge EC2 bill using it and blame me
12:23 🔗 HCross voltagex, dont say delete to archiveteam
12:24 🔗 HCross DONT
12:24 🔗 voltagex HAHAHA
12:24 🔗 voltagex good point
12:24 🔗 HCross already archivebotted it
12:24 🔗 HCross YOU CANT REMOVE IT NOW
12:25 🔗 kris33_ has joined #archiveteam
12:26 🔗 voltagex :P
12:26 🔗 kris33_ has quit IRC (Textual IRC Client: www.textualapp.com)
12:33 🔗 kris33 has quit IRC (Ping timeout: 506 seconds)
12:36 🔗 voltagex passed YOURNICKHERE
13:00 🔗 WinterFox has quit IRC (Remote host closed the connection)
14:00 🔗 Start has quit IRC (Quit: Disconnected.)
14:01 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
14:06 🔗 tomwsmf-a has joined #archiveteam
14:09 🔗 khaoohs_ has joined #archiveteam
14:19 🔗 MMovie has joined #archiveteam
14:27 🔗 tomwsmf-a has quit IRC (Read error: Operation timed out)
14:52 🔗 atomotic has joined #archiveteam
14:56 🔗 Fletcher has quit IRC (Read error: Operation timed out)
15:03 🔗 Start has joined #archiveteam
15:11 🔗 Fletcher has joined #archiveteam
15:14 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
15:28 🔗 tomwsmf-a has joined #archiveteam
15:35 🔗 JesseW has joined #archiveteam
15:44 🔗 will has joined #archiveteam
15:47 🔗 JesseW has quit IRC (Read error: Operation timed out)
15:54 🔗 Smiley has joined #archiveteam
15:56 🔗 SmileyG has quit IRC (Read error: Operation timed out)
16:07 🔗 Start has quit IRC (Quit: Disconnected.)
16:13 🔗 brayden_ has joined #archiveteam
16:13 🔗 swebb sets mode: +o brayden_
16:18 🔗 vitzli has joined #archiveteam
16:18 🔗 JW_work voltagex: you are working on URLteam? Please do join the #urlteam channel, too.
16:19 🔗 JW_work Also, if you notice the tracker not giving you enough jobs — we can always use help investigating new shorteners (see the URLTeam wiki page)
16:23 🔗 brayden has quit IRC (Ping timeout: 633 seconds)
16:31 🔗 Start has joined #archiveteam
16:58 🔗 philpem has joined #archiveteam
17:13 🔗 Start has quit IRC (Read error: Connection reset by peer)
17:13 🔗 Start has joined #archiveteam
17:29 🔗 VADemon has joined #archiveteam
17:30 🔗 Start has quit IRC (Quit: Disconnected.)
17:35 🔗 Rotab has quit IRC (Ping timeout: 194 seconds)
18:03 🔗 atomotic has joined #archiveteam
18:10 🔗 tomwsmf-a has quit IRC (Ping timeout: 258 seconds)
18:19 🔗 VADemon has quit IRC (Quit: left4dead)
18:24 🔗 BartoCH_ has joined #archiveteam
18:25 🔗 BartoCH has quit IRC (Ping timeout: 260 seconds)
18:26 🔗 Start has joined #archiveteam
18:33 🔗 JW_work has quit IRC (Quit: Leaving.)
18:35 🔗 JW_work has joined #archiveteam
18:37 🔗 JW_work has quit IRC (Client Quit)
18:38 🔗 JW_work has joined #archiveteam
18:39 🔗 JW_work has quit IRC (Client Quit)
18:42 🔗 JW_work has joined #archiveteam
18:47 🔗 JW_work has quit IRC (Read error: Operation timed out)
18:49 🔗 vitzli has quit IRC (Quit: Leaving)
18:59 🔗 atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…)
19:04 🔗 Start has quit IRC (Quit: Disconnected.)
19:14 🔗 atomotic has joined #archiveteam
19:15 🔗 atomotic has quit IRC (Client Quit)
19:18 🔗 Start has joined #archiveteam
19:18 🔗 ndiddy has joined #archiveteam
19:45 🔗 Start has quit IRC (Quit: Disconnected.)
19:47 🔗 JW_work has joined #archiveteam
20:04 🔗 tomwsmf-a has joined #archiveteam
20:32 🔗 tomwsmf-a has quit IRC (Read error: Operation timed out)
20:44 🔗 ariscop has quit IRC (Ping timeout: 506 seconds)
20:54 🔗 tomwsmf-a has joined #archiveteam
20:59 🔗 schbirid has quit IRC (Quit: Leaving)
21:11 🔗 zino Seems the fotolog dump finished uploading to IA. Should start Gamefront, but that will have to wait for a few days.
21:28 🔗 BartoCH_ is now known as BartoCH
21:45 🔗 tomwsmf-a has quit IRC (Read error: Operation timed out)
21:45 🔗 tomwsmf-a has joined #archiveteam
22:00 🔗 ariscop has joined #archiveteam
22:03 🔗 metalcamp has quit IRC (Ping timeout: 244 seconds)
22:15 🔗 arkiver zino: awesome! Thank you so much :D
22:56 🔗 tomwsmf-a has quit IRC (Read error: Operation timed out)
23:12 🔗 Start has joined #archiveteam
23:57 🔗 ndiddy has quit IRC (Read error: Operation timed out)

irclogger-viewer