#archiveteam-bs 2018-01-11,Thu

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***REiN^ has joined #archiveteam-bs [00:08]
..... (idle for 20mn)
godane has quit IRC (Quit: Leaving.) [00:28]
BartoCH has joined #archiveteam-bs [00:35]
...... (idle for 25mn)
Ravenloft has joined #archiveteam-bs [01:00]
........ (idle for 35mn)
Asparagir has quit IRC (Asparagir) [01:35]
...... (idle for 25mn)
BlueMaxim has quit IRC (Leaving)
octothorp has quit IRC (Read error: Connection reset by peer)
[02:00]
BlueMaxim has joined #archiveteam-bs [02:14]
godane has joined #archiveteam-bs [02:25]
.................. (idle for 1h28mn)
AeonG__ has quit IRC (Ping timeout: 633 seconds)
AeonG__ has joined #archiveteam-bs
Valentine has quit IRC (Ping timeout: 506 seconds)
[03:53]
dashcloud has quit IRC (Read error: Operation timed out)
Odd0002 has quit IRC (Read error: Operation timed out)
[04:04]
BlueMaxim has quit IRC (Leaving) [04:10]
..... (idle for 20mn)
octothorp has joined #archiveteam-bs [04:30]
BlueMaxim has joined #archiveteam-bs
qw3rty16 has joined #archiveteam-bs
[04:43]
qw3rty15 has quit IRC (Ping timeout: 600 seconds) [04:51]
Ravenloft has quit IRC (Ping timeout: 264 seconds) [05:02]
Odd0002 has joined #archiveteam-bs [05:14]
............ (idle for 58mn)
wp494 has quit IRC (Ping timeout: 506 seconds)
wp494 has joined #archiveteam-bs
[06:12]
.......... (idle for 49mn)
Jusque has quit IRC (Quit: ZNC - http://znc.in)
Jusque has joined #archiveteam-bs
wp494 has quit IRC (Ping timeout: 492 seconds)
[07:02]
.... (idle for 15mn)
wp494 has joined #archiveteam-bs [07:21]
.... (idle for 15mn)
wp494 has quit IRC (Ping timeout: 633 seconds)
yuitimoth has quit IRC (Ping timeout: 480 seconds)
yuitimoth has joined #archiveteam-bs
wp494 has joined #archiveteam-bs
godane has quit IRC (Read error: Operation timed out)
[07:36]
yuitimoth has quit IRC (Remote host closed the connection)
yuitimoth has joined #archiveteam-bs
Sk1d has quit IRC (Ping timeout: 186 seconds)
[07:54]
Sk1d has joined #archiveteam-bs
wp494 has quit IRC (Read error: Operation timed out)
[08:05]
wp494 has joined #archiveteam-bs [08:12]
..... (idle for 22mn)
wp494 has quit IRC (Ping timeout: 633 seconds)
wp494 has joined #archiveteam-bs
[08:34]
....... (idle for 33mn)
Stiletto has quit IRC (Ping timeout: 264 seconds)
Stilett0 has joined #archiveteam-bs
[09:08]
......... (idle for 43mn)
BlueMaxim has quit IRC (Leaving) [09:55]
....... (idle for 31mn)
Stilett0 has quit IRC (Ping timeout: 264 seconds)
Stilett0 has joined #archiveteam-bs
[10:26]
...... (idle for 27mn)
Valentine has joined #archiveteam-bs [10:53]
...... (idle for 27mn)
Mateon1 has quit IRC (Ping timeout: 250 seconds)
Mateon1 has joined #archiveteam-bs
Ravenloft has joined #archiveteam-bs
[11:20]
........................... (idle for 2h12mn)
zinoHow the F do you spend $2000/month on keeping a forum running? (re SRK tweets/discussion)
Unless that includes personel cost it sounds absurdly expensive unless your company name is Reddit.
[13:35]
IglooReddits costs will be far hgher than that zino
A good setup of servers will run you that much, AWS with elastic LB'seasily
[13:39]
JAAThe only numbers I could find are from 2010: around $20-30k per month. https://www.reddit.com/r/blog/comments/ctz7c/your_gold_dollars_at_work/c0v8ug8/?context=1 [13:45]
...... (idle for 26mn)
***bwn has quit IRC (Read error: Operation timed out) [14:11]
...... (idle for 28mn)
joepie91zino: my experience is that almost everybody who goes down due to expenses like that, is running on unnecessarily expensive systems / cloudycloud services
very rarely are the costs actually justified
[14:39]
***bwn has joined #archiveteam-bs [14:39]
joepie91zino: (the second most common case is running ridiculously non-performant software and throwing endless amounts of servers at it rather than taking a week to optimize it) [14:39]
.... (idle for 16mn)
***icedice has joined #archiveteam-bs [14:55]
fireglow has joined #archiveteam-bs [15:01]
fireglowlet's hear the bs [15:02]
.... (idle for 15mn)
***icedice has quit IRC (Ping timeout: 260 seconds)
icedice has joined #archiveteam-bs
[15:17]
............. (idle for 1h4mn)
Froggingjoepie91: yeah people forget that scaling isn't only about being able to use more resources when needed, it's also about doing more with less
low marginal cost is nice, low fixed cost for a small operation is better
[16:23]
...... (idle for 28mn)
***schbirid has joined #archiveteam-bs [16:52]
schbirid2 has joined #archiveteam-bs
schbirid has quit IRC (Read error: Operation timed out)
sep332_ has quit IRC (konversation out)
[17:01]
.... (idle for 15mn)
schbirid2 has quit IRC (Remote host closed the connection)
schbirid has joined #archiveteam-bs
icedice has quit IRC (Quit: Leaving)
schbirid has quit IRC (Quit: Leaving)
[17:24]
schbirid has joined #archiveteam-bs [17:40]
jrwroh ya joepie91
when you can run the whole thing in under 200$ off OVH or 2k off AWS
do burst scaling with AWS and have your core baselines on dedicated hardware
its super rare to see that
[17:49]
..... (idle for 21mn)
tomasparki am looking a upgrade my NAS, but I am unsure witch way to go
DIY or off-the-self
[18:11]
FroggingI don't think there's a "right answer", it's whatever you prefer or feel like doing
I prefer DIY personally
also cost I guess. I don't know what direction or how much difference there is in cost between off-the-shelf and building from parts
[18:21]
tomasparkthe diys have better bang per buck
but the off-the-shelfs are turnkey
[18:24]
jrwrand they cause a bigger bang when they fail :) [18:24]
Froggingthis stuff's a hobby for me so failure is a valuable learning experience :p [18:25]
tomasparki like the look of the 45drives setups [18:26]
Kazso, budget is not a problem?
if you're willing to drop $(god knows what) on a 45drives box
[18:26]
***AeonG__ has quit IRC (Read error: Operation timed out) [18:28]
tomasparkthe 15 drive i would like if I could get the rest of the familiy to use it
^extended family
[18:29]
Kaz15 drives can be done for a lot cheaper than $2500
depends on the value of your time I guess
[18:31]
tomasparkor 8 drive
if not
where you go to get a 15 drive nas?
[18:32]
JAAThere are definitely tower cases which can hold 15 drives. I think there's a Lian Li one with 20 slots. [18:34]
Kazebay, tbh [18:34]
astridi have a 16 drive cage i've been looking to unload if yr in seattle [18:35]
tomasparkno australia [18:36]
JAAOh, my deepest condolences. HDD prices over there are even worse than here in Europe. [18:37]
tomasparkthat why I looking at upgrading HDD in stages [18:39]
astrid"drive-of-the-month club": every time you can afford it, buy the cheapest-per-gigabyte disk you can find, and add it to your array
you'll mix lots and manufacturers, so they won't all fail at the same time :)
[18:40]
tomasparkthat what I been doing yearly
but I hit the port limits
[18:41]
astridah okay [18:46]
tomasparki like the diy options but i want something that is turnkey just add drives and OS
my current setup is a eeepc 701SD netbook 4x2TB HDD into 2 RAID arrays and a UPS
^usb desktop HHD
[18:48]
.... (idle for 16mn)
schbiridi plan to use http://www.fantec.de/en/products/storage-devices/external-hard-drives/35-inch-external-hard-drives/produkt/details/artikel/1461_fantec_qb_x8us3/ with a raspberry for hoarding
costs ~230€
[19:06]
***Hiccup has joined #archiveteam-bs [19:10]
HiccupIs there some kinda of directory or more advanced search engine for the Internet Archive? [19:11]
tomasparkschbirid: :thinking:
checking on ebay and bookmarked
AU $922.23 ouch
[19:14]
JAAHiccup: https://archive.org/advancedsearch.php
I wrote a tool specifically for ArchiveBot that lists the files in each item in that collection.
[19:20]
Hiccupby more more advanced search I meant one that could search through sub-pages, but I'll try this [19:21]
JAABut there is nothing in general to search for filenames etc. [19:21]
Hiccupoh [19:21]
JAA(As far as I know, anyway.)
My tool is at https://github.com/JustAnotherArchivist/archivebot-archives . There's nothing special going on there really; it just uses IA's API to iterate through all items in the collection and writes the file list for each to a YAML file.
I then just use 'git grep' to search for files (or the GitHub search, because those YAML files are also in the repo).
But yeah, you basically have to write your own tool which extracts the data you need and run the search locally.
[19:22]
...... (idle for 25mn)
***Hiccup has quit IRC (Leaving) [19:49]
..... (idle for 22mn)
godane has joined #archiveteam-bs
jschwart has joined #archiveteam-bs
BlueMaxim has joined #archiveteam-bs
[20:11]
...... (idle for 25mn)
RichardG has quit IRC (Read error: Operation timed out) [20:40]
schbirid2 has joined #archiveteam-bs
RichardG has joined #archiveteam-bs
schbirid has quit IRC (Ping timeout: 252 seconds)
[20:47]
....... (idle for 33mn)
schbirid2 has quit IRC (Quit: Leaving) [21:23]
AeonG__ has joined #archiveteam-bs [21:34]
......... (idle for 44mn)
jschwart has quit IRC (Quit: Konversation terminated!) [22:18]
....... (idle for 32mn)
will has quit IRC (Read error: Operation timed out)
will has joined #archiveteam-bs
[22:50]
godanei'm starting to upload America Now podcast
it had Meghan McCain on it
its about 25gb for 2015 and 2016
[23:04]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)