| Time |
Nickname |
Message |
|
00:08
🔗
|
|
REiN^ has joined #archiveteam-bs |
|
00:28
🔗
|
|
godane has quit IRC (Quit: Leaving.) |
|
00:35
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
01:00
🔗
|
|
Ravenloft has joined #archiveteam-bs |
|
01:35
🔗
|
|
Asparagir has quit IRC (Asparagir) |
|
02:00
🔗
|
|
BlueMaxim has quit IRC (Leaving) |
|
02:00
🔗
|
|
octothorp has quit IRC (Read error: Connection reset by peer) |
|
02:14
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
02:25
🔗
|
|
godane has joined #archiveteam-bs |
|
03:53
🔗
|
|
AeonG__ has quit IRC (Ping timeout: 633 seconds) |
|
03:56
🔗
|
|
AeonG__ has joined #archiveteam-bs |
|
03:58
🔗
|
|
Valentine has quit IRC (Ping timeout: 506 seconds) |
|
04:04
🔗
|
|
dashcloud has quit IRC (Read error: Operation timed out) |
|
04:05
🔗
|
|
Odd0002 has quit IRC (Read error: Operation timed out) |
|
04:10
🔗
|
|
BlueMaxim has quit IRC (Leaving) |
|
04:30
🔗
|
|
octothorp has joined #archiveteam-bs |
|
04:43
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
04:46
🔗
|
|
qw3rty16 has joined #archiveteam-bs |
|
04:51
🔗
|
|
qw3rty15 has quit IRC (Ping timeout: 600 seconds) |
|
05:02
🔗
|
|
Ravenloft has quit IRC (Ping timeout: 264 seconds) |
|
05:14
🔗
|
|
Odd0002 has joined #archiveteam-bs |
|
06:12
🔗
|
|
wp494 has quit IRC (Ping timeout: 506 seconds) |
|
06:13
🔗
|
|
wp494 has joined #archiveteam-bs |
|
07:02
🔗
|
|
Jusque has quit IRC (Quit: ZNC - http://znc.in) |
|
07:03
🔗
|
|
Jusque has joined #archiveteam-bs |
|
07:06
🔗
|
|
wp494 has quit IRC (Ping timeout: 492 seconds) |
|
07:21
🔗
|
|
wp494 has joined #archiveteam-bs |
|
07:36
🔗
|
|
wp494 has quit IRC (Ping timeout: 633 seconds) |
|
07:39
🔗
|
|
yuitimoth has quit IRC (Ping timeout: 480 seconds) |
|
07:39
🔗
|
|
yuitimoth has joined #archiveteam-bs |
|
07:41
🔗
|
|
wp494 has joined #archiveteam-bs |
|
07:43
🔗
|
|
godane has quit IRC (Read error: Operation timed out) |
|
07:54
🔗
|
|
yuitimoth has quit IRC (Remote host closed the connection) |
|
07:56
🔗
|
|
yuitimoth has joined #archiveteam-bs |
|
07:58
🔗
|
|
Sk1d has quit IRC (Ping timeout: 186 seconds) |
|
08:05
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
08:07
🔗
|
|
wp494 has quit IRC (Read error: Operation timed out) |
|
08:12
🔗
|
|
wp494 has joined #archiveteam-bs |
|
08:34
🔗
|
|
wp494 has quit IRC (Ping timeout: 633 seconds) |
|
08:35
🔗
|
|
wp494 has joined #archiveteam-bs |
|
09:08
🔗
|
|
Stiletto has quit IRC (Ping timeout: 264 seconds) |
|
09:12
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
09:55
🔗
|
|
BlueMaxim has quit IRC (Leaving) |
|
10:26
🔗
|
|
Stilett0 has quit IRC (Ping timeout: 264 seconds) |
|
10:26
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
10:53
🔗
|
|
Valentine has joined #archiveteam-bs |
|
11:20
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 250 seconds) |
|
11:20
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
11:23
🔗
|
|
Ravenloft has joined #archiveteam-bs |
|
13:35
🔗
|
zino |
How the F do you spend $2000/month on keeping a forum running? (re SRK tweets/discussion) |
|
13:36
🔗
|
zino |
Unless that includes personel cost it sounds absurdly expensive unless your company name is Reddit. |
|
13:39
🔗
|
Igloo |
Reddits costs will be far hgher than that zino |
|
13:40
🔗
|
Igloo |
A good setup of servers will run you that much, AWS with elastic LB'seasily |
|
13:45
🔗
|
JAA |
The only numbers I could find are from 2010: around $20-30k per month. https://www.reddit.com/r/blog/comments/ctz7c/your_gold_dollars_at_work/c0v8ug8/?context=1 |
|
14:11
🔗
|
|
bwn has quit IRC (Read error: Operation timed out) |
|
14:39
🔗
|
joepie91 |
zino: my experience is that almost everybody who goes down due to expenses like that, is running on unnecessarily expensive systems / cloudycloud services |
|
14:39
🔗
|
joepie91 |
very rarely are the costs actually justified |
|
14:39
🔗
|
|
bwn has joined #archiveteam-bs |
|
14:39
🔗
|
joepie91 |
zino: (the second most common case is running ridiculously non-performant software and throwing endless amounts of servers at it rather than taking a week to optimize it) |
|
14:55
🔗
|
|
icedice has joined #archiveteam-bs |
|
15:01
🔗
|
|
fireglow has joined #archiveteam-bs |
|
15:02
🔗
|
fireglow |
let's hear the bs |
|
15:17
🔗
|
|
icedice has quit IRC (Ping timeout: 260 seconds) |
|
15:19
🔗
|
|
icedice has joined #archiveteam-bs |
|
16:23
🔗
|
Frogging |
joepie91: yeah people forget that scaling isn't only about being able to use more resources when needed, it's also about doing more with less |
|
16:24
🔗
|
Frogging |
low marginal cost is nice, low fixed cost for a small operation is better |
|
16:52
🔗
|
|
schbirid has joined #archiveteam-bs |
|
17:01
🔗
|
|
schbirid2 has joined #archiveteam-bs |
|
17:05
🔗
|
|
schbirid has quit IRC (Read error: Operation timed out) |
|
17:09
🔗
|
|
sep332_ has quit IRC (konversation out) |
|
17:24
🔗
|
|
schbirid2 has quit IRC (Remote host closed the connection) |
|
17:26
🔗
|
|
schbirid has joined #archiveteam-bs |
|
17:30
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
17:33
🔗
|
|
schbirid has quit IRC (Quit: Leaving) |
|
17:40
🔗
|
|
schbirid has joined #archiveteam-bs |
|
17:49
🔗
|
jrwr |
oh ya joepie91 |
|
17:49
🔗
|
jrwr |
when you can run the whole thing in under 200$ off OVH or 2k off AWS |
|
17:50
🔗
|
jrwr |
do burst scaling with AWS and have your core baselines on dedicated hardware |
|
17:50
🔗
|
jrwr |
its super rare to see that |
|
18:11
🔗
|
tomaspark |
i am looking a upgrade my NAS, but I am unsure witch way to go |
|
18:12
🔗
|
tomaspark |
DIY or off-the-self |
|
18:21
🔗
|
Frogging |
I don't think there's a "right answer", it's whatever you prefer or feel like doing |
|
18:21
🔗
|
Frogging |
I prefer DIY personally |
|
18:22
🔗
|
Frogging |
also cost I guess. I don't know what direction or how much difference there is in cost between off-the-shelf and building from parts |
|
18:24
🔗
|
tomaspark |
the diys have better bang per buck |
|
18:24
🔗
|
tomaspark |
but the off-the-shelfs are turnkey |
|
18:24
🔗
|
jrwr |
and they cause a bigger bang when they fail :) |
|
18:25
🔗
|
Frogging |
this stuff's a hobby for me so failure is a valuable learning experience :p |
|
18:26
🔗
|
tomaspark |
i like the look of the 45drives setups |
|
18:26
🔗
|
Kaz |
so, budget is not a problem? |
|
18:26
🔗
|
Kaz |
if you're willing to drop $(god knows what) on a 45drives box |
|
18:28
🔗
|
|
AeonG__ has quit IRC (Read error: Operation timed out) |
|
18:29
🔗
|
tomaspark |
the 15 drive i would like if I could get the rest of the familiy to use it |
|
18:30
🔗
|
tomaspark |
^extended family |
|
18:31
🔗
|
Kaz |
15 drives can be done for a lot cheaper than $2500 |
|
18:31
🔗
|
Kaz |
depends on the value of your time I guess |
|
18:32
🔗
|
tomaspark |
or 8 drive |
|
18:32
🔗
|
tomaspark |
if not |
|
18:34
🔗
|
tomaspark |
where you go to get a 15 drive nas? |
|
18:34
🔗
|
JAA |
There are definitely tower cases which can hold 15 drives. I think there's a Lian Li one with 20 slots. |
|
18:34
🔗
|
Kaz |
ebay, tbh |
|
18:35
🔗
|
astrid |
i have a 16 drive cage i've been looking to unload if yr in seattle |
|
18:36
🔗
|
tomaspark |
no australia |
|
18:37
🔗
|
JAA |
Oh, my deepest condolences. HDD prices over there are even worse than here in Europe. |
|
18:39
🔗
|
tomaspark |
that why I looking at upgrading HDD in stages |
|
18:40
🔗
|
astrid |
"drive-of-the-month club": every time you can afford it, buy the cheapest-per-gigabyte disk you can find, and add it to your array |
|
18:40
🔗
|
astrid |
you'll mix lots and manufacturers, so they won't all fail at the same time :) |
|
18:41
🔗
|
tomaspark |
that what I been doing yearly |
|
18:42
🔗
|
tomaspark |
but I hit the port limits |
|
18:46
🔗
|
astrid |
ah okay |
|
18:48
🔗
|
tomaspark |
i like the diy options but i want something that is turnkey just add drives and OS |
|
18:49
🔗
|
tomaspark |
my current setup is a eeepc 701SD netbook 4x2TB HDD into 2 RAID arrays and a UPS |
|
18:50
🔗
|
tomaspark |
^usb desktop HHD |
|
19:06
🔗
|
schbirid |
i plan to use http://www.fantec.de/en/products/storage-devices/external-hard-drives/35-inch-external-hard-drives/produkt/details/artikel/1461_fantec_qb_x8us3/ with a raspberry for hoarding |
|
19:06
🔗
|
schbirid |
costs ~230€ |
|
19:10
🔗
|
|
Hiccup has joined #archiveteam-bs |
|
19:11
🔗
|
Hiccup |
Is there some kinda of directory or more advanced search engine for the Internet Archive? |
|
19:14
🔗
|
tomaspark |
schbirid: :thinking: |
|
19:18
🔗
|
tomaspark |
checking on ebay and bookmarked |
|
19:19
🔗
|
tomaspark |
AU $922.23 ouch |
|
19:20
🔗
|
JAA |
Hiccup: https://archive.org/advancedsearch.php |
|
19:21
🔗
|
JAA |
I wrote a tool specifically for ArchiveBot that lists the files in each item in that collection. |
|
19:21
🔗
|
Hiccup |
by more more advanced search I meant one that could search through sub-pages, but I'll try this |
|
19:21
🔗
|
JAA |
But there is nothing in general to search for filenames etc. |
|
19:21
🔗
|
Hiccup |
oh |
|
19:22
🔗
|
JAA |
(As far as I know, anyway.) |
|
19:23
🔗
|
JAA |
My tool is at https://github.com/JustAnotherArchivist/archivebot-archives . There's nothing special going on there really; it just uses IA's API to iterate through all items in the collection and writes the file list for each to a YAML file. |
|
19:24
🔗
|
JAA |
I then just use 'git grep' to search for files (or the GitHub search, because those YAML files are also in the repo). |
|
19:24
🔗
|
JAA |
But yeah, you basically have to write your own tool which extracts the data you need and run the search locally. |
|
19:49
🔗
|
|
Hiccup has quit IRC (Leaving) |
|
20:11
🔗
|
|
godane has joined #archiveteam-bs |
|
20:12
🔗
|
|
jschwart has joined #archiveteam-bs |
|
20:15
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
20:40
🔗
|
|
RichardG has quit IRC (Read error: Operation timed out) |
|
20:47
🔗
|
|
schbirid2 has joined #archiveteam-bs |
|
20:50
🔗
|
|
RichardG has joined #archiveteam-bs |
|
20:50
🔗
|
|
schbirid has quit IRC (Ping timeout: 252 seconds) |
|
21:23
🔗
|
|
schbirid2 has quit IRC (Quit: Leaving) |
|
21:34
🔗
|
|
AeonG__ has joined #archiveteam-bs |
|
22:18
🔗
|
|
jschwart has quit IRC (Quit: Konversation terminated!) |
|
22:50
🔗
|
|
will has quit IRC (Read error: Operation timed out) |
|
22:50
🔗
|
|
will has joined #archiveteam-bs |
|
23:04
🔗
|
godane |
i'm starting to upload America Now podcast |
|
23:05
🔗
|
godane |
it had Meghan McCain on it |
|
23:06
🔗
|
godane |
its about 25gb for 2015 and 2016 |