Monitoring

Typically it's Watcher...you have to call Elastic, the # of nodes, the developer contract was more expensive than Production contract, starting at $5k-$10k-$20k (they've started removing some of the cheaper contracts). [How good is it?] We use it at a couple of customers...it runs queries. They've added some new streaming features (v2.0 added some new analytics streaming features). Yelp is just running queries over and over again. Most of the folkst that Trent works with, have contracts. Shield for security. Marvel is good (in v3 provided better statistics into Java GCs; in v4, ) In v3, it ran on the data nodes. In v4, you add an application plugin to Kibana.

For really looking into what your ES is doing, you monitor the nodes with NewRelic. Ruxit is an APM, roughly 20% of the cost of NewRelic. Their pricing is $80-$90/node, a lot cheaper than NewRelic. https://ruxit.com/product-pricing/. NewRelix is $149/mo/host for annual plan.

[Do you see people using Grafana?] Not really, unless they're looking at using it with InfluxDB, or for time-series data. Time-series databases have grown like crazy over the last couple of years

  • Prometheus - http://prometheus.io/
  • InfluxDB + Grafana [Do you see customers putting time-series data in ES?] Yes, it's not the best tool for the job, but it's usable.

Master node

http://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/es-managedomains.html#es-managedomains-dedicatedmasternodes