On the Utility of Anonymized Flow Traces for Anomaly Detection
Metrics, Logs, Transaction Traces, Anomaly Detection at Scale
-
Upload
sematext-group-inc -
Category
Data & Analytics
-
view
2.069 -
download
0
Transcript of Metrics, Logs, Transaction Traces, Anomaly Detection at Scale
WHO Services
Solr Elasticsearch* Kafka Spark HBase Cassandra...
* We’ve got serious Solr & Elasticsearch ninjas on the team!
OSS
http://blog.sematext.com/2015/04/22/monitoring-stream-processing-tools-cassandra-kafka-and-spark/
OSS
“I have an ELK stack that has been suffering as of late. The logstash service will continually crash, the elasticsearch cluster is hardly in the green, and it is taking a constant amount of maintenance.”
WHAT
SPM → monitoring
Logsene → logging
On PremisesCloud
http://sematext.com/spm http://sematext.com/logsene
WHAT
http://blog.sematext.com/2015/04/22/monitoring-stream-processing-tools-cassandra-kafka-and-spark/
WHAT Interesting finds
Variable Collectd supportCollectd ⇒ SIGARApache Flume Elasticsearch Stats APIMetrics 2nd class citizen
WHAT Custom Pointcuts
<method signature="java.lang.String com.company.example.Service#getUserName(com.company.model.Company company)"/>
WHAT Anomaly Detection
ExponentialSTDFromMAKNN ...
boolean result = anomalyCount / (notAnomalyCount + anomalyCount) >= 3d / 4d;
Thank you!
@sematexthttp://sematext.com