ELK: BigData for DevOps (retired)

Big Data is often related to companies like Google, Facebook or Twitter. Indeed, 500 bilion tweets a day, 1,3 billion active Facebook users or 30 billion web pages to search, we’re talking ‘Big Data’. Many smaller companies have Big Data, too, without knowing it: application log files.

This talk discusses how to use Elasticsearch, Logstash and Kibana to gain insight in these data. Apart from the general picture, it covers a detailed walk-through of how to configure Logstash for filtering sensitive data from log files. It also covers a real-world example at a major Dutch bank, including common pit falls, best practices and lessons learned.

After attending this session you will be able to leverage the power of the ELK stack for your own application. Even for smaller companies and applications, a lot of knowledge can be gained from proper insight in your production environment.