The ELK Stack
ELK stands for Elasticsearch Logstash and Kibana which are technologies for creating visualizations from raw data.
Elasticsearch is a distributed, open source search and analytics engine, designed for horizontal scalability, reliability, and easy management. It combines the speed of search with the power of analytics via a sophisticated, developer-friendly query language covering structured, unstructured, and time-series data.
Logstash is a flexible, open source data collection, enrichment, and transportation pipeline. With connectors to common infrastructure for easy integration, Logstash is designed to efficiently process a growing list of log, event, and unstructured data sources for distribution into a variety of outputs, including Elasticsearch.
Kibana is an open source data visualization platform that allows you to interact with your data through stunning, powerful graphics. From histograms to geomaps, Kibana brings your data to life with visuals that can be combined into custom dashboards that help you share insights from your data far and wide.
Questions in mind:
- Why do i really care about data visualization ? ( I’m not the director who really care about KPI & Uptime reporting for clients & require an visual representation of the data in order to present PPT or any other reporting format.)
- What is use of data visualization in my day to day job ?
Data visualization provide us real-time operational intelligence. It’s the easy, fast and secure way to search, analyze and visualize the massive streams of machine data generated by your IT systems and technology infrastructure—physical, virtual and in the cloud.
Troubleshoot application problems and investigate security incidents in minutes instead of hours or days, avoid service degradation or outages, deliver compliance at lower cost and gain new business insights.
How my data looks like on ELK – Kibana Dashboard:
That’s it for now – I’ll be posting all the installation & configuration steps in my next post very soon.
Happy Learning 🙂 🙂