Zabbix at scale with Elasticsearch
- 1. Zabbix At scale with Elasticsearch Zabbix Mysql ElasticSearch Leandro Totino Pereira System Engineer
- 2. Zabbix Problems • Zabbix Server busy • Database too many history records • Database slow due to huge table • Corrupted table • Backup
- 3. Zabbix Tables • History - table that stores all float values • History_uint - table that stores all integer values • History_text - table that stores all text values • History_Str - table that store all string values • History_Log - table that stores all log values • Events - table that stores all events values • Items - table that stores all items values
- 4. ES - Elasticsearch • Scalable to one a many nodes. • Really fast compared to sql history,logs tables. • Index Based (auto-partitioning index based on number documents) • Data Compression really good.
- 5. MariaDB - Galera/Binlog replication Multi cluster architecture supported, the main ones: Galera multi-master cluster Mysql replication (master,multi-slave) Binlog server (master, multi slaves) If you have a huge amount items/events you should consider partitioning events,items tables and run OPTIMIZE on them to reclaim disc space.
- 6. Hot Backup Mysql • Backups that complete quickly and reliably • Uninterrupted transaction processing during backups • Savings on disk space and network bandwidth • Automatic backup verification • Higher uptime due to faster restore time • Percona XtraBackup makes MySQL hot backups for all versions of Percona Server, MySQL, and MariaDB. It performs streaming, compressed, and incremental MySQL backups. With Percona XtraBackup, you can achieve the following benefits:
- 7. Zabbix Architecture History* table are saved in elasticsearch and the basics ones items, events are saved on mariadb cluster. Zabbix proxies set up in many networks segments VIP address in front of Zabbix server master/slave
- 9. Elasticsearch indices, no table history in Zabbix database History_uint,History_str,History(dbl),history_text,History_log in Elasticsearch and no table history in mysql cluster
- 10. Let check if It´s working
- 11. Thank you! Questions ? More Information: Linkedin: https://www.linkedin.com/in/leandro-totino- pereira Facebook: https://www.facebook.com/leandro.totinopereira