Mistral Elasticsearch indices in 2023.1 and 2024.1
In line with the data and dashboard changes in Mistral 2023.1, we extended the set of Mistral indexes for Elastic search to make it easier for data life cycle management. The elastic search plugin used to put all data into Elastic Search under one index, but since Mistral 2023.1, the Mistral Elasticsearch Plugin uses five indices:
| Index | Description |
| mistral | Time series filesystem I/O, CPU and memory metrics per mount point and per job |
| total-mistral | Total filesystem I/O, CPU and memory metrics per mount point and per job |
| summary-mistral | Filesystem I/O grouped into good medium and bad per mount point and per job |
| network-mistral | Time series network I/O metrics per job and per destination IP address |
| total-network-mistral | Total network I/O per job and per destination IP address |
Configuring data life cycle
When setting up data life cycle in Elasticsearch and Grafana, we recommend keeping the summary data and total data for longer than the time series data. This lets you go back in time to look at total and summary data for jobs, but means you don't have to keep detailed time series metrics for jobs that are no longer of interest. By using different indices for different data sets, Mistral now makes it easy to configure different settings for different data sets.
Elastic publish some guides on how to manage your data life cycle:
https://www.elastic.co/guide/en/elasticsearch/reference/current/index-lifecycle-management.html
Setting up the Elasticsearch Indexes in Mistral
For instructions on how to set up Mistral 2023.1.x to send data to elastic search using the indices above, please refer to the Mistral Getting Started Guide and the Mistral Elasticsearch Plugin Manual. This will guide you through how to set up the index templates so that Mistral and Elasticsearch match.
New: Updated for Mistral 2024.1.x the index templates are automatically created. See the Mistral Getting Started Guide and the Mistral Elasticsearch Plugin Manual for more information.