Log Management #
Logging in SphereEx-DBPlusSuite is divided into three parts: #
- Cluster ecosystem tools :
SphereEx-Console logs: logs of SphereEx-Console operations; SphereEx-Boot logs: none
- Cluster Components.
Logs generated by the cluster components, managed by the user
- Cluster Logs.
i.e. logs of compute nodes
Cluster ecosystem tools logs #
- SphereEx-Boot has no log files, so we won’t go into them
- SphereEx-Console log file location:
logs/ - SphereEx-Console log file location modification method:
conf/logback.xml - Interpretation of SphereEx-Console log file contents
Cluster component logs #
The logs generated by the cluster components are managed by the user and are not described in this document.
Cluster logs #
There are three types of logs for compute nodes: run logs, audit logs, and slow logs.
| Log name | Log file location and name | Log location modification method | Parameter | Explanation |
|---|---|---|---|---|
| Running log | logs/stdout.log | conf/logback.xml | None | On by default, cannot be turned off by online adjustment; changes to log location and name require a restart to take effect |
| Audit log (full log) | logs/stdout.log | conf/logback.xml | general_query_log: true means full logging is on; false means full logging is off; default is off | The parameters can be adjusted online to change the log location and name requiring a restart restart to take effect The audit log is the same as the log of the run log |
| Slow log | logs/slow_query.log log center | conf/logback.xml | slow_query_log: true means slow logging is on; false means slow logging is off; default is off long_query_time: slow_logging threshold in ms Default is 10 | Parameters can be adjusted online Changes to log locations and names require a reboot to take effect |
Management logs #
ReferenceCluster Management, Parameter Management
Cluster log cleaning
| Log name | Storage location | Rewind strategy |
|---|---|---|
| Running log | Compute the node’s log directory logs/ | Adjust the log rewind policy via the conf/logback.xml configuration |
| Audit log (full log) | Compute the node’s log directory logs/ | Adjust the log rewind policy via . /conf/logback.xml configuration to adjust the log rewind policy |
| Slow log | Compute the node’s log directory logs/ | Adjust the log rewind policy via . /conf/logback.xml configuration to adjust the log rewind policy |
| Slow log | Log center | Done by configuring Elasticsearch |
Cluster log format interpretation #
The format of the three types of cluster logs is explained, and this part will be added later