Go to file
2020-07-01 20:01:34 +02:00
hbase-protobuf-python Change protobuf bindings directory name 2020-07-01 18:53:36 +02:00
.gitignore Change protobuf bindings directory name 2020-07-01 18:53:36 +02:00
Dockerfile Initial commit 2019-04-04 15:37:54 +02:00
hbase-exporter Add protobuf bindings to syspath 2020-07-01 20:01:34 +02:00
hbase-exporter.service Change service user to hdfs 2019-04-10 13:14:37 +02:00
hbase-hbck.service systemd-service: Move user to the right section, change type to lowercase 2019-04-10 12:22:53 +02:00
hbase-hbck.timer hbase-hbck: Change timer to 20 minutes 2019-04-10 21:04:46 +02:00
hbase-write.py Add hbase-write script 2020-06-10 21:47:56 +02:00
Makefile Makefile: Change protobuf bindings directory name 2020-07-01 18:41:59 +02:00
README.md Update README 2020-06-25 01:06:10 +02:00
requirements.txt Update requirements 2020-06-25 00:58:50 +02:00

hbase-exporter

An HBase Prometheus Exporter

Relays JMX metrics for consumption by Prometheus

The exporter parses the (Hortonworks) Hadoop config and uses (Hortonworks) Hadoop internal tooling to determine e.g. the currently active master so that it can run in different environments without requiring any configuration

Those tools are not yet included when building the app as a container

Since some important metrics are missing or empty in JMX, we additionally parse the HBase Master UI for e.g. 'Stale regions in transition'

The hbase hbck log is parsed to check for inconsistencies in HBase. The log is created independently from the exporter with the help of a systemd-timer unit and a systemd-hbck-service unit

Unfortunately querying the active namenode requires superuser privileges

For python module requirements see requirements.txt

$ sudo dnf/pkg install python36
# As the user executing the exporter:
$ pip3[.6] install --user -r requirements.txt

To generate the necessary HBase Python Protobuf bindings, run the Makefile The protobuf compiler is necessary to build them

Install the protobuf compiler

$ sudo dnf/pkg install protobuf-c

Run make

$ make

Issues

Import paths do not work in generated protobufs when used from a subdir https://github.com/protocolbuffers/protobuf/issues/1491 The solution used here is mentioned in the comments: https://github.com/protocolbuffers/protobuf/issues/1491#issuecomment-547504972