jmx - Enable monitoring in Apache Flink through Jolokia agent

Question

How to enable monitoring on Apache Flink ? I want to monitor flink on ELK stack. I am using Jolokia to get metrics from Flink. By far I am able to get metrics of job manager but I am not able to get task manager metrics.

I have added below line on both taskmanager.sh and jobmanager.sh

export FLINK_ENV_JAVA_OPTS="-javaagent:/data/applications/flink-1.11.3/lib/jolokia-jvm-1.6.2-agent.jar=port=8778,host=0.0.0.0"

I am running flink code with jolokia_JVM agent. Below is the JMX settings in flink-conf.yaml file.

metrics.reporters: jmx
metrics.reporter.jmx.class: org.apache.flink.metrics.jmx.JMXReporter
metrics.reporter.jmx.port: 8789
metrics.delimiter: .
env.java.opts: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=9999 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -javaagent:/data/applications/flink-1.11.3/lib/jolokia-jvm-1.6.2-agent.jar=8778

How can i get both taskmanager and jobmanager metrics through JMX.

question from:https://stackoverflow.com/questions/65933131/enable-monitoring-in-apache-flink-through-jolokia-agent

Answer 1

Waitting for answers