Custom Metrics
You can publish custom metrics from Big Data Service to OCI Monitoring services.
For more information, see:
Fetching Required Metrics
Fetch required metrics using the Ambari API / Ambari Metric Collector API. The Ambari REST API supports metric queries at CLUSTER, HOST, COMPONENT and HOST COMPONENT levels. For more information, see:
Metric Levels
There's different levels of metrics, including cluster, host, component, and host-component.
Cluster Level Metrics
Ambari API
https://<Ambari_Server_IP>:<port>/api/v1/clusters/<cluster-name>?fields=metrics[startTime,endTime,Interval]
Example:
https://<Ambari_Server_IP>:<port>/api/v1/clusters/<cluster-name>?fields=metrics/cpu[1683808200,1683808260,15]&_=1430848532905
Where &_=1430848532905 doesn't effect the response used to bypass caching.
Host Level Metrics
Ambari API
https://<Ambari_Server_IP>:<port>/api/v1/clusters/<cluster-name>/hosts/<host-name>?fields=metric1[startTime,endTime,Interval],metric2[startTime,endTime,Interval]
Example:
https://<Ambari_Server_IP>:<port>/api/v1/clusters/<cluster-name>/hosts/<host-name>fields=metrics/cpu/cpu_user[1683808200,1683808260,15],metrics/cpu/cpu_wio[1683808200,1683808260,15],metrics/cpu/cpu_nice[1683808200,1683808260,15],metrics/cpu/cpu_aidle[1683808200,1683808260,15],metrics/cpu/cpu_system[1683808200,1683808260,15],metrics/cpu/cpu_idle[1683808200,1683808260,15]&_=1430848217591
Component Level Metrics
Ambari API
http://<AMC_IP>:<port>/ws/v1/timeline/metrics?metricNames=cpu_user,cpu_wio,cpu_nice,cpu_aidle,cpu_system,cpu_idle&hostname=<host-name>&appId=HOST&startTime=1683808200&endTime=1683808260&interval=15000
Example:
https://<Ambari_Server_IP>:<port>/api/v1/clusters/metric01nh/services/HDFS/components/ DATANODE?fields=metrics/dfs/datanode/DfsUsed,metrics/dfs/datanode/Capacity&_=1430849798630
Host-Component Level Metrics
Ambari API
https://<Ambari_Server_IP>:<port>/api/v1/clusters/<clusterName>/hosts/<host-name>/host_components/DATANODE?fields=metric1,metric2 (point query)
Example:
https://<Ambari_Server_IP>:<port>/api/v1/clusters/<clusterName>/hosts/<host-name>/host_components/DATANODE?fields=metrics/disk/disk_free,metrics/disk/disk_total