Big Data Service 3.0.23 has added additional features

BDS 3.0.23 release has the following new features implemented:

• Updated command to access the Trino CLI.
• Added certificate event types.
• Added new bootstrap script event types.
• Added Kafka rebalancing tool to add data to newly created Brokers on an existing Kafka Broker.

In addition, the following bugs/enhancements have been made:

• Added fix to read data from Object Storage with no job failures.
• Enabled running the HBCK addFsRegionsMissingInMeta tool from the region server.
• Fixed Kafka log lock issue that affected Kafka broker restart.
• Updated zk quorum in Kafka if ZooKeeper server is added or deleted.
• Fixed issue where Kafka service required restart when adding or removing Kafka broker.
• Fixed issue related to namenode move operation.
• Optimized start/stop cluster workflow to run operations in parallel using multithreading.
• Implemented HA for Kafka.
• Updated hive.metastore.server.max.threads in Hive to 1000 as recommended for Hive 3.x.
• Updated heap dump path for Hive to /u01/debug-dumps/.
• Fixed issue where HBase used up memory resources.
• Fixed issue where ZooKeeper and Oozie failed to restart when the restart flag was enabled.
• Updated Spark summary page to show thriftserver jdbc url.
• Automated import tsv and validated in HBase.
• Shortened time taken to reshape large cluster.
• Enabled Ranger authorization through Ambari UI for Trino service.
• Automated Ranger integration into Trino.