mlm_insights.config_reader.utils package¶

Submodules¶

mlm_insights.config_reader.utils.config_parser module¶

class mlm_insights.config_reader.utils.config_parser.ConfigParser¶

Bases: object

static compute_params(value: Any, config_map: Dict[str, Any]) → Any¶

static get_typed_object(data: Dict[str, Any], config_map: Dict[str, Any]) → Any¶

mlm_insights.config_reader.utils.config_reader_utils module¶

mlm_insights.config_reader.utils.config_reader_utils.generate_input_schema(config_dict: Dict[str, Any]) → Dict[str, FeatureType]¶

mlm_insights.config_reader.utils.config_reader_utils.get_config_dict(location: str, **storage_options: Any) → Dict[str, Any]¶

mlm_insights.config_reader.utils.config_reader_utils.get_config_json(config_location: str, **storage_options: Any) → Dict[str, Any]¶

mlm_insights.config_reader.utils.config_reader_utils.get_data_set_metrics(config_dict: Dict[str, Any], config_map: Dict[str, Any]) → List[MetricMetadata] | None¶

mlm_insights.config_reader.utils.config_reader_utils.get_engine_detail(config_dict: Dict[str, Any]) → EngineDetail¶

mlm_insights.config_reader.utils.config_reader_utils.get_metric_confing(metric_data: Dict[str, Any]) → Dict[str, Any]¶

mlm_insights.config_reader.utils.config_reader_utils.get_post_processors(config_dict: Dict[str, Any], config_map: Dict[str, Any]) → List[PostProcessor]¶

mlm_insights.config_reader.utils.config_reader_utils.get_profile_reader(config_dict: Dict[str, Any], config_map: Dict[str, Any]) → ProfileReader | None¶

mlm_insights.config_reader.utils.config_reader_utils.get_reader(config_dict: Dict[str, Any], config_map: Dict[str, Any]) → DataReader¶

mlm_insights.config_reader.utils.config_reader_utils.get_tags(config_dict: Dict[str, Any]) → Dict[str, str]¶

mlm_insights.config_reader.utils.config_reader_utils.get_transformers(config_dict: Dict[str, Any], config_map: Dict[str, Any]) → List[Transformer]¶

mlm_insights.config_reader.utils.config_reader_utils.get_univariate_metrics(config_dict: Dict[str, Any], config_map: Dict[str, Any]) → Dict[Any, List[MetricMetadata]]¶

mlm_insights.config_reader.utils.config_reader_utils.parse_object_storage_url(url: str) → Match[str] | None¶

mlm_insights.config_reader.utils.config_reader_utils.read_file(file_name: str) → bytes¶

mlm_insights.config_reader.utils.config_reader_utils.set_custom_component(custom_components: List[CustomComponent], config_registry: ConfigRegistry) → None¶

mlm_insights.config_reader.utils.config_reader_utils.validate_config_format(config_location: str) → None¶

mlm_insights.config_reader.utils.config_registry module¶

class mlm_insights.config_reader.utils.config_registry.ConfigRegistry¶

Bases: object

add_dask_components() → None¶

Method to add dask components if the engine is dask.

Below components would be added to the config map

Reader component

CSVDaskDataReader
JsonlDaskDataReader
NestedJsonDaskDataReader

get_config_map() → Dict[str, Any]¶

load_adw_components(config_dict: Dict[str, Any]) → None¶

Method to add adw components.

Below components would be added to the config map

Reader component

ADWDaskDataReader
ADWNativeDataReader

update_config_map(custom_component: Dict[str, Any]) → None¶