CreateApplicationDetails¶

class oci.data_flow.models.CreateApplicationDetails(**kwargs)¶

Bases: object

The create application details.

Attributes

`LANGUAGE_JAVA`	A constant which can be used with the language property of a CreateApplicationDetails.
`LANGUAGE_PYTHON`	A constant which can be used with the language property of a CreateApplicationDetails.
`LANGUAGE_SCALA`	A constant which can be used with the language property of a CreateApplicationDetails.
`LANGUAGE_SQL`	A constant which can be used with the language property of a CreateApplicationDetails.
`TYPE_BATCH`	A constant which can be used with the type property of a CreateApplicationDetails.
`TYPE_SESSION`	A constant which can be used with the type property of a CreateApplicationDetails.
`TYPE_STREAMING`	A constant which can be used with the type property of a CreateApplicationDetails.
`application_log_config`	Gets the application_log_config of this CreateApplicationDetails.
`archive_uri`	Gets the archive_uri of this CreateApplicationDetails.
`arguments`	Gets the arguments of this CreateApplicationDetails.
`class_name`	Gets the class_name of this CreateApplicationDetails.
`compartment_id`	[Required] Gets the compartment_id of this CreateApplicationDetails.
`configuration`	Gets the configuration of this CreateApplicationDetails.
`defined_tags`	Gets the defined_tags of this CreateApplicationDetails.
`description`	Gets the description of this CreateApplicationDetails.
`display_name`	[Required] Gets the display_name of this CreateApplicationDetails.
`driver_shape`	[Required] Gets the driver_shape of this CreateApplicationDetails.
`driver_shape_config`	Gets the driver_shape_config of this CreateApplicationDetails.
`execute`	Gets the execute of this CreateApplicationDetails.
`executor_shape`	[Required] Gets the executor_shape of this CreateApplicationDetails.
`executor_shape_config`	Gets the executor_shape_config of this CreateApplicationDetails.
`file_uri`	Gets the file_uri of this CreateApplicationDetails.
`freeform_tags`	Gets the freeform_tags of this CreateApplicationDetails.
`idle_timeout_in_minutes`	Gets the idle_timeout_in_minutes of this CreateApplicationDetails.
`language`	[Required] Gets the language of this CreateApplicationDetails.
`logs_bucket_uri`	Gets the logs_bucket_uri of this CreateApplicationDetails.
`max_duration_in_minutes`	Gets the max_duration_in_minutes of this CreateApplicationDetails.
`metastore_id`	Gets the metastore_id of this CreateApplicationDetails.
`num_executors`	[Required] Gets the num_executors of this CreateApplicationDetails.
`parameters`	Gets the parameters of this CreateApplicationDetails.
`pool_id`	Gets the pool_id of this CreateApplicationDetails.
`private_endpoint_id`	Gets the private_endpoint_id of this CreateApplicationDetails.
`spark_version`	[Required] Gets the spark_version of this CreateApplicationDetails.
`type`	Gets the type of this CreateApplicationDetails.
`warehouse_bucket_uri`	Gets the warehouse_bucket_uri of this CreateApplicationDetails.

Methods

__init__(**kwargs) Initializes a new CreateApplicationDetails object with values from keyword arguments.

LANGUAGE_JAVA = 'JAVA'¶: A constant which can be used with the language property of a CreateApplicationDetails. This constant has a value of “JAVA”

LANGUAGE_PYTHON = 'PYTHON'¶: A constant which can be used with the language property of a CreateApplicationDetails. This constant has a value of “PYTHON”

LANGUAGE_SCALA = 'SCALA'¶: A constant which can be used with the language property of a CreateApplicationDetails. This constant has a value of “SCALA”

LANGUAGE_SQL = 'SQL'¶: A constant which can be used with the language property of a CreateApplicationDetails. This constant has a value of “SQL”

TYPE_BATCH = 'BATCH'¶: A constant which can be used with the type property of a CreateApplicationDetails. This constant has a value of “BATCH”

TYPE_SESSION = 'SESSION'¶: A constant which can be used with the type property of a CreateApplicationDetails. This constant has a value of “SESSION”

TYPE_STREAMING = 'STREAMING'¶: A constant which can be used with the type property of a CreateApplicationDetails. This constant has a value of “STREAMING”

__init__(**kwargs)¶

Initializes a new CreateApplicationDetails object with values from keyword arguments. The following keyword arguments are supported (corresponding to the getters/setters of this class):

Parameters:

archive_uri (str) – The value to assign to the archive_uri property of this CreateApplicationDetails.
arguments (list[str]) – The value to assign to the arguments property of this CreateApplicationDetails.
application_log_config (oci.data_flow.models.ApplicationLogConfig) – The value to assign to the application_log_config property of this CreateApplicationDetails.
class_name (str) – The value to assign to the class_name property of this CreateApplicationDetails.
compartment_id (str) – The value to assign to the compartment_id property of this CreateApplicationDetails.
configuration (dict(str, str)) – The value to assign to the configuration property of this CreateApplicationDetails.
defined_tags (dict(str, dict(str, object))) – The value to assign to the defined_tags property of this CreateApplicationDetails.
description (str) – The value to assign to the description property of this CreateApplicationDetails.
display_name (str) – The value to assign to the display_name property of this CreateApplicationDetails.
driver_shape (str) – The value to assign to the driver_shape property of this CreateApplicationDetails.
driver_shape_config (oci.data_flow.models.ShapeConfig) – The value to assign to the driver_shape_config property of this CreateApplicationDetails.
execute (str) – The value to assign to the execute property of this CreateApplicationDetails.
executor_shape (str) – The value to assign to the executor_shape property of this CreateApplicationDetails.
executor_shape_config (oci.data_flow.models.ShapeConfig) – The value to assign to the executor_shape_config property of this CreateApplicationDetails.
file_uri (str) – The value to assign to the file_uri property of this CreateApplicationDetails.
freeform_tags (dict(str, str)) – The value to assign to the freeform_tags property of this CreateApplicationDetails.
language (str) – The value to assign to the language property of this CreateApplicationDetails. Allowed values for this property are: “SCALA”, “JAVA”, “PYTHON”, “SQL”
logs_bucket_uri (str) – The value to assign to the logs_bucket_uri property of this CreateApplicationDetails.
metastore_id (str) – The value to assign to the metastore_id property of this CreateApplicationDetails.
num_executors (int) – The value to assign to the num_executors property of this CreateApplicationDetails.
parameters (list[oci.data_flow.models.ApplicationParameter]) – The value to assign to the parameters property of this CreateApplicationDetails.
pool_id (str) – The value to assign to the pool_id property of this CreateApplicationDetails.
private_endpoint_id (str) – The value to assign to the private_endpoint_id property of this CreateApplicationDetails.
spark_version (str) – The value to assign to the spark_version property of this CreateApplicationDetails.
type (str) – The value to assign to the type property of this CreateApplicationDetails. Allowed values for this property are: “BATCH”, “STREAMING”, “SESSION”
warehouse_bucket_uri (str) – The value to assign to the warehouse_bucket_uri property of this CreateApplicationDetails.
max_duration_in_minutes (int) – The value to assign to the max_duration_in_minutes property of this CreateApplicationDetails.
idle_timeout_in_minutes (int) – The value to assign to the idle_timeout_in_minutes property of this CreateApplicationDetails.

application_log_config¶

Gets the application_log_config of this CreateApplicationDetails.

Returns:	The application_log_config of this CreateApplicationDetails.
Return type:	oci.data_flow.models.ApplicationLogConfig

archive_uri¶

Gets the archive_uri of this CreateApplicationDetails. A comma separated list of one or more archive files as Oracle Cloud Infrastructure URIs. For example, oci://path/to/a.zip,oci://path/to/b.zip. An Oracle Cloud Infrastructure URI of an archive.zip file containing custom dependencies that may be used to support the execution of a Python, Java, or Scala application. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

Returns:	The archive_uri of this CreateApplicationDetails.
Return type:	str

arguments¶

Gets the arguments of this CreateApplicationDetails. The arguments passed to the running application as command line arguments. An argument is either a plain text or a placeholder. Placeholders are replaced using values from the parameters map. Each placeholder specified must be represented in the parameters map else the request (POST or PUT) will fail with a HTTP 400 status code. Placeholders are specified as Service Api Spec, where name is the name of the parameter. Example: [ “–input”, “${input_file}”, “–name”, “John Doe” ] If “input_file” has a value of “mydata.xml”, then the value above will be translated to –input mydata.xml –name “John Doe”

Returns:	The arguments of this CreateApplicationDetails.
Return type:	list[str]

class_name¶

Gets the class_name of this CreateApplicationDetails. The class for the application.

Returns:	The class_name of this CreateApplicationDetails.
Return type:	str

compartment_id¶

[Required] Gets the compartment_id of this CreateApplicationDetails. The OCID of a compartment.

Returns:	The compartment_id of this CreateApplicationDetails.
Return type:	str

configuration¶

Gets the configuration of this CreateApplicationDetails. The Spark configuration passed to the running process. See https://spark.apache.org/docs/latest/configuration.html#available-properties. Example: { “spark.app.name” : “My App Name”, “spark.shuffle.io.maxRetries” : “4” } Note: Not all Spark properties are permitted to be set. Attempting to set a property that is not allowed to be overwritten will cause a 400 status to be returned.

Returns:	The configuration of this CreateApplicationDetails.
Return type:	dict(str, str)

defined_tags¶

Gets the defined_tags of this CreateApplicationDetails. Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {“Operations”: {“CostCenter”: “42”}}

Returns:	The defined_tags of this CreateApplicationDetails.
Return type:	dict(str, dict(str, object))

description¶

Gets the description of this CreateApplicationDetails. A user-friendly description. Avoid entering confidential information.

Returns:	The description of this CreateApplicationDetails.
Return type:	str

display_name¶

[Required] Gets the display_name of this CreateApplicationDetails. A user-friendly name. It does not have to be unique. Avoid entering confidential information.

Returns:	The display_name of this CreateApplicationDetails.
Return type:	str

driver_shape¶

[Required] Gets the driver_shape of this CreateApplicationDetails. The VM shape for the driver. Sets the driver cores and memory.

Returns:	The driver_shape of this CreateApplicationDetails.
Return type:	str

driver_shape_config¶

Gets the driver_shape_config of this CreateApplicationDetails.

Returns:	The driver_shape_config of this CreateApplicationDetails.
Return type:	oci.data_flow.models.ShapeConfig

execute¶

Gets the execute of this CreateApplicationDetails. The input used for spark-submit command. For more details see https://spark.apache.org/docs/latest/submitting-applications.html#launching-applications-with-spark-submit. Supported options include --class, --file, --jars, --conf, --py-files, and main application file with arguments. Example: --jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10 Note: If execute is specified together with applicationId, className, configuration, fileUri, language, arguments, parameters during application create/update, or run create/submit, Data Flow service will use derived information from execute input only.

Returns:	The execute of this CreateApplicationDetails.
Return type:	str

executor_shape¶

[Required] Gets the executor_shape of this CreateApplicationDetails. The VM shape for the executors. Sets the executor cores and memory.

Returns:	The executor_shape of this CreateApplicationDetails.
Return type:	str

executor_shape_config¶

Gets the executor_shape_config of this CreateApplicationDetails.

Returns:	The executor_shape_config of this CreateApplicationDetails.
Return type:	oci.data_flow.models.ShapeConfig

file_uri¶

Gets the file_uri of this CreateApplicationDetails. An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

Returns:	The file_uri of this CreateApplicationDetails.
Return type:	str

freeform_tags¶

Gets the freeform_tags of this CreateApplicationDetails. Free-form tags for this resource. Each tag is a simple key-value pair with no predefined name, type, or namespace. For more information, see Resource Tags. Example: {“Department”: “Finance”}

Returns:	The freeform_tags of this CreateApplicationDetails.
Return type:	dict(str, str)

idle_timeout_in_minutes¶

Gets the idle_timeout_in_minutes of this CreateApplicationDetails. The timeout value in minutes used to manage Runs. A Run would be stopped after inactivity for this amount of time period. Note: This parameter is currently only applicable for Runs of type SESSION. Default value is 2880 minutes (2 days)

Returns:	The idle_timeout_in_minutes of this CreateApplicationDetails.
Return type:	int

language¶

[Required] Gets the language of this CreateApplicationDetails. The Spark language.

Allowed values for this property are: “SCALA”, “JAVA”, “PYTHON”, “SQL”

Returns:	The language of this CreateApplicationDetails.
Return type:	str

logs_bucket_uri¶

Gets the logs_bucket_uri of this CreateApplicationDetails. An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

Returns:	The logs_bucket_uri of this CreateApplicationDetails.
Return type:	str

max_duration_in_minutes¶

Gets the max_duration_in_minutes of this CreateApplicationDetails. The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

Returns:	The max_duration_in_minutes of this CreateApplicationDetails.
Return type:	int

metastore_id¶

Gets the metastore_id of this CreateApplicationDetails. The OCID of OCI Hive Metastore.

Returns:	The metastore_id of this CreateApplicationDetails.
Return type:	str

num_executors¶

[Required] Gets the num_executors of this CreateApplicationDetails. The number of executor VMs requested.

Returns:	The num_executors of this CreateApplicationDetails.
Return type:	int

parameters¶

Gets the parameters of this CreateApplicationDetails. An array of name/value pairs used to fill placeholders found in properties like Application.arguments. The name must be a string of one or more word characters (a-z, A-Z, 0-9, _). The value can be a string of 0 or more characters of any kind. Example: [ { name: “iterations”, value: “10”}, { name: “input_file”, value: “mydata.xml” }, { name: “variable_x”, value: “${x}”} ]

Returns:	The parameters of this CreateApplicationDetails.
Return type:	list[oci.data_flow.models.ApplicationParameter]

pool_id¶

Gets the pool_id of this CreateApplicationDetails. The OCID of a pool. Unique Id to indentify a dataflow pool resource.

Returns:	The pool_id of this CreateApplicationDetails.
Return type:	str

private_endpoint_id¶

Gets the private_endpoint_id of this CreateApplicationDetails. The OCID of a private endpoint.

Returns:	The private_endpoint_id of this CreateApplicationDetails.
Return type:	str

spark_version¶

[Required] Gets the spark_version of this CreateApplicationDetails. The Spark version utilized to run the application.

Returns:	The spark_version of this CreateApplicationDetails.
Return type:	str

type¶

Gets the type of this CreateApplicationDetails. The Spark application processing type.

Allowed values for this property are: “BATCH”, “STREAMING”, “SESSION”

Returns:	The type of this CreateApplicationDetails.
Return type:	str

warehouse_bucket_uri¶

Gets the warehouse_bucket_uri of this CreateApplicationDetails. An Oracle Cloud Infrastructure URI of the bucket to be used as default warehouse directory for BATCH SQL runs. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

Returns:	The warehouse_bucket_uri of this CreateApplicationDetails.
Return type:	str