Application Parameters

If the Spark application requires one or more parameters at run time, then Data Flow lets you provide the parameter name and default value when you create the application.

For Java, Python, and Scala, during the application creation step, enter the parameter name in the Arguments field, enclose it in curly brackets and precede it with the $ symbol. For example:
${MyParameter}
After you provide the parameter name in the Arguments field, a Parameters section with two new fields appears below it. The fields are Name, and Default Value. The Name field isn't editable, and contains the name of your parameter. The Default Value field is editable, and you can enter a default value for the parameter. The default value can be over-ridden at execution time.
If you have more than one parameter, enter each of the parameter names one after the other in the Arguments field. Data Flow expects a space between each to define the argument values, but be careful, as the parameters are still parsed if you miss out the space. For example, if you have three parameters called Parameter1, Parameter2, and Parameter3, with values of Value1, Value2, and Value3, and enter them as follows:
${Parameter1}${Parameter2} ${Parameter3}
then the resulting argument provided to Data Flow, has only two values:
Value1Value2 Value3
which might not be what you want.

Each parameter has its own Name and Default Value fields.

For SQL applications, the parameter entry doesn't use the ${MyParameter} format. Instead, the Parameters section with a single Name text field and its corresponding Value field are present. Enter the name of the parameter and the default value in the corresponding field. If you need to add several parameters, click the +Add Parameters button.

Application Parameters when Running Applications

Application Parameters allow you to re-use your Data Flow Applications in a variety of different ways. See Run Applications for more information.