New Release for Data Integration
- Services: Data Integration
- Release Date: May 30, 2023
A new release for Data Integration is available.
You can now:
- Choose between a custom last extract date or a Data Integration managed date when loading incrementally from a BICC source.
- Use parameters for the source and target in a data loader task. You can:
- Parameterize the data assets, connections, and schemas or buckets.
- Parameterize the data entity when the load type is single entity.
- Reuse a source parameter as the parameter for a resource of the same type on the target.
- Reuse a target parameter as the parameter for a resource of the same type on the source.
- Create output as a single file for an Object Storage target in a data loader task when the load type is multiple entities.
- Change the merge key selection in an integration task at design time and runtime when the target data entity in the underlying data flow is parameterized and merge is set as the integration strategy. Subsequently, the merge key can also be updated:
- At pipeline design time when you use the integration task in a pipeline, and at runtime when you run the pipeline task.
- In task schedules that are created for the integration and pipeline tasks.
- Add design-time tasks to a pipeline, in addition to published tasks.
- Choose to skip validation of data asset connectivity when you publish a task to an application.
- See performance improvements in task runs associated with relational data systems that support pushdown.
For details, see Data Integration.