Data Flow Dependency Packager Release Notes
Learn about the changes in each release of the third-party dependencies packager.
Release 2.4.0
- Released: Apr 19, 2024
- Upgrade Python version to 3.11.
- Upgrade pip to latest for Python 3.11.
- Support Multi Architecture Manifest build for both
arm64
andamd64
. - Backward compatible to previous Spark version archiver for the supported python versions.
Release 2.3.1
- Released: Jun 08, 2023
- Upgrade pip to latest for Python 3.6 and 3.8.
- Install
python-devel
package for Python 3.8. - Support Multi Architecture Manifest build for both
arm64
andamd64
.
Release 2.2.0
- Released: Mar 24, 2022
- Release
dependency-packager:2.2.0 at phx.ocir.io/oracle/dataflow/dependency-packager:2.2.0
and tag as latest. - Support option
--validate <archive_file>
to validate archive file locally.
Release 2.1.0
- Released: Feb 19, 2022
- Release
dependency-packager:2.1.0 at phx.ocir.io/oracle/dataflow/dependency-packager:2.1.0
and tag as latest. - Add support of Python 3.8.11 for dependencies. Must specify Python version (3.6 or 3.8) using the
-p
option in therequirements.txt
file.
Release 2.0.0
- Released: Nov 07, 2021
- Major change that uses the Ivy resolver from
spark-core
to download dependencies, instead of Maven. - Support
packages.txt
to be backward compatible with 1.0.x for Java applications. - Support
--packages
from thespark-submit
CLI to download dependencies. - Support
--exclude-packages
from thespark-submit
CLI to exclude certain dependencies.
Release 1.0.4
- Released: Oct 20, 2021
- Release
dependency-packager:1.0.4 at phx.ocir.io/oracle/dataflow/dependency-packager:1.0.4
and tag as latest. - Remove leftover pom file for Java application.
- Fix duplicate exclusion tag issue for dependency packager tool.
- Handle last line without newline for the
requirements.txt
file.
Release 1.0.3
- Released: Sep 21, 2021
- Release
dependency-packager:1.0.3 at phx.ocir.io/oracle/dataflow/dependency-packager:1.0.3
and tag as latest. - Handle packages that have no version information.
Release 1.0.2
- Released: Apr 06, 2021
- Release
dependency-packager:1.0.2 at phx.ocir.io/oracle/dataflow/dependency-packager:1.0.2
and tag as latest. - Reduce image size and install libraries from yum repository.
Release 1.0.1
- Released: Jan 06, 2021
- Release
dependency-packager:1.0.1 at phx.ocir.io/oracle/dataflow/dependency-packager:1.0.1
and tag as latest. - Remove
pip
,pip3
from generated thearchive.zip
file.