[Feature Request]: Define an expansion service jar for Delta Lake

[chamikaramj]

What would you like to happen?

For context, please see s.apache.org/beam-delta-lake-source.

Given that potential size of the transitive dependencies of the Delta Lake connector and due to needing Java 17, I suggest defining a new expansion service jar for this.

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Infrastructure
• Component: Spark Runner
• Component: Flink Runner
• Component: Prism Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[chamikaramj]

We need to either a new expansion service jar to support Managed Delta Lake source.

[derrickaw]

upgraded expansion service to use Java 17 to work with Delta Lake - #38931

[derrickaw]

I think this is done unless @chamikaramj you see a reason why we need to do this? Thanks

[chamikaramj]

We added Delta Lake IO to I/O expansion service instead: #39052

Closing this.