Skip to content

chore: fix PySpark 3.x dependencies / drop Kotlin subproj - #185

Merged
iobruno merged 3 commits into
masterfrom
fix/pyspark-3.x-deps
Jul 18, 2026
Merged

iobruno merged 3 commits into
masterfrom
fix/pyspark-3.x-deps

Conversation

@iobruno

@iobruno iobruno commented Jul 18, 2026 •

Copy link
Copy Markdown
Owner

Summary

  • Constrain the PySpark 3.x module to Python >=3.11,<3.12 (PySpark 3.5 compatibility)
  • Fix running instructions on README
  • Drop the unused Kotlin subproject and its reference in the top-level README

Test plan

  • uv sync inside module5-batch-processing/pyspark-3.x and confirm the venv resolves under Python 3.11
  • Run the spark-submit example from the updated README to confirm the corrected ../fhv_zones_gcs.py path works

@iobruno iobruno changed the title Fix PySpark 3.x module deps and drop Kotlin subproject chore: fix PySpark 3.x dependencies / drop Kotlin subproject Jul 18, 2026
@iobruno iobruno changed the title chore: fix PySpark 3.x dependencies / drop Kotlin subproject chore: fix PySpark 3.x dependencies / drop Kotlin subproj Jul 18, 2026
@iobruno
iobruno merged commit 388377a into master Jul 18, 2026
1 check passed
@iobruno
iobruno deleted the fix/pyspark-3.x-deps branch July 18, 2026 04:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant