Run locally with container

Run interactive pyspark session

podman run -it -v ./:/opt/spark/work-dir spark:3.5.6-java17-python3 /opt/spark/bin/pyspark

Submit a pyspark app

podman run -it spark:3.5.6-java17-python3 \
  /opt/spark/bin/spark-submit \
  --conf spark.log.level=WARN \
  /opt/spark/examples/src/main/python/pi.py

Links