Skip to content

Releases: ogrodnek/spark-plug

Upgrade AWS Java SDK to support for EMR releases

11 Sep 17:16
Compare
Choose a tag to compare

Java SDK release 1.10.6 introduces support for "emr releases" detailed here:

https://docs.aws.amazon.com/ElasticMapReduce/latest/ReleaseGuide/emr-release-components.html

This changeset introduces the ability to spawn EMR clusters with emr-4.0.0, and also enables creating EMR clusters with Spark preinstalled.

  • Added an DSL for adding Applications to JobFlowRequests
  • Added a SparkStep dsl + test

Thanks pkallos !

1.2.4.2

24 Nov 21:00
Compare
Choose a tag to compare

Clean up bid pricing

1.2.4.1

24 Nov 21:00
Compare
Choose a tag to compare

basic VPC subnet support

1.2.4

28 Jul 22:52
Compare
Choose a tag to compare
  • No-args constructor for creating EMR client using default AWS credentials chain (rayo)

1.2.3

01 Jul 19:25
Compare
Choose a tag to compare

spark-plug 1.2.2

19 Feb 21:40
Compare
Choose a tag to compare
  • availability zone is now configurable
  • separate termination protection and keep-alive settings
  • support for EMR tagging