v2.0

Amazon Service Version: Amazon EMR Serverless (various EMR Releases available)

v2.0 represents a major enhancement of the single-tenant v1.0 product to a multi-tenant v2.0 product. This was achieved by standing up a new EMR Serverless managed product offering which multiple tenants can share.

Upgrade Steps

All jobs created on the FCS Data Processing Cluster v1.0 - EMR on EC2 should still work on EMR Serverless. However, tenants will want to work with the Cloud Advisory Team to arrange for provisioning of the EMR Serverless infrastructure and access.

Breaking Changes (Optional)

1. Custom libraries or configurations loaded directly on cluster EC2 linux servers will not be supported initially
2. Moving from 1.0 to 2.0 may yield a different EMR runtime version. Work with the FCS Data Products team to arrange a compatible migration.
3. Integrations with GitHub repositories are not yet supported.

New Features

1. Clusters will auto scale
2. Clusters will auto-terminate after job completion
3. IAM permissions can be arranged at a per-job level, to isolate what data the job has access to.

Bug Fixes

• None

Other Changes

• None