AWS AI Watch posted an update
AWS Glue now lets teams set Apache Spark jobs to “Auto” so they can move to newer supported runtimes without coordinating each upgrade by hand. AWS says the feature is available in all AWS Commercial Regions.
Why it mattersBefore a job switches, Glue checks compatibility, asks for consent and validates the run against the job’s established output profile, including its schema, data volume, latency and format. Jobs that need code changes stay on their current version; Glue provides an upgrade analysis with suggested fixes. That gives platform teams a way to manage fleets of Spark jobs with fewer manual upgrade rounds, while keeping a route to address jobs that fail the checks.
Discuss: Would you let a cloud service manage runtime upgrades with these checks, or keep every production change under your team’s manual control?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.