1 of 15

Slide Notes

DownloadGo Live

Production

Published on Mar 16, 2016

No Description

PRESENTATION OUTLINE

Production

Photo by kevin dooley

Persistence

Photo by Peter Mooney

AKKA

  • Journaling
  • Snapshots
Photo by JoelMontes

SPARK

  • Checkpointing
  • Message Replay
Photo by m.joedicke

Hosting

Photo by Tom Raftery

Spark

  • Natively supported on EMR
  • Minimal Conf-Mgmt changes
Photo by Wakx

AKKA

  • Docker on CoreOS
  • Configured by CloudFormation
  • Best Practices
Photo by kirainet

DATA

  • HBase pre-installed
  • No new infrastructure
Photo by BobMical

AKKA

  • Etcd
  • Membership Events
  • Cluster routers
  • Fully elastic
Photo by Marc Samsom

SPARK

  • EC2 Tags
  • Etcd
  • Membership Events
Photo by Cast a Line

Deployment

Photo by Puzzler4879

Untitled Slide

  • Rolling cut-over used for all systems
  • Entire system treated as stateless
  • State restored after cut-over
  • Zero effective downtime
  • Independent layers
Photo by Theen ...

Next Steps

Untitled Slide

  • Everything prototyped
  • Change architecture
  • Implement persistence
  • Conf-Mgmt Changes
Photo by kevin dooley