You are on page 1of 35

I N D I A | M A Y 2 5 - 2 6 , 2 0 2 2

D1MOD109

SPOT BY NETAPP

Best practices for optimizing


cloud services

Amiram Shachar
CEO & Co-founder
Spot by NetApp

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why Spot by NetApp

Rapid adoption of public cloud This has overburdened This slows cloud adoption and
has led to higher costs, operations teams, tools, and prevents the realization of the
complexity, and inefficiency manual processes full benefits of cloud

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is Spot by NetApp

A suite of products for automating and


optimizing cloud infrastructure

Ocean Insights helps reveal:


• Continuous cost optimization that reduces
cloud compute costs by up to 90%
• Automation that reduces infrastructure
operations burdens by up to 85%
• To help operations teams deliver, manage,
and scale infrastructure for cloud
applications and workloads

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Our vision for CloudOps

DevOps SecOps
Delivery and optimization for cloud Security and governance for cloud
applications operations

CloudOps

FinOps PC Ops
Cost management and continuous Solution for delivering enterprise-ready
infrastructure optimization cloud desktops as a service

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Product portfolio for CloudOps

FinOps DevOps SecOps PC Ops

Containers

Virtual machines

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DevOps
Containers Virtual machines

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Elastigroup | Multi-cloud infrastructure optimization
Auto-scaling group on steroids, powered
by machine learning to utilize spot
instances with SLA

Optimize costs with SLA


Reliably leverage excess cloud capacity to
optimize cost and save up to 90% on compute
infrastructure across all major cloud providers.

Simplify operations
Scale, manage, and accelerate workloads without
the complexity and risk of manually managing
your infrastructure.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Elastigroup
Intelligent traffic routing Predictive scaling and rebalancing Infrastructure
Balanced distribution and Predictive infrastructure scaling and proactive provisioning and pricing
load-balancing of inbound detection of Spot VM interruptions ensure AI-driven selection and
traffic across varied instance highly available and fully utilized compute predictive rebalancing of all
types and sizes guarantees infrastructure. cloud pricing models–spot,
optimal workload on demand, and reserved
performance and capacity–deliver maximum
infrastructure utilization. cost efficiency with an
enterprise-level SLA.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Elastigroup | Multi-cloud infrastructure optimization
Prediction is the key
Elastigroup predicts spot-instance behavior, capacity
trends, pricing, and interruption rate.

Up to 90% cost optimization with SLA


By predicting interruptions and fluctuations,
Elastigroup is able to proactively rebalance clusters
to prevent interruption.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use case summary

Load balanced applications Jenkins Runners Stateful applications


(Elasticsearch, Dev machines)

Spinnaker deployed Batch jobs and big data Anything running on an AWS
applications Auto Scaling group

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ocean: Serverless computing service
Run containers without provisioning or managing VMs
Deploy your containers via kubectl or favorite CI/CD pipeline – Ocean does the work to execute and
scale your containers with high availability, high performance, and at low cost.

Without Ocean

Build a Define & deploy Provision & manage compute, Run & manage both Pay for used and
container image infrastructure memory and storage resources applications and infrastructure idle infrastructure

With Ocean

Build a Deploy Run and manage Pay only for


container image applications applications what you use

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ocean | Run containers without managing servers
Infrastructure Pod-driven auto scaling Continuous pods
provisioning and pricing and advanced bin packing right-sizing
Intelligent selection of Instance size, type, pricing, and allocation is Ocean monitors and
compute pricing models determined based on pod/container analyzes container
(spot, on demand, and resource specifications while honoring labels, utilization and modifies
reserved instances) with an taints, tolerations, network, and storage their resource requests for
enterprise-level SLA and requirements. performance in runtime, at a
predictive cluster rebalancing low cost.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Extending Ocean to big data

• Spark jobs autotuning


• Spark autoscaling Spark-driven optimization, operations automation,
• Spark monitoring simple UI and integration with popular frameworks
• Integration with Jupyter,
Airflow
like Jupyter and Airflow

• Compute pricing optimization


• Provisioning automation
+
• Kubernetes infrastructure Cloud automation and optimization that delivers
autoscaling serverless Apache Spark at 80% less
• Pods bin packing
• Pods right-sizing
• Spark jobs-cost showback

Public cloud

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless Spark on Kubernetes
Infrastructure Spark-aware infrastructure autoscaling Resource
provisioning and Automation of instance size, type selection right-sizing and
pricing based on the Spark jobs specifications, while monitoring
Automate cloud honoring network and storage requirements.​ Continuously tuning Spark
infrastructure pricing configuration for recurring
selection for compute jobs based on runtime
across spot, on demand, outputs (memory shuffle,
and reserved instances; CPU allocation, disk types,
powered by an ML and parallelism
prediction technology configurations).
to provide enterprise-
level SLA for cost
savings and high
performance.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deployment
Ocean Apache Sark
Spot Console
Ingress Spark Wave
History server
controller operator operator

Driver pod

User Driver StorageSync (Sidecar)

spark-submit
Executor pod Executor pod

Executor Executor
spark.yaml

Amazon EKS +

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ocean Insights
Read access to any kubernetes
cluster that will analyze and present
details on cluster efficiency,
potential performance, and cost
optimizations.

Ocean Insights helps reveal:


• Overprovisioning
• Unscheduled pods
• VM and pod right-sizing visibility
• Distribution of Spot by
NetApp®/reserved/on-demand cost
structures
• Clear potential pricing

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ocean Continuous Delivery
Full stack visibility Deployment engine Continuous verification
Understand application Simple to implement Automatic deploy, run and
health from service to server. canary and blue/green rollback based on SLOs.
deployments.​

Amazon

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Taking CD automation & kubernetes to the next level

Deploy Gradual Continuous


Build Test Detection
preparation deployment verification

CI CD

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
FinOps

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CloudCheckr

NetApp announces agreement to acquire


CloudCheckr to expand
Spot by NetApp FinOps suite

Cloud management platform to


optimize cost, security, and governance
• Comprehensive billing analytics
• Comprehensive security analytics
• Platform to support needs of enterprises
and managed service providers

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Eco | Continuous reserved capacity management

Intelligent RI and Savings Plans


lifecycle automation

Managed RI Lifecycle
Comprehensive analysis of compute workloads, RI
buying and selling in the AWS Marketplace is
automated to ensure your workloads are running
at optimal pricing.

Finance & DevOps synergy


With full visibility into compute consumption and
automation of optimal RI and savings-plans
strategies, finance and DevOps teams can easily
collaborate on managing cloud cost.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Eco | Marketplace and prediction
Reserved-instance marketplace
With hundreds of accounts and hundreds of
thousands of reserved instances under management,
Eco can quickly match customers who have
immediate needs to buy and sell reservations on the
marketplace, acting as a perfect broker.

Forecast powered by machine learning


As smart as a human can be, forecasting cloud
commitment in an increasingly complicated cloud
environment is inefficient, even when using the best
reporting tools out there.

Eco continually analyzes millions of data points


to identify the makeup of your ideal RI fleet.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Eco | Autonomous efficiency
No engineering effort
Reserved instances are a billing construct, engineers
don’t have to change anything about the compute or
applications they use today. Once enabled, Eco will
continually track usage, as well as build forecasting
models to constantly manage the lifecycle.

Diversify commitment
Eco acts as an RI broker, utilizing the marketplace
to mix and match commitment lengths from 2-36
months to optimize utilization while maximizing
flexibility.

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Eco | For MSPs & Enterprises

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spot Security
Removes friction between security
and DevOps teams
• Providing clear visibility
• Prioritized actions through
relationship analysis of cloud usage
Makes DevSecOps reality
• Spot Security automation works with
the same toolsets and pipelines
DevOps teams use today
Utilizes cloud-resource
relationships
• Understand the exposure of each
cloud resource
• Analyze events and configuration
• Reduces noise and surfaces the most
critical security threats by the
potential impact to your business
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spot Security | Approach
Full cloud visibility AI-driven security Customizable and
Visualize cloud platform assessment​ intelligent remediation
utilization, configuration, Identify anomalies and drift Prioritize action with clear
network communications and with a detailed, organization and reporting into incident
access for both containerized account-level risk analysis. severity and impact, along
and non-containerized with guided remediation for
workloads. ​ full compliance and
comprehensive security.

Data input
• Cloud API
• Network traffic
• User activity

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spot Security | Features & functionality

Visibility Analysis Detection


● Cloud asset inventory ● Misconfiguration ● Threat detection
● Integrated threat assessment ● Resource exposure
dashboard ● Continuous compliance ● Possible/potential threats
● Data visibility and monitoring ● Post compromised-
classification ● Inventory correlation patterns detection
● Intelligent alerting ● Access origins
● Shadow IT monitoring ● Anomaly detection for
● NetApp® Cloud Services: atomic events, advanced Action
resource and network event-sequence
forensics interpretation ● Guided remediation
● Service maps ● Identify and remove ● Automated remediation
weak/duplicate policies ● Enforce compliance

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PC Ops

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spot PC | Enabling Cloud Desktops as a Service

Fully managed 50% more cost effective Secure


● Simple onboarding and ● Spot by NetApp ● Admin and user identity
migration included–data, optimization yields pricing and access integrated with
apps, and users at 50% less than Microsoft security
● Day 2+ admin tools for competitive solutions, framework
partner and customer lower than DIY ● Complete solution,
admins to expedite partner/MSP enabled
management tasks ● Includes data layer, data
protection, application
management, and real-
time session observability

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Give your workloads the
cloud infrastructure they deserve

Always available
Always scalable
Always at low cost

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Stay connected!
https://www.facebook.com/spothq

https://www.linkedin.com/company/spothq/

https://twitter.com/spot_by_netapp

https://www.youtube.com/c/Spotinstances

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Please complete
the session survey

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!
Tomer Hadassi
Head of Strategy
Spot by NetApp

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.

You might also like