Cloud Native Computing Foundation KubeCon + CloudNativeCon Europe 2021, 15 May 2021

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Sponsored Session: NetApp - Cloud Native Application-aware Data Management in multi-cloud

Description

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Sponsored Session: NetApp - Cloud Native Application-aware Data Management in multi-cloud

Speakers: Jaimon George, Diane Patton

In this session, you’ll learn about how to address application data management challenges that enterprises of all sizes adopting Kubernetes face today. Such challenges include protecting application data from accidental corruption, recovering applications from human-made or natural disasters, and being compliant with regulatory data residency needs when running and scaling your Kubernetes clusters in a multi-cloud environment.
We conclude this session with a demonstration that show how to:
Automate the backend storage configuration and provision persistent volumes when needed.
Manage your cloud native application and persistent data from multi-cloud Kubernetes clusters from a single pane of glass.
Easily snapshot, backup, clone and migrate applications with their data to another Kubernetes cluster.

A

Hi everyone thank you for joining our session and welcome to kubecon emea 2021, I'm diane patton, a technical marketing engineer here at netapp and with me, is jmon george who's. Also a technical marketing engineer. We support the kubernetes initiatives at netapp today we're going to talk a little bit about cloud native application, aware data management within multi-clouds.

A

So, as we all know, kubernetes originally started to support only stateless applications. But, as we all know, it's not just for stateless anymore. Many enterprises are starting to deploy kubernetes with more stateful applications, including databases, but there's a lot of challenges around how to deploy kubernetes with a stateful application.

A

And as we can see, enterprises are driving stateful application growth in kubernetes.

A

If we take a look at this survey here from cncf in 2020, we can see that approximately 55 percent of enterprises are running kubernetes with stateful applications, and this could include file workloads, ci cd pipelines, in addition to what we all think of stateful, which is databases, but there are some challenges around. This containers are very different, as we all know than vms right. The vms and applications are generally bound together, whereas containers were made the exact opposite way.

A

We don't want to bind those applications with the underlying os, and this makes it a little bit more challenging to be able to support applications. The way that we do in vms today. So again the containers could come and go, but those applications. We still need to be able to support and we need to be able to support their data in addition to snapshots and backing up and being able to allow those applications to have portability and disaster recovery if it's needed.

A

So these are some of the challenges that we know about with enterprise workloads in containers and to start off with there's data persistence.

A

We all know that kubernetes, one of the main features of kubernetes is ability to scale up and scale down and with that we're able to go ahead and destroy and redeploy pods, but the problem with that is. If we've got underlying data, we don't want to destroy the data along with the pod. So we need to look at that storage persistence within kubernetes.

A

We need to make sure that those volumes on those pods, even if the pot is destroyed, that volume is still available for when a new pod gets deployed, perhaps on a different worker node, and this is also why it's very important to look at things like your access modes right, your rwo read, write once only allows access to a volume from one worker node.

A

What would happen if, on a specific deployment, you have a pod that gets destroyed and gets redeployed on another worker node, for example, or you do a rolling upgrade- is another good example. In that case, you might need to have access to that volume from more than one pod.

A

So one of the things you might want to look into is the ability to run something like nas, for example, in order to be able to support those rolling upgrades or the ability to be able to move dynamically um re, deploy that pod on a different worker node and still have access to that underlying volume.

B

So, along with the persistent um storage need, we also need to think about how do we bring that aspect into hybrid multi-cloud experience right? So you can't have the similar experience wherever you go, it can be within the cloud or across the cloud, or maybe you want to do the same experience even in on-prem. That is very important when we do kubernetes workloads. Another important fact to think about it. You know, especially when I, when we talk about multi-cloud there, isn't a big aspect of application, migration or application movement between them right.

B

So traditionally we all thought about you know, container workloads or kubernetes workloads can be moved anywhere easily. That was well true for stateless application, but when it comes to stateful application as many of our enterprise customers are actually running the production workloads, it's not that easy anymore. There's a lot of things we need to understand.

B

How do I move my application and its data from one kubernetes cluster to another kubernetes cluster that can be within the cloud across the cloud or from on-prem to cloud.

B

We need to understand how an application has been constructed in kubernetes compared to how we do that in a typical bare metal or a virtualized environment. That's what we think kubernetes require the application awareness to do that job for you. If you look at the virtualized application, all the configuration was with the vm itself, but now with kubernetes all the application metadata, which we call kubernetes objects, are actually constructed along with the application.

B

So if you look at the application, config maps secrets stateful set the system volume claims, we all need to understand how it's been actually created and configured within the capabilities. When we actually migrate the application you should able to migrate the configuration its data and the application state. That's an important part of migrating application between multi-cloud and others. Otherwise, what we end up doing we get the data and you manually have to copy over all these kubernetes objects, which is not practical.

B

So when we think about the real-time use cases, we should have a way to automate that and get your kubernetes data applications and its objects into the destination faster right.

A

And we want to be able to take a look at that application and view everything as one whole application right. We want to take all those kubernetes objects, the pvs, all of that and be able to manage all of that together as one entity.

B

Another thing I diane I want to add here: is you know no matter if your application is running in containerized, form or traditional way in virtualized or bare metal, the data is important. The data cannot be corrupted or lost, even when you are in kubernetes right, that's an important part for any business.

B

The next thing we need to think about is what is my business continuity model right right now. You know I'm getting fantastic features of kubernetes. Now, I'm I'm in kubernetes. But how do I? How do I continue my business even when there is a disaster right? So what is my strategy along with it? These are the things it's very key um aspect before even thinking about migrating application to kubernetes or running application in kubernetes, and there may be aspect of it that you know there is a need of. You know large compute requirement right.

B

So how do I? How do I get into that kind of situation right? If, if my data center is out of my capabilities to provide enough compute? What do I do to get my compute needs within a short amount of time? That's where customers may look into migrating the app from on-prem to cloud or one cloud to another cloud. Even maybe they have another data center that have more capabilities to run this kind of applications. They are actually thinking about. How do I get my application from data center one to data center? Two?

B

What are the strategies? I have to do that if, when I need it, and especially some of the enterprise customers, have a strategy of running application in one data center for two months, the same data application needs to be run in another data center. They call location or vr in the next two months.

A

Exactly so, we need to have that ability to be able to take whatever application that we're running, be it on-prem or in a cloud and be able to run that same application, along with its data in another cloud or moving again between on-prem and the cloud and back and of course, we'd like to be able to do all of this with one easy type of uniform experience.

B

There is more solution out there to address the challenges we've gone through here so far, and diane is going to walk you through how we are addressing that challenges for our customers in netapp.

A

Thanks jamon, so, as jim was mentioning, we've been talking about multi-cloud and the ability to manage workloads on different clouds. All is one experience, so this is the dashboard of astra, as we were talking about where it shows that it's managing two applications and three different clusters. So if we look at those clusters, we can see, astra has a cluster registered in azure and it also has two clusters registered in gke.

A

They are managed from the same interface. So, looking at the cluster running on aks, we can see the aks nodes, the pvs from that cluster, the storage classes that trident installed and the csi provisioner and storage classes. If we take a look at one of the gke clusters, we can see very similar information.

A

The storage, the storage classes that astra installed are also there. So again, it's a consistent experience between the gke as well as the aks.

A

So if we take a look at the apps now we can see the apps being managed using wordpress as an example in this case, so we have a wordpress instance running on azure and another instance running in gke. So if we look at azure in the data protection, we can see that we've got a snapshot already there and if we take a look at the backups, there's also a scheduled backup, that's been taken and we can configure the configure the protection policy.

A

However, we want next we go to storage, we can see the pvs and all of the resources that are being managed along with this application.

A

And then, if we go ahead and take a look at the one on gke, we can see a very similar setup where we've got the data protection. However, we want to set that up. We can do that again, snapshots and backups.

A

We can configure it. If we want, we can go to the storage, we can see the pvs and all the resources that are being managed by astra together. So again, it looks exactly the same as what we just saw with aks.

A

So next we'll take a look at wordpress, which is actually currently installed on the gke cluster, and we can see that we have a blog here so moving back to astr, then at this point we're going to go to that specific application, which is the wordpress on gke and we're going to clone it. So we just do the drop down and hit clone.

A

We go ahead and we fill in the clone details we'll just use clone, so we can keep it straight, which is which the destination compute cluster that we want and then we just confirm it and we hit and it starts cloning. So after a few minutes, the clone has been completed and if we go ahead and click on that clone we'll see. All of those resources have been copied to that new cluster. This pvs are there the data protection. We can go ahead and set up our own protection policy on that new clone.

A

If we would like and then we'll go over to that services in ingress and we're just going to grab the ip address of the new load balancer, so we can go ahead and log into that, and we can see that all of that content that was on that original cluster has now been copied over to that new cluster.

A

And look: we can still see mr fluffy pants now, so we have shown the ability to be able to migrate that application between one cluster and another cluster and have the same user experience between different clouds. So thank you for watching. We hope this was very informative. Come by our virtual booth, we'd love to hear from you and enjoy the rest of kubecon.

A