.Net Foundation On .NET, 11 Jun 2018

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Microservice Architecture with ASP.NET Core

Description

Having a solid architecture is an essential piece for ensuring the longevity of your software.

In this episode Cesar De la Torre Llorente (@cesardelatorre) comes on the show to talk about ASP.NET Core application architecture for microservices and containers.
•[T01:06] - Introducing the .NET application architecture website
•[T05:23] - Running the reference application
•[T06:33] - Understanding the target audience
•[T07:35] - Testing strategy
•[T09:11] - Exploring the technology stack
•[T13:25] - Managing the weight of the API gateway
•[T16:35] - Adopting the guidance
•[T21:33] - Communication patterns between microservices
•[T22:36] - Modeling challenges with microservices
•[T26:14] - Getting help with the reference application

To learn more about some of the topics discussed in this episode, take a look at the links below.
•GitHub repository for eShopOnContainers: https://github.com/dotnet-architecture/eShopOnContainers
•.NET Microservices - Architecture e-book: https://docs.microsoft.com/en-us/dotnet/standard/microservices-architecture/?WT.mc_id=ondotnet-channel9-cephilli
•.NET Application Architecture Guidance: https://www.microsoft.com/net/learn/architecture?WT.mc_id=ondotnet-channel9-cephilli
Get your questions answered on the Microsoft Q&A for .NET - http://aka.ms/dotnet-qa
Learn .NET with free self-guided learning from Microsoft Learn: http://aka.ms/learndotnet

A

Okay on today's episode of the on dinette show we're here with cesare and.

A

We're gonna be talking about micro-services architecture with asp.net.

A

Core you'll definitely want to check it out.

A

Welcome to another episode of the on net show today we're gonna be talking about.

A

Microservices and architectural patterns with cesare della torre right yeah, so.

A

How do you quickly introduce yourself and then we'll get into the topic yeah.

B

So um I work as p.m. in the dartmouth team yeah, and my focus is most of all.

B

About dog net application architecture, guidance, reference applications and.

B

Provide that through ebooks technical ebooks and on those applications and.

B

Also in this kind of events, yeah yeah we're teammates right. I think we've.

A

Worked together for what six or seven years or something like that longer in.

A

Here, yes, at microsoft, yeah well, microsoft, it's been 11 years.

B

Ok, but in in def day, if it's gonna be yeah six years almost yeah exactly.

A

Yeah, so how about you tell me about this, the site that you have up right now. I.

A

Think this is kind of the homepage for your guys right, yeah, so being we've been.

B

Working on these for quite some time, yeah- it's not just about micro services,.

B

So we we created a aside about.net application architecture, as you can see.

B

Here there are multiple areas about mobile applications for windows, apps for.

B

Regular web applications but modern with asp.net core the cloud with uh sure how.

B

To modernize with windows containers your existing apps- and this is the area.

B

That we are focusing today, which is about micro services, architecture and.

B

Darker containers, so if you, if you go to the microsoft.net side, then you you.

B

Click on the architectural link you'll get here- and this is the the area that.

B

We're going to be talking about so we have a very extensive book about micro.

B

Services that I wrote and then a reference application, videos and so on.

B

So, for instance, the e-book is, you can download it for free. It's a deep content.

B

About micro services like around 300 pages, so the first section is about.

B

Architecture patterns, and so you could really like this first 70 pages just to.

B

Know about what is that, and then the rest of the book is about the.

B

Implementation with dotnet core so depending on how deep you want to go and.

B

That the cool thing is that it's not just this content, it's also related to a.

B

Reference application that we have in github, so it's called a shop on.

B

Containers it's a shop because we just wanted to find like a very well-known.

B

Domain developers, it doesn't we're not trying to create our reference about.

B

E-Commerce, this is just about to learn micro services and docker containers, but.

B

You can see it's been pretty successful like we yeah, we have like 2004 almost.

B

6000 stars a lot of people watching it and then here you can see that you can.

B

Run these kind of in two levels, if you are just trying containers, you can run.

B

Everything in your laptop, like here just with this a studio or even the cli and.

B

Just docker for windows and everything we run all the containers will will.

B

Deploy like I write, I have it now here in business studio and then all the.

B

Containers like if I do docker ps, you see all the micro services and.

B

Containers running locally and even the infrastructure is being deployed.

B

Automatically so we are deploying a sequel container, redis container.

B

Rabbitmq for 10 bars everything even a mongodb everything running locally and.

B

You just need to to hit at 5:00 in visual studio, and everything will get.

B

Downloaded all the images pull down and everything will run that's kind of the.

B

First step, but then you can also move ahead and if you're thinking about a.

B

Production environment, then you can swap things like, for instance, instead of a.

B

Sequel container, you will move to a sequel database cynosure.

B

Or instead of a mongodb container, you move well not document eb christmas db.

B

Now, instead of rabbit and q for messaging, you use service, vos and, and so.

B

On right is cache and so on, so we have all that in place. All the code ready you.

B

Just need to put your your sequest, your kids, and instead of deploying on a.

B

Regular docker container, you would deploy in a scaleable orchestrator.

B

Either a ks with kubernetes or service fabric as well. That's kind of the.

B

Summary and here you can see the architecture where we have three clients.

B

Client apps, we have a summary nap: regular mvc application, angular single.

B

Page application and then multiple micro services, all of them autonomous.

B

Independent with their own data, ipa gateways and so on right. So, if I take.

A

This application kind of get familiar with it on my machine potentially make.

A

Some changes to it just to kind of get a sense of what it means to make changes.

A

In multiple kind of parts of the architecture, once I get there, then it's.

A

You know and say I have an azure subscription already. What I'm hearing is.

A

It's relatively straightforward to yeah, going to ploy that to azure and then.

A

Actually have that you know at some point I'd pretty mess the self.

A

Certificate somewhere, and it would just like appear like a real application in.

A

The cloud yeah yeah, first of all, you don't need a sure. You know in order just.

B

To test it in for sure in literacy, but then you can move to usher and undo it.

B

Pretty easily it's not just a code, we also create here in the wiki, all the you.

B

Know, procedures on how to set this up with a visual studio or even with anna.

B

Mac and cli, or how to deploy these in in iks or service fabric. And you know all.

B

The details that you need to do step by step well looks like a lot of content.

A

Now, can you tell me about the type of like who do you, what kind of customers.

A

Do you talk to you believe our using this content is.

A

There any kind of clustering there yeah I mean it could be any industry, but.

B

Microservices is not kind of the silver bullet, so it's not for any kind of.

B

Application so more than any type of customer I mean yeah, it could be.

B

Enterprise customers could be isley's, but most of all we're talking about.

B

Large applications and that also need to evolve in the long term and potentially.

B

Or probably, in each area like one area per microservice, you want to evolve that.

B

Independently now you have a one development team for this area. Another.

B

Development team for this area and then not just to deploy that independently or.

B

Work on that autonomously, because you deploy your micro servers, you deploy.

B

Your database related to that, and it shouldn't impact as much as when you.

B

Have a monolithic application right so here I ask you the hard question: what is.

A

Testing look like in this kind of model. You know, do you have you know fairly.

A

Focused unit tests for each one of these systems and call it good. I assume not.

A

Like what? What does the testing strategy like, so, we basically have kind of three.

B

Levels of testing would be unit tests per micro service yeah, and then we have.

B

Integration tests, so that would be taken into account data and all those things.

B

That are not just your code and, finally, what we're calling functional tests and.

B

That would be taking into account the whole system, so let's say I do a create.

B

An order from the ui that is coming through the api gateway, and then this is.

B

Coming to one or two micro services in that whole execution would be a.

B

Functional test, and and for that you need to have the whole application.

B

Either in docker docker host or in indi orchestrator.

A

Sorry, what did you mean by that? Last part? You say you need the application in.

A

The docker host or doctor orchestrator or in the kubernetes.

B

Oh, I see I yeah because it's not like just running.

B

Unit tests with your code, you need the actual micro services or containers to.

B

Be up and running somewhere and then you run the tests. The integration test early.

B

Yeah makes sense- and you didn't say this but yeah tell me what exactly which.

A

Technologies used here, I assume you used. You know a bunch of asp.net core here.

A

And there and some xamarin mm-hmm, can you talk to that a little bit yeah well,.

B

From the client side, the mobile application is summer in forms, so it can.

B

Run on on android and ios and then the web applications, the single page.

B

Application is angular, but then in the server side it's nbc and the same thing for for the regular or traditional application. It's.

B

Mvc but all dot that code here is dotnet core. So it's cross-platform usefully by.

B

Default we are deploying into a linux docker host. You can also run it on a.

B

Windows, docker host and and then usually, we deployed into kubernetes also.

B

Internal linux right and then about the micro services. All these micro services.

B

Are asp.net core web api s and and then the api gateway? It's it's an op based on.

B

On ocelot, which is an open source project, especially made for api gateways,.

B

But you at the end of the day, you have like a nougat package and then you host.

B

That into web host asp.net core as well right now to remind us what is the so. I.

A

Think most people will understand what an api based micro service is and means.

A

What additional value does a gateway provide on top of those, because I think.

A

The applications are just touching: the gateway they're not actually touching.

A

The services themselves- yeah yeah, that's right so think about in this case this.

B

Is a kind of small, medium micro service based application, and we have like one.

B

Two three four: seven: eight nine like micro, service types and but even.

B

When, with 10 micro services, if you have to access those micro services directly.

B

From from the client apps, you will need all those urls from the client and but.

B

It's not just about the number of urls, it's also about even about security.

B

So you want to surface only the api is that the client applications need not.

B

The rest, so potentially you might have quite a few micro services in internal.

B

Api is that shouldn't be called directly from the outside, so basically the api.

B

Gateway is like a front-end for shot for your micro services, so you are.

B

Simplifying what the yeah that front-end of services to be consumed by the by the.

B

Client apps, no sorry yeah, and something else that I want to say is that's one.

B

Thing but then something that I I'm highlighting in the guidance is the fact.

B

That might not be good to have a single api gateway, because because then you.

B

Could be kind of breaking the autonomy of those micro services like if you are.

B

Deploying autonomously these micro service, but then every time you do.

B

Something here you need to change to change something in a monolithic api.

B

Gateway, then, that kind of api gateways is becoming the monolithic thing right.

B

Yeah, so that's why a good pattern is to have multiple api gateways. It could be.

B

Larger or smaller one pivot would be. What you see here. Bff is back in from.

B

For front end yeah, so you can create, or you can create kind of special api for.

B

The mobile apps, as you can see here, these two are specially made for the.

B

Mobile applications- and these two are especially made for the web apps, because.

B

You might need different api when you are talking from the mobile ap mobile.

B

App or the web application right, yeah and then the same thing could be about.

B

Areas like business or domain areas, so this is about the shopping area or the.

B

Marketing area in this case, because this is a small sample- we just have two.

B

Domains or areas, but you could have more right now. I could imagine a situation.

A

Where you build up these facades, which are these gateways and there's kind of.

A

This, I assume, maybe there's this tension between wanting to kind of aggregate.

A

Functionality which seems like it could be a good thing, but then also maybe the.

A

Gateway could get a little bit on the fat side and almost become a service on.

A

Its own, can you speak to that yeah yeah! That's a good point, because um in this.

B

Diagram, this is simplified and you can see just kind of the api gateway which.

B

At the end of the day, an api gateways is like a reverse proxy yeah, with single.

B

Url and then you, you are redirecting to or route into different internal.

B

Endpoints right but but then there's another well. You could have also cache.

B

Or authentication quite a few things in the api gateway, but the most important.

B

Thing is reverse proxy, but then the other thing is aggregation. Yeah. That's.

B

Where I was headed so the aggregation, so the less you put about logic or these.

B

Kind of things in they pay go gateways they better. It should be as thin as.

B

Possible but sometimes it's important to have an aggregation here, for instance,.

B

And especially for the mobile applications or even the single page application, which is remote if it is the mvc application, which is, you can see.

B

Here it's running within the same orchestrator same cluster because of the.

B

Latencies is smaller. Well, if I do a few calls here like two or three max.

B

Services, that's okay, yeah, but if you are talking to the server side from the.

B

Mobile app or from the browser in the single page application and let's say if.

B

You are loading a single screen or page, and you need to talk to three or four.

B

Different micro services, that would mean three or four http requests and that's.

B

Not going to be very optimal, well and also, I would imagine in many cases they.

A

Can't be made parallel because you're actually.

A

Using yeah, the output of one call to do to make the other one, so they have to be.

A

Sequential, so, that's why, if you see this other diagram, which is a little bit more.

B

Detailed that I have here in a you know deck. What is it? Well, I'm not sure if I.

C

Have it here now? Well, maybe here you can see? No, I don't.

B

Have it here, but in any case, what we also have is like in the case of the.

B

Shopping area, because we need to talk to a few microservices here we have an.

B

Aggregator container or api that for just some cases you do it a call from.

B

The mobile application, for instance, and then this one is talking to 2 or 3 micro.

B

Services and respond in just a single time, so that is optimizing. So it's not.

B

So chatty it makes sense okay, so it sounds like if people are really.

A

Interested in this, they can go to the website. They can read the books. That's.

A

Probably good for the type of person that really was just wants to build up a.

A

Mental model of what this whole space looks like and then they can kind of talk about it with some level of kind of authority and and context. And then we.

A

Also, have these github repos for people who want to kind of really dig in.

A

Experience it through visual studio, you know, step into code and and potentially.

A

Even deploy it somewhere to figure out what that looks like, I guess you have.

A

Any advice for someone who's good yeah I've been like you mean about.

A

Architecture or about apart adopting about adopting these samples yeah, but.

A

Most of them yeah, I can talk about two things. One would be about how to adopt.

B

All the samples or even the micro service architecture and then the other.

B

Thing we can talk about, maybe a little bit of patterns or anti patterns in.

B

Micro services, okay, the other thing I want to talk about so first thing on how.

B

To adopt this approach, I we really recommend not to start. You know.

B

Scratch and trying to do everything right the first time. So probably it's.

B

Better to start with something which is even monolithic where you are putting.

B

The logic and the business domain that you know and then you start splitting.

B

That into smaller pieces, but thinking about also that- and this is the most.

B

Important thing about micro services that each micro service has to own its.

B

Own data so and that's one of the most challenging things in micro services, so.

B

You shouldn't have just a single database or just a couple of databases.

B

And then a bunch of services, because then it's gonna be monolithic because of.

B

The data and well instead of a a process, you will have multiple processes, but.

B

That is not what my services mean yeah. It also makes a validation like your.

A

Risk level goes up quite a bit when you deploy a change and the data side of it.

A

Is being used through three things, then it's not gonna be true that you have out.

B

On almost deployment, because then it will be impacting the database right so.

B

In regards adoption, well, you can start with something which is monolithic and.

B

Then start splitting it or even adding new features as micro services, but each.

A

Micro service, with a new with its own data owned by it, like you, can see here.

B

Small data base per micro service in the diagram- that's one thing and another.

B

Thing is, if you use the api gateway pattern, that's an advantage for that.

B

Because from the client perspective you wouldn't know, if you, what do you have.

B

Inside, if you have like 100 micro services or just some monolithic web api.

B

Plus some other small micro services and little by little, you can evolve and.

B

Split up that monolithic api in other micro services, but from the client side.

B

You wouldn't notice it yeah. Well, you are refactoring that yeah. I think so. I first.

A

Read there was a blog post that I think netflix put out. I want to say, like four.

A

Years ago, or something like that- and I think that's where I first saw that bff.

A

Term- and I think that was the the approach that they took, was to infer.

C

From that ya, build up that gateway. First reap lat, the clients on top.

A

That gateway yep and then you have. Then you have the separation. You need and.

A

Then you kind of never have to talk to the clients again and then you do your.

A

Architectural, like you are kind of decoupling, your newer microservices from.

B

The client and then you can play with that yeah. That's one thing: the other.

B

Thing to me is the most important, like each micro service has to own its data.

B

Okay, that's one thing, but the other thing is and and this is a kind of.

B

Financial pattern that I've seen from many many developers or companies is.

B

That they start using micro services like if they were objects, and they start.

B

Kind of you talk to, or you do a request with one micro service and this one is.

B

Talking to another one and this one to another, one kind of long chains, yeah of.

B

Http, and that is really bad because at the beginning it's gonna work, but then.

B

It's gonna be in reality. What you're kind of building is like a monolithic, a.

B

Distributed monolithic right and the issue here, is that if you, if you start.

B

With having issues with one micro service or star, and it's going to slow.

B

It slowly down is gonna impact exponents on it, yeah just a pile of spaghetti. Yeah.

B

So yeah, I have one slide here which is pretty, and this is why it is also.

B

Important to or do you have, this yeah.

B

So this is what you shouldn't do like you have the klein app is talking to.

B

From the api gateway for let's say to a basket maker service, this one to another.

B

One another one and then respond in, but then, if that micro service is failing.

B

Then, or going slowly and think about thousands of http requests like that is.

B

Gonna be pretty bad or even if you, if you were using retries because sometimes.

B

You have like a very small problem with the network and these micro services.

B

Start giving a problem, then all the microphones are going to start free.

B

Trying and then you can cost like a denial of service to yourself to.

A

Yourself so so the the important thing is to really isolate or identify.

B

Autonomous boundaries, so each micro service should be purely independent.

B

From other micro services and and then if you need, because sometimes you might.

B

Have like kind of the same entity in multiple like a services data, so that's.

B

The challenge right so I mean one of the things I find with a lot of the work.

A

That we do- and it applies here too, is there's this modelling challenge like.

A

You have to spend a bunch of time on modeling and have a set of.

A

Characteristics in your mind that you want that you want to apply to the.

A

Software you built, and your model is the thing that kind of has to account for.

A

All of that yeah. So thinking about the models and how to split the the big.

B

Model into multiple models is probably the most important thing like bounding.

B

Context, which is the name that you use in domain, drew and design, which is.

B

Pretty similar yeah and then maybe one one entity could be even the same entity.

B

Split up in multiple pieces that may be in the catalog, I have all the all the.

B

Attributes for that entity of the product, but maybe in the basket. I just.

B

Need the id and maybe the price, but not the rest right so but then, if you see.

B

Here the col, when I talk to from the client with http, it would be just to the.

B

First level, so if something happens in any internal servus, you just send an event and you send that communication to other micro.

B

Services through an event, bus or service box or rabbitmq, so basically, this is to.

B

Have eventual consistency between those small models yeah? Another important word.

B

That's that's the most important thing here because maybe when I change the.

B

Price in the catalog for a product, I want to be a worry about that in the.

B

Basket but I will keep the price in the basket and the new price is going to.

B

Come with an event is synchronously, so finally, what you get is that, from the.

B

Client you're, just when all that propagation of data and eventual.

B

Consistency is done from the clan. You just need to talk to one micro service.

B

And maybe something happens again and but it's like decline up or the ap api.

B

Gateway should talk just to as much as possible to a single level of micro.

B

Service, not a long http request yeah, I almost see it as then. We should kind of.

A

Finish up is this kind of approach is almost like client, first development.

A

Meaning your architecture is oriented on the best possible experience for your.

A

Client, whereas the very first diagram is almost like a back-end first, not that.

A

It's great for the backend, but a back-end first approach, which is its.

A

Oriented on consistency now, whatever the opposite of eventual consistency, is so.

A

It it's kind of on the easiest way for the the backend, but the client suffers a.

A

Lot so on the second diagram, the the backend has to kind of use. These other.

A

Techniques to cause data to flow and get various ways right and and and this is.

B

Where, if we come back to the architecture, you see that we have an.

B

Event, bus as just running it on top of robert and q or service bus, and we use.

B

That for this event, which consists on your backplane and so that's, okay is.

A

There anything else you want to just say in closing.

B

Oh just that, well it's not just running this locally. You can also deploy this as.

B

You can see here in usher, this is a ks and, and you can deploy this into cooper.

B

Nudity, nashor, and- and here you can also you know like scale out so if right.

B

Right, but so is there any if you know someone goes and looks at this and.

A

They've got some like pretty detail-oriented questions. Where would.

A

They ask these and with the hope of kind of giving or yeah sure so yeah. That's a.

B

Great question so, first of all, if you have any issue about when you're trying.

B

The the examples or the reference application you can go here and create.

A

An issue- and we are monitoring these and and an answering and solving everything.

B

As much as we can that's one thing, the other thing is: if you have a like a.

B

Specific question: you can also send a question to in most of the pages here.

B

You you can see this in list email issue. Ok back! You send an email as well.

B

Okay, thanks azhar, this has been excellent cool. I know that there's a ton.

A

Of folks that really appreciate this content. I know you spend gargantuan.

C

Amount of time on this yeah 40 hours a week right, probably a few more than that.

A

Okay, well, thanks for thank you, yeah thanks for listening to another episode.

A

Of the on net show, and today we learned about micro services and architectural.

A