Cloud Native Computing Foundation ServiceMeshCon EU 2021, 14 May 2021

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Lightning Talk: Use SkyWalking Satellite to Process Tracing, Logging and Metrics in Serv... Ming Wen

Description

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: Use SkyWalking Satellite to Process Tracing, Logging and Metrics in Service Mesh - Ming Wen, api7.ai

Observability has always been a thorny issue in service mesh. Users of the service mesh need multi-dimensional data such as logs, metrics, and tracing to analyze the problems they encounter. In traditional solutions, users need to deploy skywalking, Prometheus, and Elasticsearch to handle these issues respectively. In this topic sharing, Ming Wen will introduce the latest version of Skywalking 8.4 and the sub-project of skywalking satellite. Using these two open source projects will help users use a complete and unified solution to process all observable data under service mesh.

A

Hello, everyone I'm pleased to be here to have the opportunity to sharing and the serious smash conference europe. This topic I'm sharing today, is use skywalking, satellite to process tracing logging and metrics in search mesh.

A

Let me introduce myself first. My name is minwoon, I'm the co-founder of api 7.ai, which is an open source software startup company in china, and I'm also the pmc chair of apache ps6 eps. Six is the apache software foundation's top-level project and api 6 is a dynamic, real-time, high performance, api gateway, eps-6 provides traffic management features such as the load, balancing dynamic, breaking up stream, other observability and more features you can use apply gps 6 to handle traditional north source traffic, as well as the east-west traffic between the services.

A

It can also be used as kubernetes in glass controller, I'm also the committer of apache skywalking. You can reach me through the following twitter, email and the github channels.

A

First, let's take a look at the summer problems faced by the service mesh. The service mesh is absolutely a good solution, but at the same time the smash will also bring some problems.

A

We may have hundreds of thousands of services and there is a set car next to each service.

A

The calling relationship between services is more complicated, so do know how their services call each other, and how can we see each service have problems with course. This is the first question, and the second problem is that we hope to analyze and process this kind of observability data in the service mesh. In the traditional solution. We need to send the metrics data to promiscuous and send the tracing data to zip king, our apache scan working, and then we send the login data to electric search.

A

There will have a lot of differences in our system in terms of observability. We need to relay on at least three open source components claim issues skywalker and the erk.

A

This is more difficult for system to maintain so many open source projects for the enterprise, the cost will be higher. So is there any way we can make it easy to maintain and reduce our use, cost.

A

Before this introduction, let's take a look at what apache slovakia is apache. Skywalking is an apm tools for distributed systems. Api means application. Performance, monitor slogan is special designed for the micro services cloud native and the container-based architectures.

A

The 8.4 version of skywalking supports three types of data, including logging, metrics and tracing, so we can process the data uniformly through our participating.

A

Let's look at another question: how can we better collect their data on the service side?.

A

Then we need to introduce a sub-project of skywalker, the skywalking satellite skull satellite is a high weight collector. It's also cell car that could be deployed close to the target system to collect metrics, freezing and logging, and it also provides more features such as the local cache format, transform. Saving the following is a picture of satellite. We can see that we can collect the log data through satellite, the log data may come from the apps log or you may have e-ball invoice ars plug-in or linux log.

A

Yes, it can be all kinds of logs about tracing skywalker has a lot of agent such as a golan agent lula agent or the java agent. This agent can also send their data to a satellite. The third part is the plume uses data.

A

We know that columbus uses data is provided by polling, which is request you to expose a port to the outside, which is not safe. We can limit the polling, behave to the local machines through the satellite and then satellite pushes the perimeter's data to the remote sky. Working inside of poly.

A

Now, satellite can use the kafka protocol to send data to kafka, and then we like skywalking, act as a consumer to process the data center from the satellite okay. Then we, let's take a look and why we need uh this project where we need this uh slogan, satellite forms above architecture. We can see that we only use one component of the epp site. Satellite satellite is a one-stop epm data, collector it covering the tracing logging and matrix.

A

As we mentioned earlier, it can convert the promiscuous fetch model to a safer push mode because it is local, so we can do mould data filter and cache before we send the data to the skeleton another advantage of satellite is that we learn the service restart or the service crash. We will not lose data because all of the data has been saved in the satellite.

A

Then, let's take a look at another example of use: satellite with the apache api. Six. The previous architecture is more suitable for the deploy the service and the skeleton in the same vpc, because you send all of the data to kafka, but how to send data from hybrid cloud architecture.

A

You may use both satellite and empire gpr6.

A

Api 6 is a infrastructure part of the processing critical traffic in grass and the epi 6 has the scaling plug-in, so it can replace kafka to receive such as uh observability data, in other words, api, six and scale working at deployment in the public cloud. Well, the service may be on promise, so we are sending your data. You cannot use the kafka protocol but use the gipc and mtrs.

A

In this way you can send the separate to apply gpr6 on the public cloud and the zoom. The api 6 is sent to the skelo king through the skeleton plugin or vpn 6 for precision satire is a very young open source project, so it still have a lot of to-do features. For example, we want to support demon site so that we can save more resources, especially for the deployment model of the service. Mesh. Saving resources is also a critical factor.

A

Also, we will support more protocols, such as open, telemetry, envoy, ais, ais means the exact log service and apache ps6 crs, because the satellite is a project deployed on the edge side, so we can do more works on the edge. For example, we can pre-process the data and we can compromise the data in this way. When we send data to the backend scouting service, our data has been filtered so that will make it easy and process and stop yes.

A

This is just a brief introduction above so, if you want to know more about the sky walking celebrating satellite and the java jbl6 project, you can learn more from the github. Thank you.