Cloud Native Computing Foundation PromCon North America 2021, 1 Nov 2021

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Lightning Talk: Monitor Your SOA Stack with Prometheus & Grafana - Michel Schildmeijer, Qualogy

Description

Don’t miss out! Join us at our next event: KubeCon + CloudNativeCon Europe 2022 in Valencia, Spain from May 17-20. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Lightning Talk: Monitor Your SOA Stack with Prometheus & Grafana - Michel Schildmeijer, Qualogy

Monitoring performance, throughput, and the error rate are important to be in control of your SOA transactions. If you use Oracle Service Bus or Oracle SOA/BPM suite there are a lot out of the box diagnostics waiting for you. The puzzle here is how to get it out in a useful way. Besides the many commercial solutions also OpenSource tools can help you out with it. You can export runtime diagnostics out of the Diagnostics framework, monitor your SOA Composites, and trace down Service Bus statistics using Prometheus and Grafana. The session will elaborate on how to set up proper monitoring using these tools, also in a proactive way where automated monitoring is a must for every application environment.

A

Hello, dear audience, my name is michelle spielberg, I'm from amsterdam, the netherlands. I work with quality and I'm presenting for you monitoring your soa stack with prometheus and kerfman. I'm sorry, I can't attend the event in person, so I will do it virtually remote behind my desktop. I hope you enjoyed this session so in nowadays monitoring. There are a lot of tools around commercial tools which are licensed to be used, but also some open source tools and well. I will discuss open source used by commercial off-the-shelf licensed products which oracle has also it's.

A

uh The soa stack is always sweet in fact, and um when you look at the different tooling around open source, there are lots more, of course, but we're on prom com. So I will talk about that. You have grafana for despot, visualization and prometheus, to scrape and gather diagnostics uh for your monitoring and the same for your log file analytics. So you have your kibana to visualize all your log files and logstash to gather all the log entries and do something with it.

A

And if you look a bit closer into how oracle has come more into the open source and the open container and open cloud movement, you can see they made their traditional application. Server, weblogic container ready. Actually, so it's certified to run run at docker and and kubernetes, and all the different flavors of kubernetes open shift and all the others.

A

But it's also certified for more. The open container initiative like cryo and container d and cutter containers and looking at the integration part so integrate all this technology. Oracle also creates, or has some projects around the around an operator for weblogic and also in in terms of monitoring.

A

It has written an exporter for prometheus uh and also for elastic stack. So you can see that the platform is ready to be monitored, open source.

A

Now, on top of weblogic, you can run all kinds of other products from oracle. You can build your own java applications, but you can also use uh commercial off. The shelf. Products like weblogic is a java e application server, but oracle also built their own software, and this software is the oracle soa suite as a way suite, and this consists of a certain kind of products about the main products running our oracle service bus, which is an enterprise service, bus and the oracle.

A

Soa bpel execution language, which is an enrichment language for getting more data into your transaction.

A

This is a schematic overview of how the sol architecture looks like with all kinds of open standards like the surface component architecture composites, which consist of some of components like an interface and an autonomy process within it, and the infrastructure is built on weblogic, uh and on top of that, it's all java, based java connection architecture.

A

um Well, I already told you people some internal routing with mediator and some database related stuff, like a dehydration store to dehydrate uh processes which are running maybe for some long time and, of course, the web-based stuff which is for the administration.

A

An important part for your web logic and for your monitoring is, of course, is that weblogic enables to to control over rest. So the rest management api within weblogic is also uh good for your monitoring stack for your monitoring tool, it's a rest api and you can do a lot of stuff with it. You can configure it, you can start stop it deploy applications, monitoring and also the operator makes use for it. So um and you don't need any client for it.

A

It's just over http, and this is important for your grafana and prometheus, because it also uses this interface. So let's focus a little bit about the monitoring, diagnostics and everything within weblogic soa. So what logic provides a lot of frameworks within which can be used by prometheus to extract all the metrics out of it? You have the weblogic diagnostic framework, and some additional frameworks are added to that, and also because soa is a bit of another product which lands on weblogic.

A

You need some additional tooling oracle diagnostics, logging, dynamic monitoring, service and selected tracing, and this all can be used by prometheus to to make an extract and to show it within grafana.

A

So specific diagnostic tools for soa can be extracted out of the weblogic diagnostic framework, within with a combination of other tooling dms, metrics, dynamic monitoring, monitoring system and have some dumps of logs metrics and images which can be used for prometheus to make a logical understanding of how the system is doing. At that moment now, I'm going to show you an overview of how you can set up prometheus and grafana for your soa stack.

A

So you have a few components in here. You have your uh traditional prometheus and grafana in your your kubernetes environment, using an operator for your prometheus, perhaps to install everything and to control it, and also to publish your your metrics somewhere um but specific for weblogic. You would have some additional stuff which is needed. Yeah. You need a war file to install in your weblogic domain.

A

You have to repackage or rebuild it with a proper configuration and you can use some dashboards. You can have some imports, uh json, dashboard imports, which are already configured and and done from the oracle site, or you can configure them yourself and you can also use in sql agent pod for querying the esoa repository.

A

I already mentioned the dehydration store and the aero hospital to get all the diagnostics metrics out of.

A

That now this is a schematic overview of how prometheus in general works, but also how it works within a typical java, so uh environment, so an important part for that is the wls weblogic jmx exporter, which exports all the mb metrics out of the java application, or the soa stack now here have you have a flow of how um how these metrics uh end up in committees and, finally, of course, in grafana, I already told the weblogic exporter war file, the web archive you deploy it in to your weblogic domain and with this war file, you can export all the ambient jmx metrics into you can scrape them.

A

Sorry, you can scrape them from the exporter into prometheus, and if you have set that up, you can already see all the metrics in the prometheus console, and then you have to create a data source for kerfana to visualize all the metrics into your dashboards and looking into prometheus. You can look at the endpoints at the endpoints of the metrics and there you can see all the metrics which are collected with this endpoint, the scraping which is done from the weblogic domain into prometheus.

A

And here you can see uh that the weblogic admin server is scraped, but also one of the managed servers which is running in a pod.

A

When it comes to visualization grafana is the tool to be used within prometheus and within weblogic. You can use your customized dashboards or using templates with the json format to import them into your phone, but you can also write your own queries and create your own dashboards.

A

So here's an example of how I created a query around the weblogic server state, so the server state can be running or failed or some other stealth, and you can build this into your grafana dashboard and with some value mappings, you can give them values into integer volumes and correspond some text which also matches with the weblogic running and starting and shutdown states.

A

Okay, that's about it. This was my session, my lightning session. I hope you enjoyed it. It was a short session and a short overview of what's possible, um but if you want to know more, please contact me on my channels. Thank you. Very much have a wonderful day.