Cloud Native Computing Foundation / TAG Observability

Agenda

* Introductions
* Summary of the WG Charter and goals
* Select initial DSLs to research
* Review and contribute to DSL Designer In-Depth Interview questions. (stub PR)
* Discuss End User survey questions. (stub PR)
* Review and contribute to the use cases documentation schema. (stub PR)
* Review and contribute to the telemetry model schemas. (stub PR)
* Review and contribute to the DSL documentation schema. (stub PR)

Slides
https://docs.google.com/presentation/d/1kmIR5TKuHIDGMphYhFlZKHozLiQjTb8BaUFa_POCLMI/edit#slide=id.g72e417d42c_27_0

Tweet Announcement:
https://twitter.com/alolita/status/1663577162451128321

Notes:

* YAML format seems ok to proceed with for documentation
* Look at adding validation for the schema for PRs to help folks
* Break the schema review due dates up so that we review the telemetry schema first then the use case and DSL schemas next.
* Extend due dates to June 30th as folks are pretty busy.
* Chat on Slack for primary communication in #obs-query-standard-wg. Major milestones/announcements in other slack channels and email.

## Kubecon EU O11y TAG session;
* Lots of interest on the common query language working group
WG: weekly; 1 hour; timezone
* Talk videos are now available on CNCF YT

## TOC update from May 2
* Project Community Health - TOC requested TAG O11y open up an issue to discuss

## Query Language WG discussion, next steps
* Topics: ML Observability (MLOps), Business benefits, ROI of observability tools, data to communicate to management, Cost Management, Real-life use cases of tracing platforms and best practices, OpenTelemetry for tracing - running it at scale, tracing data stores, O11y services - who is responsible for o11y in an org, is that a shared responsibility model; O11y pipelines and stacks - how folks are choosing their stacks; selection criteria vs. implementation; Discoverability of issues using tracing and metrics for root causing issues - what are best practices, use-cases; Data Protection considerations for o11y data - especially EU - both what are rules applied to o11y data and how is this done technically;

## Kubecon NA Chicago CFP is now open.
* CFP Closes: Sunday, June 18 at 11:59pm Central Daylight Time (UTC-6)
* CFP Notifications: Monday, August 28
* Schedule Announcement: Wednesday, August 30
* Slide upload deadline to Sched.com: Wednesday, November 1
* Event Date: November 6-10, 2023

Query Language WQ charter finalization. (doc)
Next steps - followup with TOC (create issue with charter doc for review and Q&A) - Chris, Vijay, Alolita, Matt

Questions / Discussion around WG for Query Language
CNCF TOC Meeting 3/7/2023 - mentioned this effort/WG for awareness

https://substrait.io

Pixie’s application for incubation
https://github.com/cncf/toc/pull/1001/files

Highlights:
* Community engagement, maintainership
* Versioning, stability guarantees
* CICD (Jenkins, GHA)
* Deployment w Helm chart, K8s CRD
* Demo

Landscape-graph project is open for contribution!
* https://github.com/cncf/tag-observability/issues/96
* https://github.com/cncf/landscape-graph

(Vijay Samuel) "Why and How eBay Pivoted to OpenTelemetry"

https://opentelemetry.io/blog/2022/why-and-how-ebay-pivoted-to-opentelemetry

The Open Telemetry initiative is providing observability practitioners a vendor neutral and an open standard by which applications can ship telemetry data into observability platforms. eBay is a well documented adopter of Elastic Beats. eBay has been an extensive contributor to the Beats project and contributed its Kubernetes autodiscover module which can dynamically monitor pods on Kubernetes clusters. However, with the rest of the observability ecosystem converging onto Open Telemetry, we felt that it is essential for us to adopt the same. This presentation focuses on:
* scale problems seen in large Kubernetes installations
* benefits of using annotation based discovery at scale
* our journey of replacing Metricbeat with Open Telemetry Collector without impacting metric collection
* bridging critical gaps such as:
* dynamic configuration reloading
* semantic differences between Prometheus receiver and stock Prometheus
* challenges faced in ensuring data parity post migration and solutions
---

(Chris Larsen) Observability Query Standardization WG Charter Review (doc)

---

(Matt Young) CNCF Landscape Graph


Meeting notes and more: https://github.com/cncf/tag-observability

OpenTelemetery Profiling Update

Meeting notes and more: https://github.com/cncf/tag-observability

Yuri Shukro - Talk on the 6 pillars of observability data
* https://medium.com/@YuriShkuro/temple-six-pillars-of-observability-4ac3e3deb402
* https://research.facebook.com/publications/positional-paper-schema-first-application-telemetry

Meeting notes and more: https://github.com/cncf/tag-observability

Liz-Fong Jones joined us for an discussion / talk on "Evolving and hybridizing signal types - my journey from metrics/logs to traces to profiles"

* OpenTelemetry Profiling updates (#otel-profiles)
* potential for collab w/ other tags (STAG)
* updates from https://github.com/cncf/landscape-graph
* we have a logo!

Meeting notes and more: https://github.com/cncf/tag-observability

Quick update from TAG chairs:
* Kubecon NA participation from the TAG
* TOC update (from meeting prior hour)

Call out for observability topics / speakers interested in presenting at TAG meetings
* Aug 16th: Liz Fong-Jones, "Evolving and hybridizing signal types - my journey from metrics/logs to traces to profiles"

Supporting APAC timezones for OTAG meetings

New Google Drive folder for TAG Observability has been created by CNCF.

(keyval) Introducing https://github.com/keyval-dev/odigos

* Profiling in OTEL update - join #otel-profiling on CNCF Slack
* https://github.com/cncf/tag-observability/issues/89
* Annual Review for O11y sandbox projects
* See https://landscape.cncf.io/images/landscape.pdf for project status
* Open Source Stories - Topics that Henrik would like to cover -

Metrics at Scale: Issues in OTEL Collector, Prometheus by Kevin w/Google

* Nominations (TL, co-chair)
* New Sandbox Projects - discussion of "welcome packet" for CNCF Projects
* Update on OpenTelemetry Profiling efforts

* KubeCon EU Meeting Recap (Bartek)
* Adding profiling as a signal → OpenTelemetry

Notes for meetings are linked from our github repo (

How to join: cncf.io/calendar, https://tockify.com/cncf.public.events/detail/388/1649174400000
More info: https://github.com/cncf/tag-observability

#cncf #observability #opentelemetry #profiling #cloudnative

* Meshery.io and its founder Lee Calcote. The Meshery project describes itself as "...the open source, cloud native management plane that enables the adoption, operation, and management of Kubernetes, any service mesh, and their workloads."

Services meshes provide a wealth of Observability signals. Meshery aims to facilitate good practices, patterns, and lifecycle management of services meshes.

In addition, we'll be covering updates & news related to:

* New short-format serial video series covering current events in our domain by Hendrik Rexed of the "It's Observable" YouTube channel.
* observe-k8s: a nascent community curated compendium of clonable case-studies
* Amazing new book! "Understanding Software Dynamics" by Richard Sites
the latest on our soon-to-be-unveiled mascot & logo!

How to join: cncf.io/calendar, https://tockify.com/cncf.public.events/detail/388/1649174400000
More info: github.com / tag-observability

#cncf #observability #meshery #kutrace #observe-k8s

* Hubble, cillium.io, https://github.com/cilium/hubble
* Pixie, https://pixielabs.ai, https://github.com/pixie-io/pixie, blog.px.dev
* KubeCon EU, TAG Observability Meetup

#observability #ebpf #cncf

* OpenCost / KubeCost
* Observability Personas
* Open Source News (new effort announced)

No description provided.

No description provided.

No description provided.

No description provided.

No description provided.

No description provided.

No description provided.

No description provided.

No description provided.

2021-07-06 CNCF TAG Observability Meeting

CNCF TAG Observability Meeting 2021-06-22

2021-06-08 CNCF TAG Observability Meeting

2021-05-25 CNCF TAG Observability Meeting

2021-05-11 CNCF TAG Observability Meeting