Dagster / Dagster Team Product Demos

Join the Dagster team for a special showcase of new dbt functionality included in Dagster 1.4. which makes Dagster a strong alternative to dbt Cloud. This session will benefit data professionals who work with dbt models and are looking to manage these as part of a larger pipeline. If you are looking to migrate off dbt Cloud or simply exploring dbt alternatives, this is a session you will not want to miss.

Partitioning is a technique that helps data engineers and ML engineers organize data and the computations that produce that data.

Dagster is a cloud-native data orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. In this short overview, Sean Lopp—data engineer at Elementl—gives us a tour of Dagster's capabilities and how this modern orchestrator helps data engineering teams break out of a typical vicious cycle.

Every other week, Dagster hosts a live demo with Q&A. You can join us at a future session by signing up here: https://dagster.io/dagster-demo-signup - alternatively. you can watch a recording of this demo from Dec 2022 featuring Elementl developer Ben Pankow as he builds a data pipeline using Software-defined assets, dbt models, scheduling, and more.

Data engineers waste a lot of time troubleshooting long-running pipelines and know only too well the frustration of minor errors consuming hours of work. In this practical tutorial, we will demonstrate an innovative solution for dramatically shortening testing cycles and reducing the number of reruns required, boosting developer/practitioner productivity, and reducing frustration on the team.

Join Noteable's CTO & Co-Founder Matthew Seal and Elementl's Jamie DeMaria for this virtual event.

DuckDB is so hot right now. Could it replace our cloud data warehouses or data lakes?
Pete Hunt builds a data lake from scratch with DuckDB and Dagster. Follow the tutorial here: https://dagster.io/blog/duckdb-data-lake

Combined with Dagster, S3, and Apache Parquet, DuckDB can become a powerful, multiplayer data lake that can serve the needs of many organizations with very little effort. Think of it as a free, simple SQLite.

We can see the rise of DuckDB for subsets of workloads that don’t have massive scale and can take advantage of its simplicity and fast performance.
Give it a go!

If you are looking to get up and running with Dagster in 10 minutes or less, this is a good place to start. Buckle up.
This video is a companion piece to the tutorial found at https://dagster.io/blog/dagster-crash-course-oct-2022
Sourcecode is found on GitHub: https://github.com/petehunt/dagster-github-stars-example
You can launch an instance and follow along on GitPod: https://gitpod.io/#https://github.com/petehunt/dagster-github-stars-example

Dagster Cloud is the easiest way to get started using Dagster. This video explores how Dagster Cloud lets developers build, test, and deploy their code with confidence.

Get started with Dagster Cloud here: https://dagster.io/cloud

For more information on getting started using Dagster, check out this demo: https://www.youtube.com/watch?v=lRwpcyd6w8k&t=0s

This video shows off how to get started with Dagster’s Software-Defined Assets, and the features they enable. It walks through creating assets in Python, as well as loading them from tools such as dbt.

Read more about Software-defined Assets in Dagster here: https://dagster.io/blog/software-defined-assets

In this edition of the Community Call, Owen will show off the new Airbyte Dagster integration, allowing you to orchestrate Airbyte and the rest of your modern data stack easily.

Check out our announcement here: https://airbyte.com/blog/orchestrate-your-airbyte-elt-jobs-with-dagster

Subscribe to our newsletter: https://airbyte.com/newsletter?utm_source=youtube
Learn more about Airbyte: https://airbyte.com