Dagster / Dagster Hot Takes

Add meeting Rate page Subscribe

Dagster / Dagster Hot Takes

These are all the meetings we have in "Dagster Hot Takes" (part of the organization "Dagster"). Click into individual meeting pages to watch the recording and search or read the transcript.

30 Dec 2022

Getting an on-call page is the worst. Unfortunately most task-based orchestrators page teams frequently, whenever jobs fail. With Dagster you can reduce this alert fatigue by using retry strategies and only getting notified when SLAs are violated.

Resources:
- *Star Us*: https://github.com/dagster-io/dagster
- *Example*: https://github.com/dagster-io/hooli-data-eng-pipelines
  • 1 participant
  • 7 minutes
dag
dagster
robust
diagster
dbt
execution
data
orchestrator
models
interruptions
youtube image

29 Nov 2022

Logging is great, but it isn't the only tool. With dagster, data engineers can also tap into debuggers, unit tests, and local development best practices.

Prefer to read: https://gist.github.com/slopp/7c64973c70b12ffbd506d4e64d80d65e

Resources posted below, or star us on GitHub to get started.

- Star Us: https://gitub.com/dagster-io/dagster
- Example Project: https://gist.github.com/slopp/359ba324a4d6ccfb3bf23d0e9554c080
  • 1 participant
  • 7 minutes
debugging
debug
dagster
dag
debugger
tools
daxter
testing
develop
ski
youtube image

16 Nov 2022

No more dependency hell or Orchestrators for your orchestrator

Prefer to read: https://gist.github.com/slopp/7c64973c70b12ffbd506d4e64d80d65e

Resources posted below, or star us on GitHub to get started.

- Star Us: https://gitub.com/dagster-io/dagster
- Example Project: https://github.com/slopp/dagteam
  • 1 participant
  • 7 minutes
dag
dagster
orchestrator
repository
packages
dependencies
upgrades
deployments
project
robust
youtube image

10 Nov 2022

IStop guesstimating when your Notebooks should run

Prefer to read: https://gist.github.com/slopp/7c64973c70b12ffbd506d4e64d80d65e

Resources posted below, or star us on GitHub to get started.

- Star Us: https://gitub.com/dagster-io/dagster
- Full Example Project: https://github.com/dagster-io/hooli-data-eng-pipelines
  • 1 participant
  • 6 minutes
notebooks
notebook
scheduling
dag
data
execute
excel
problems
project
late
youtube image