Dagster Dagster Community Day - Dec 2022, 8 Dec 2022

Previous Meeting

⏯

youtube image

►

From YouTube: Secrets Management - Dagster Community Day - Dec 2022

Description

In this demo, Elementl engineer Shalabh Chaturvedi provides an overview of a recent improvement to Dagster Cloud Serverless: Secrets Management. Dagster Cloud users can now set environment variables straight in the Dagit UI in Dagster Serverless.

A

A

If you go to your deployment, it's Tab and go to the environment variables section, you can create an environment variable I'm, going to create one called my secret.

A

And give it a value secret value, save everything, as else as is, and while that's updating I already have an asset created that uses the secret. All it does right now is extract this environment variable and and print it out to the logs.

A

I just did a run earlier of the for this asset and since I didn't have anything defined. As you can see, my secret is set to none. Now that our definitions are Reloaded, I am going to run I'm going to materialize this asset again.

A

And see what happens.

A

So the job's finished running and here I can see that it did in fact get the secret value out. These values are stored encrypted on our end, using a organization specific encryption key, so you can use them for your secrets. You connect to your Warehouse or other environment variables and with that I'm going to hand it off to Johan who will show you another serverless deployment feature.