Delta Lake Last Week in a Byte, 10 Jan 2023

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Last Week in a Byte (2023-01-10)

Description

Learn about the latest #deltalake news a week late! This quick byte includes:
- delta-rs 0.6.0 release which includes support for check invariants, support for DataFusion 15, a new Python binding release Github Action for universal2 wheel, and more! https://github.com/delta-io/delta-rs/releases/tag/rust-v0.6.0 #rustlang #python #datafusion

- Noritaka Sekiyama, Kyle Duong, and Sandeep Adwankar published Introducing native Delta Lake table support with AWS Glue crawlers on the AWS Big Data blog. https://aws.amazon.com/blogs/big-data/introducing-native-delta-lake-table-support-with-aws-glue-crawlers/ #aws #bigdata #awsglue

- Matthew Powers, Chitral Verma published Reading Delta Lake Tables into Polars DataFrames https://delta.io/blog/2022-12-22-reading-delta-lake-tables-polars-dataframe/ #polars

- Mehdi Ouazza published Python Devs, It's Time To Get On The Rust Bandwagon! https://youtu.be/j_1uUbxDWjY #python #rustlang

- Want to watch Delta Rust code development? Join R. Tyler Croy (agentdero) LIVE on twitch.tv. https://www.twitch.tv/agentdero/schedule?seriesID=d8138556-c4c2-4383-a2cd-44a12610dc83 #twitch

- A big shout out to Florian Valeye who is Delta Lake's contributor of the month! https://delta.io/profiles/florian-valeye/

A

A

Lee I'm here to tell you the latest Delta Lake news and events about a week late.

A

So let's start off and talk about Delta rust, 0.6.0 release that was released over the holidays, oh by the way Happy New Year for 2023, includes check and variance and support for data Fusion 15..

A

uh There are two awesome: Delta blogs on AWS glue and polars. The introducing native Delta lake table support with AWS glue. Crawlers was a part of the AWS Big Data blog, while the polar's blog reading Delta Lake tables into polar's Data frames was released on the Delta. I o blog I want to give a shout out to many for his wonderful YouTube and Linkedin uh video on python devs. It's time to get on the rust bandwagon in the newsletter.

A

There's a link directly to both the blogs, as well as the video here and so just want. To give many a shout out thanks very much. He also did a call out to me as well in one of the d3l2 sessions about the convergence of software and data engineering.

A

Do you want to go ahead and watch how Delta rust code is developed? Live well. Look no further are Tyler Kroy uh from also known as agent diro he's a Delta Lake, maintainer and director of platform engineering at scrip. He on a weekly basis, we'll go ahead and showcase Delta, rust code development live on Twitch last, but certainly not least, we want to give a shout out to Florian valet he's adult leg, maintainer staff data engineer at back Market.

A

He is Delta Lake's contributor of the month for his amazing work in Delta rust in the Delta python ecosystems Florian. Thank you very much for everything that you currently do and continue to do for the Delta Lake community and that's it for this week's last week. Invite I hope to see you next week and I hope your week treats you well have a good one.