Delta Lake Last Week in a Byte, 21 Mar 2023

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Last Week in a Byte (2023-03-21)

Description

Learn about the latest #deltalake news a week late! This quick byte includes:
- We're proud to announce the release of delta-rs rust-v0.8.0 release! More information at https://github.com/delta-io/delta-rs/releases/tag/rust-v0.8.0. #rustlang

- Gurunath Rajagopal recently released his Lakehouse Sharing project, which Demonstrates a table format agnostic data sharing server (based on #deltasharing protocol) implemented in Python for both #deltalake and #apacheiceberg formats.

- Want to help with creating Delta Lake helper functions without Spark dependencies? Check out https://github.com/MrPowers/levi and chat with Matthew Powers, CFA, who created the levi, mack, and jodie Delta Lake helper function libraries.

- Get the latest Delta table version using mack helper functions using mack.

- Joydeep Banik Roy published CHANGE DATA FEED — Time Travel — Failure Scenarios, Prevention & Recovery, which covers three scenarios where time travel queries fail and how to check for these errors easily.

- We are happy to partner with Blueprint on their Velocity Tour to bring you demos, meet and greets, speaking sessions, and more! They will be at Data Council Austin 2023, PyCon US 2023 in Salt Lake City, and PyData Seattle 2023 in Seattle for March and April. Check out the Velocity Tour for all of their dates!

- Robert Kossendey published the fourth blog in his insightful series on his journey to the #lakehouse with the post Lakehouse - A resumé.

A

A

2023 edition of last week in a bite on Delta Lake, let me start off by saying we're proud to announce the release of the Delta rust 0.8.0 release, which includes support for additional types of partition, values, partition pruning of columns, typed commit information, as well as enabling passing storage options.

A

The Delta table Builder via data Fusion's, crate external table and more wanted to do a shout out to greenth uh Roger Paul on his recent release of the lake house, sharing project which demonstrates a table format, agnostic data sharing server based on the Delta sharing protocol implemented in Python for both Delta Lake and Apache Iceberg formats.

A

There were recent releases and contributions, for example, like uh with the Delta Lake helper functions, um which, uh without spark dependencies check out the Levi project.

A

um It's a chat with Matthew Powers, who created the Levi Mac and Jody Delta Delta Lake helper function, libraries, and also with the Mac helper functions. Now you can get the latest Delta table version um just like this.

A

Nice and easy also want to shout out to uh Joey deep and manic Roy for his uh publishing change data, feed time, travel, failure, uh scenarios, prevention and Recovery, which covers three scenarios where time travel queries fail and how to check for these areas easily or happy to partner with blueprint on their velocity torch, which brings you, demos, meets and greets speaking sessions and more they're going to be at data Council Austin, 2023, pycon us2283 in Salt, Lake, City and piety to Seattle 2023 for March and April, and check out the velocity tour for different cities.

A

Throughout the year, Robert consignee published the fourth blog in his insightful series on his journey to the lake house, with the post lake house a resume some amazing call-outs, including their ability to reduce overall costs while drastically improving developer experience. It's really nice to see how their core infrastructure is powered by a bio open source, namely Apache spark and Delta Lake, and with that thanks very much for this week's last week in a bite. Hope to see you next week.

A

Foreign foreign.