Delta Lake Last Week in a Byte, 13 Dec 2022

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: Last Week in a Byte (2022-12-13)

Description

Learn about the latest #deltalake news a week late! This quick byte includes:
- Delta Connectors 0.6.0: https://github.com/delta-io/connectors/releases/tag/v0.6.0 which includes support for the Flink/Delta connect or on #apacheflink 1.15.3

- Delta Sharing 0.6.0: https://github.com/delta-io/delta-sharing/releases/tag/v0.6.0 #deltasharing

- Delta Spark 2.2 Release supporting #apachespark 3.3 https://github.com/delta-io/delta/releases/tag/v2.2.0

- D3L2: Discussing Data Integration with Airbyte and Delta Lake: https://youtu.be/sa49O_Ho1X4

- D3L2: The Genesis of Delta Rust with QP Hou: https://youtu.be/ZQdEdifcBh8

- Delta Lake is the foundation of an open data platform at Scribd: https://www.databricks.com/customers/scribd/delta-lake

- Data Sharing across Government Agencies using Delta Sharing: https://delta.io/blog/2022-12-08-data-sharing-across-government-delta-sharing/

- Linux Foundation called out the Delta Lake project: https://project.linuxfoundation.org/hubfs/LF%20Research/2022%20Linux%20Foundation%20Annual%20Report.pdf?hsLang=en

We're happy to announce two new Delta Lake maintainers
- Will Jones: https://github.com/wjones127
- Robert Pack: https://github.com/roeap

A

Thank you welcome to last week in a bite on Delta Lake for the latest Delta Lake news and events a week late. Let's start off with the latest releases, which includes Delta sharing 0.6.0, which now supports using Delta sharing table as a source instructor streaming Delta connector 0.6.0, which includes column, mapping, support in the Delta and power bi connector and add support for the Flink Delta connector on Apache Flink 1.15.3.

A

Also, don't forget. Delta spark 2.2, which supports aggregate Apache spark 3.3 with performance features like limit and aggregate push Downs into Delta scans. We had two great D3 L2 vidcast postcast sessions, where we were discussing data integration with air byte and Delta lake, with Simon spatty from airbite, and also great conversation discussing the Genesis of Delta rust with QP Howe. Did you know that Delta rust was qp's first rust code in production, pretty cool eh as the Director of platform engineering, our Tyler Croix headlines, this great Delta Lake story at script.

A

Tyler is an amazing cyclist, but just as importantly, hell create Delta rest N is a Delta Lake maintainer, there's a great blog on Delta. I o last week on data sharing across government agencies using Delta sharing a pretty cool read in the Linux foundation's 2022 annual report. There was a call out to Delta Lake uh check out page 130..

A

There's also a great quote from Florian here about contributing to open source is a key to learning how to solve problems within worldwide benevolent communities of people, thanks Florian, what a great quote, but last, but certainly not least, we're happy to announce the two Delta Lake maintainers will Jones and Robert Pack. Congratulations, I! Hope you enjoyed this week's last week in a bite. Talk to you soon.