Prior to Delta, data lakes and data warehouses occupied separate worlds, explained Michael Armbrust, a Databricks distinguished software engineer and the creator of Delta Lake, Spark SQL, and Spark ...

This meant users had to choose one of the three and engage in complicated integration work. Now, with the release of Delta Lake 3.0, there’s no need to compromise anymore, according to Databricks.

The positive impact of open table formats has been growing over the past few years. While Hudi was arguably first on the market, Iceberg has been building momentum over the past 18 months thanks to ...

Databricks Inc. opens its Data + AI Summit today with the announcement that it will release the entirety of its Delta Lake storage framework to open-source under the oversight of the Linux Foundation.

The updates in Delta Lake 3.0 include a new universal table format, dubbed UniForm, a Delta Kernel, and liquid clustering to improve data read and write performance.

Streaming and batch unification: A table in Delta Lake is a batch table as well as a streaming source and sink. Streaming data ingest, batch historic backfill, interactive queries all just work ...

What’s maybe more exciting, though, is something Databricks calls Project Lightspeed, which the company describes as the next generation of the Spark streaming engine.