Databricks将Spark声明式管道贡献给Apache Spark
At the Databricks Data+AI Summit, held in San Francisco, USA, from June 10 to 12, Databricks announced that it is contributing the technology behind Delta Live Tables (DLT) to the Apache Spark...
在旧金山的Databricks Data+AI峰会上,Databricks宣布将Delta Live Tables技术贡献给Apache Spark,命名为Spark Declarative Pipelines。这一新特性将简化流式管道的开发与维护,支持使用SQL或Python SDK定义数据流,预计将在2026年1月的Spark 4.10版本中发布。
