Shared Clusters in Unity Catalog for the win: Introducing Cluster Libraries, Python UDFs, Scala, Machine Learning and more
We are thrilled to announce that you can run even more workloads on Databricks’ highly efficient multi-user clusters thanks to new security and g...
Databricks introduces security and governance features in Unity Catalog for developing and running SQL, Python, and Scala workloads on shared compute resources. Fine-grained access control is offered for Scala, Python, and SQL Spark workloads. Shared clusters provide cost savings, simplified management, and data governance. Enhancements include cluster libraries, init scripts, support for Scala workloads, Python and Pandas UDFs, machine learning libraries, and structured streaming. Databricks Runtime 13.3 LTS or above is required.
