Databricks 初始化脚本
原文英文,约400词,阅读约需2分钟。发表于: 。General # Init script is just a shell script, which will be run for each node in the cluster, before Apache Spark driver or executor JVM starts. A cluster can have multiple init script if you...
介绍Databricks中的init script,是一个shell脚本,在Spark启动之前在每个节点上运行,可以按顺序执行,可以在集群配置页面或DBFS/ABFSS路径中添加,提供环境变量,不建议使用全局init script,可配置日志路径。