winway / commentRepo

commenyRepo

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Spark-sql支持cluster模式 | winway's blog

winway opened this issue · comments

https://winway.github.io/2022/01/16/sparksql-cluster/

问题 解决 问题使用Spark-sql执行sql不支持cluster模式,导致driver只能启动在提交机器,进而占用提交机大量内存。 Exception in thread “main” org.apache.spark.SparkException: Cluster deploy mode is not applicable to Spark SQL shell. 解决开发一个sp