spark写入数据报错

本文介绍: Exc ept ion in thread “main” org.apache.spark.sql.An aly si sExc ept ion: Ca n no t over write table dwd.dim _user _info that i s a ls o b e in g read f ro m at org.apache.spark.sql.DataFram eWr iter.saveAsTa ble(DataFram eWr iter.scala:720) at org.apache.spark.sql.DataFram

报错信息如下：

Exc ept ion in th read “main” o rg.apache.spark.sql.Analy sisExc ept ion: Cannot ov er write table dwd.dim_user_info that is als o b e in g read f ro m
   at o rg.apache.spark.sql.DataFram eWr iter.saveAsTable(DataFrameWr iter.scala:720)
   at o rg.apache.spark.sql.DataFrameWriter.saveAsTable(DataFrameWriter.scala:626)
   at GS_1.task2$.writeDw dTable(task2.scala:103)
   at GS_1.task2$.teast1(task2.scala:65)
   at GS_1.task2$.main(task2.scala:109)
   at GS_1.task2.main(task2.scala)

我的解决办法如下：

    println("""这里有个报错：Exception in thread "main" org.apache.spark.sql.AnalysisException: Cannot overwrite table dwd.dim_user_info that is also being read from""")
    println("""读写同时报错，我的解决办法是，创建临时表b，删除原表a，表b创建表a，表a删除。""")
    frame.write.mode("overwrite").partitionBy("etl_date").saveAsTable(s"dwd.${dwdTableName}_B")   // 创建 B
    util.getSparkSession.sql(s"drop table dwd.${dwdTableName}")   // 删除 A
    util.getSparkSession.sql(s"select * from dwd.${dwdTableName}_B").write.mode("overwrite").partitionBy("etl_date").saveAsTable(s"dwd.${dwdTableName}")  // 复制B创建A
    util.getSparkSession.sql(s"drop table dwd.${dwdTableName}_B")   // 删除 B