spark查询hive表因库跟表名反引号报错Table or view not found

使用spark查询hive表时,报错如下:

20/03/23 11:24:10 INFO StateStoreCoordinatorRef: Registered StateStoreCoordinator endpoint
Error in query: Table or view not found: bili_manga.homepage_mangacard_user_norm_onehot; line 19 pos 6
20/03/23 11:24:11 INFO SparkUI: Stopped Spark web UI at http://xxx:10005
20/03/23 11:24:11 INFO YarnClientSchedulerBackend: Interrupting monitor thread
20/03/23 11:24:12 INFO YarnClientSchedulerBackend: Shutting down all executors
20/03/23 11:24:12 INFO YarnSchedulerBackend$YarnDriverEndpoint: Asking each executor to shut down
20/03/23 11:24:12 INFO SchedulerExtensionServices: Stopping SchedulerExtensionServices
(serviceOption=None,
 services=List(),

但是使用hive引擎查询表存在且有结果的,$SPARK_HOME/conf下 也已经存放hive-site.xml文件。

查询sql部分如下

  LEFT JOIN (
    SELECT
      *
    FROM
      `bili_manga`.`homepage_mangacard_item_norm_onehot`
    WHERE
      dt = "<%=log_date-1%>"
  ) c ON a.manga_id = c.item_id
  LEFT JOIN (
    SELECT

将反引号去掉即可正常查询。

posted @ 2020-03-23 11:29  songchaolin  阅读(1818)  评论(0编辑  收藏  举报