impala 问题

1. This Impala daemon is not ready to accept user requests. Status: Waiting for catalog update from the StateStore.

端口未开启。開啓23000。

涉及impala的端口有:

组件

服务

端口

访问要求

说明

Impala

Daemon

Impala Daemon Frontend Port

21000

External

用于通过impala-shell和Cloudera ODBC驱动程序1.2版传输命令和接收结果。

Impala Daemon Frontend Port

21050

External

例如商业智能工具, JDBC,Hue中的Beeswax查询编辑器,以及Cloudera ODBC驱动程序的2.0或更高版本等传输命令和接收结果。

Impala Daemon Backend Port

22000

Internal

限内部使用。 Impala守护程序使用此端口相互通信。

StateStoreSubscriber Service Port

23000

Internal

限内部使用。 Impala守护程序在此端口上侦听statestore守护程序的更新。

Impala Daemon HTTP Server Port

25000

External

供管理员监控和排除故障的Impala Web界面。

Llama Callback Port

28000

Internal

限内部使用。 Impala守护进程用于与Llama通信。

Catalog

Daemon

StateStoreSubscriber Service Port

23020

Internal

限内部使用。catalog daemon在此端口上侦听statestore守护程序的更新。

Catalog HTTP Server Port

25020

External

Catalog服务Web界面,供管理员监控和排除故障。

StateStore Service Port

26000

Internal

限内部使用。 Catalog服务使用此端口与Impala守护程序进行通信。

Impala StateStore Daemon

StateStore HTTP Server Port

25010

External

StateStore Web界面供管理员监控和排除故障。

StateStore Service Port

24000

Internal

限内部使用。 statestore守护程序在此端口上侦听注册/取消注册请求。

Impala Llama ApplicationMaster

Llama Thrift Admin Port

15002

Internal

限内部使用

Llama Thrift Port

15000

Internal

限内部使用

Llama HTTP Port

15001

External

Llama服务Web界面,供管理员监控和排除故障。

2. java.sql.SQLException: Cannot create PoolableConnectionFactory (Method not supported)

jmeter测试kerberos认证的impala接口时,出现的错误。

 3. impala刚启动后,运行正常,一段时间后,响应时间边长。查看catalog日志

W0104 14:13:52.062723 16850 RetryingMetaStoreClient.java:148] MetaStoreClient lost connection. Attempting to reconnect.
Java exception follows:
org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection timed out
	at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
	at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
	at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:346)
	at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:423)
	at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:405)
	at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
	at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
	at org.apache.hadoop.hive.thrift.TFilterTransport.readAll(TFilterTransport.java:62)
	at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
	at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
	at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1262)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1248)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1271)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:101)
	at com.sun.proxy.$Proxy5.getTable(Unknown Source)
	at org.apache.impala.catalog.CatalogServiceCatalog.reloadTable(CatalogServiceCatalog.java:1011)
	at org.apache.impala.service.CatalogOpExecutor.execResetMetadata(CatalogOpExecutor.java:3125)
	at org.apache.impala.service.JniCatalog.resetMetadata(JniCatalog.java:156)
Caused by: java.net.SocketException: Connection timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
	at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
	... 23 more
W0104 14:13:53.067286 16850 TIOStreamTransport.java:112] Error closing output stream.
Java exception follows:
java.net.SocketException: Socket closed
	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:116)
	at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
	at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
	at org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)
	at org.apache.thrift.transport.TSocket.close(TSocket.java:194)
	at org.apache.thrift.transport.TSaslTransport.close(TSaslTransport.java:372)
	at org.apache.thrift.transport.TSaslClientTransport.close(TSaslClientTransport.java:37)
	at org.apache.hadoop.hive.thrift.TFilterTransport.close(TFilterTransport.java:52)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:554)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.reconnect(HiveMetaStoreClient.java:332)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:98)
	at com.sun.proxy.$Proxy5.getTable(Unknown Source)
	at org.apache.impala.catalog.CatalogServiceCatalog.reloadTable(CatalogServiceCatalog.java:1011)
	at org.apache.impala.service.CatalogOpExecutor.execResetMetadata(CatalogOpExecutor.java:3125)
	at org.apache.impala.service.JniCatalog.resetMetadata(JniCatalog.java:156)

  

posted @ 2018-11-21 13:40  duaner92  阅读(1483)  评论(0编辑  收藏  举报