impala 问题
1. This Impala daemon is not ready to accept user requests. Status: Waiting for catalog update from the StateStore.
端口未开启。開啓23000。
涉及impala的端口有:
组件 |
服务 |
端口 |
访问要求 |
说明 |
Impala Daemon |
Impala Daemon Frontend Port |
21000 |
External |
用于通过impala-shell和Cloudera ODBC驱动程序1.2版传输命令和接收结果。 |
Impala Daemon Frontend Port |
21050 |
External |
例如商业智能工具, JDBC,Hue中的Beeswax查询编辑器,以及Cloudera ODBC驱动程序的2.0或更高版本等传输命令和接收结果。 |
|
Impala Daemon Backend Port |
22000 |
Internal |
限内部使用。 Impala守护程序使用此端口相互通信。 |
|
StateStoreSubscriber Service Port |
23000 |
Internal |
限内部使用。 Impala守护程序在此端口上侦听statestore守护程序的更新。 |
|
Impala Daemon HTTP Server Port |
25000 |
External |
供管理员监控和排除故障的Impala Web界面。 |
|
Llama Callback Port |
28000 |
Internal |
限内部使用。 Impala守护进程用于与Llama通信。 |
|
Catalog Daemon |
StateStoreSubscriber Service Port |
23020 |
Internal |
限内部使用。catalog daemon在此端口上侦听statestore守护程序的更新。 |
Catalog HTTP Server Port |
25020 |
External |
Catalog服务Web界面,供管理员监控和排除故障。 |
|
StateStore Service Port |
26000 |
Internal |
限内部使用。 Catalog服务使用此端口与Impala守护程序进行通信。 |
|
Impala StateStore Daemon |
StateStore HTTP Server Port |
25010 |
External |
StateStore Web界面供管理员监控和排除故障。 |
StateStore Service Port |
24000 |
Internal |
限内部使用。 statestore守护程序在此端口上侦听注册/取消注册请求。 |
|
Impala Llama ApplicationMaster |
Llama Thrift Admin Port |
15002 |
Internal |
限内部使用 |
Llama Thrift Port |
15000 |
Internal |
限内部使用 |
|
Llama HTTP Port |
15001 |
External |
Llama服务Web界面,供管理员监控和排除故障。 |
2. java.sql.SQLException: Cannot create PoolableConnectionFactory (Method not supported)
jmeter测试kerberos认证的impala接口时,出现的错误。
3. impala刚启动后,运行正常,一段时间后,响应时间边长。查看catalog日志
W0104 14:13:52.062723 16850 RetryingMetaStoreClient.java:148] MetaStoreClient lost connection. Attempting to reconnect. Java exception follows: org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection timed out at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:346) at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:423) at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:405) at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.hadoop.hive.thrift.TFilterTransport.readAll(TFilterTransport.java:62) at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378) at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297) at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1262) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1248) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1271) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:101) at com.sun.proxy.$Proxy5.getTable(Unknown Source) at org.apache.impala.catalog.CatalogServiceCatalog.reloadTable(CatalogServiceCatalog.java:1011) at org.apache.impala.service.CatalogOpExecutor.execResetMetadata(CatalogOpExecutor.java:3125) at org.apache.impala.service.JniCatalog.resetMetadata(JniCatalog.java:156) Caused by: java.net.SocketException: Connection timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ... 23 more W0104 14:13:53.067286 16850 TIOStreamTransport.java:112] Error closing output stream. Java exception follows: java.net.SocketException: Socket closed at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:116) at java.net.SocketOutputStream.write(SocketOutputStream.java:153) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) at java.io.FilterOutputStream.close(FilterOutputStream.java:158) at org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110) at org.apache.thrift.transport.TSocket.close(TSocket.java:194) at org.apache.thrift.transport.TSaslTransport.close(TSaslTransport.java:372) at org.apache.thrift.transport.TSaslClientTransport.close(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.TFilterTransport.close(TFilterTransport.java:52) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:554) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.reconnect(HiveMetaStoreClient.java:332) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:98) at com.sun.proxy.$Proxy5.getTable(Unknown Source) at org.apache.impala.catalog.CatalogServiceCatalog.reloadTable(CatalogServiceCatalog.java:1011) at org.apache.impala.service.CatalogOpExecutor.execResetMetadata(CatalogOpExecutor.java:3125) at org.apache.impala.service.JniCatalog.resetMetadata(JniCatalog.java:156)