HDP 相关日志位置

 

 

1. HIVESERVER2 的日志：

/var/log/hive

-rwxrwxrwx 1 hive hadoop      479 1月  14 18:20 hive.err
-rwxrwxrwx 1 hive hadoop     2438 1月  13 20:27 hivemetastore-gc-2024-01-13_20-27-25.log.0.current
-rwxrwxrwx 1 hive hadoop   103264 1月  13 21:47 hivemetastore-gc-2024-01-13_20-27-29.log.0.current
-rwxrwxrwx 1 hive hadoop     2440 1月  14 18:20 hivemetastore-gc-2024-01-14_18-20-33.log.0.current
-rwxrwxrwx 1 hive hadoop   635805 1月  15 16:26 hivemetastore-gc-2024-01-14_18-20-34.log.0.current
-rwxrwxrwx 1 hive hadoop 53508507 1月  15 16:27 hivemetastore.log
-rwxrwxrwx 1 hive hadoop   193825 1月  14 18:20 hivemetastore.log.2024-01-13_1.gz
-rwxrwxrwx 1 hive hadoop   720886 1月  15 06:37 hivemetastore.log.2024-01-14_1.gz
-rwxrwxrwx 1 hive hadoop       52 1月  14 18:20 hive.out
-rwxrwxrwx 1 root root       2432 1月  13 21:16 hiveserver2-gc-2024-01-13_21-16-59.log.0.current
-rwxrwxrwx 1 root root        955 1月  13 21:17 hiveserver2-gc-2024-01-13_21-17-00.log.0.current
-rwxrwxrwx 1 root root      19123 1月  13 21:41 hiveserver2-gc-2024-01-13_21-17-03.log.0.current
-rwxrwxrwx 1 root root       2431 1月  15 15:38 hiveserver2-gc-2024-01-15_15-38-12.log.0.current
-rwxrwxrwx 1 root root        955 1月  15 15:38 hiveserver2-gc-2024-01-15_15-38-13.log.0.current
-rwxrwxrwx 1 root root      13501 1月  15 15:42 hiveserver2-gc-2024-01-15_15-38-14.log.0.current
-rw-r--r-- 1 hdfs hadoop      956 1月  15 16:20 hiveserver2-gc-2024-01-15_16-20-08.log.0.current
-rw-r--r-- 1 hdfs hadoop    18888 1月  15 16:22 hiveserver2-gc-2024-01-15_16-20-10.log.0.current
-rw-r--r-- 1 hdfs hadoop     2434 1月  15 16:25 hiveserver2-gc-2024-01-15_16-25-38.log.0.current
-rw-r--r-- 1 hdfs hadoop      956 1月  15 16:25 hiveserver2-gc-2024-01-15_16-25-39.log.0.current
-rw-r--r-- 1 hdfs hadoop    18565 1月  15 16:25 hiveserver2-gc-2024-01-15_16-25-41.log.0.current
-rwxrwxrwx 1 root root     359711 1月  15 16:26 hiveserver2.log
-rwxrwxrwx 1 root root      14753 1月  15 15:38 hiveserver2.log.2024-01-13_1.gz
[root@hdp01 hive]# pwd
/var/log/hive

 

 

2.查看 metastore日志.

tail /var/log/hive/hivemetastore.log

 

 

 

 

2. ambari-agent 日志

请留意大部分log 在/var/log目录下 .

/var/log/ambari-agent/

ambari-agent running.
Agent PID at: /run/ambari-agent/ambari-agent.pid
Agent out at: /var/log/ambari-agent/ambari-agent.out
Agent log at: /var/log/ambari-agent/ambari-agent.log

 

3. HDP安装目录

/usr/hdp/3.

 

 

 

 

 

 

 

 

 

 

 

 

 

99. 其他目录

1. HDFS

DATA DIRS
 DataNode directories ：
/hadoop/hdfs/data

 NameNode directories 
/hadoop/hdfs/namenode

 SecondaryNameNode Checkpoint directories 
 /hadoop/hdfs/namesecondary
 
  NameNode Backup directory 
  /tmp/upgrades
 
JournalNode Edits directory 
/hadoop/hdfs/journalnode


 NameNode Checkpoint Edits directory 
 ${dfs.namenode.checkpoint.dir}
 
  Hadoop Log Dir Prefix 
  /var/log/hadoop
  
   Hadoop PID Dir Prefix 
   /var/run/hadoop
 
 2.YARN
 
DATA DIRS

YARN NodeManager Local directories
/hadoop/yarn/local

YARN Timeline Service Entity Group FS Store Active directory
/ats/active/

YARN Node Labels FS Store Root directory
/system/yarn/node-labels

YARN NodeManager Recovery directory
{{yarn_log_dir_prefix}}/nodemanager/recovery-state

YARN Timeline Service Entity Group FS Store Done directory
/ats/done/


LOG DIRS

YARN NodeManager Log directories
/hadoop/yarn/log

YARN NodeManager Remote App Log directory

YARN Log Dir Prefix
/var/log/hadoop-yarn


 YARN PID Dir Prefix 
 /var/run/hadoop-yarn
 

3. HIVE 

 DATA DIRS

Hive Metastore Warehouse directory
/warehouse/tablespace/managed/hive

Hive Exec Scratchdir
/tmp/hive


Hive User Install directory
/user/

TEZ Lib URIs
/hdp/apps/${hdp.version}/tez/tez.tar.gz

LOG DIRS

Hive Log Dir
/var/log/hive

HiveServer2 Logging Operation Log Location
/tmp/hive/operation_logs


PID DIRS

Hive PID Dir
/var/run/hive