Oozie调度hive报错application application failed 2 times due to applicationmaster for attempt appattempt_ timed out. failing the application.

    <action name="xxx">
        <hive xmlns="uri:oozie:hive-action:0.5">
            <job-xml>${nameNode}/xxx/hive-site.xml</job-xml>
            <configuration>
                <property>
                    <name>oozie.launcher.mapreduce.map.java.opts</name>
                    <value>-XX:PermSize=512m -XX:MaxPermSize=512m</value>
                </property>
            </configuration>
            <script>xxxx.sql</script>
            <param>gn=${gn}</param>
            <param>dt=${dt}</param>
         </hive>
         <ok to="end"/>
         <error to="fail"/>
  </action>

 

    <action name="xxx">
        <hive xmlns="uri:oozie:hive-action:0.5">
            <job-xml>${nameNode}/xxxx/hive-site.xml</job-xml>

            <configuration>
            <property>
            <name>oozie.launcher.mapreduce.map.java.opts</name>
            <value>-XX:PermSize=512m -XX:MaxPermSize=512m</value>
            </property>
            <property>
            <name>oozie.launcher.mapreduce.map.memory.mb</name>
            <value>512</value>
            </property>
            <property>
            <name>oozie.launcher.mapreduce.reduce.memory.mb</name>
            <value>512</value>
            </property>
            </configuration>
            
            <script>${baseUri}/xxx.sql</script>

            <param>dt=${dt}</param>

         </hive>
         <ok to="xxx"/>
         <error to="failed-email"/>
    </action>

 

 

设置配置。

workflow编写

    在workflow中配置以下两个参数，用来降低Oozie launcher内存占用

1.  
   oozie.launcher.mapreduce.map.memory.mb 512 --减少给“hive2等”oozie.launcher作业分配的资源
2.  
    
3.  
   oozie.launcher.yarn.app.mapreduce.am.resource.mb 512 --减少oozie.launcher使用AppMaster资源的总内存大小。

 

报错如下截图 ：

 

 

Oozie调度优化与原理参考：

https://blog.csdn.net/godlovedaniel/article/details/106094675