Kafka问题记录
- kafka读取数据到sparkstreaming是遇到以下这个错误
java.lang.IllegalArgumentException: requirement failed: No output operations registered, so nothing to execute
解决方法:tranformation最后一步产生的那个RDD必须有相应Action操作,例如massages.print()等
2. latest, earliest, none
Exception in thread “main” org.apache.kafka.common.config.ConfigException: Invalid value earliest1 for configuration auto.offset.reset: String must be one of: latest, earliest, none
earliest : 从头开始消费
latest: 消费最新的数据
==0.8=
largest :消费最新的数据
smallest:从头开始消费