pyspark 出现pyspark.sql.utils.IllegalArgumentException: 'requirement failed: Column prediction must be of type double but was actually float.'异常

在pyspark的交互式环境下调用pysark.ml中的MulticlassClassificationEvaluator执行下列命令做评估时会出现下面那个问题,但在代码中通过spark-submit提交时则可以正常运行。

from pyspark.ml.evaluation import  MulticlassClassificationEvaluator
evaluatorMC = MulticlassClassificationEvaluator().setLabelCol("score").setPredictionCol("prediction")
Accuracy = evaluator.evaluate(predictions)

 

posted @ 2020-04-05 21:02  秋夜花开  阅读(2289)  评论(0编辑  收藏  举报