Angel - MemoryDataBlock - angel.task.estimize.sample.number

angel.task.estimize.sample.number

val validData = new MemoryDataBlock[LabeledData](isVali)
trainData.resetReadIndex()
try {
  val validSample = (0 until isVali).map(i => validData.put(trainData.read()))
  validData.flush()
} catch {
  case e: Exception =>
    throw new AngelException("Create validData found Error.", e);
} finally {
  validData.clean()
}
  • in

val validData = new MemoryDataBlock[LabeledData](isVali)

there has a angel config parameter to set the size of vList as a ArrayList

this.estimateSampleNumber = conf.getInt("angel.task.estimize.sample.number", 100);
posted @ 2018-07-28 17:22  澄轶  阅读(193)  评论(0编辑  收藏  举报