val result=data.select("termIndices").rdd.map {
case Row(termIndices: mutable.WrappedArray[int]) =>
val res=termIndices.iterator.map{
t=>termMap.get(t)
}
res.toArray
}
result.saveAsTextFile("file:///D:/data/ld/ld3")
打开文件,文件中的内容结果为
[Lscala.Option;@7af280cd
[Lscala.Option;@12e3ec85
[Lscala.Option;@4aaab25e
[Lscala.Option;@6bbfebcf
[Lscala.Option;@7bc42a7a
http://blog.csdn.net/tuntunwang/article/details/51362492
RDD result中存储的res.toArray是一个对象,
解决办法为:
val result=data.select("termIndices").rdd.map {
case Row(termIndices: mutable.WrappedArray[int]) =>
val res=termIndices.iterator.map{
t=>termMap.get(t)
}
val d=res.toArray
val sent = for (i <- Range(0, d.size) )yield d(i)
sent
}
result.saveAsTextFile("file:///D:/data/ld/ld3")