天天看点

IDEA下sparkMLlib出现java.lang.AbstractMethodError错误

在写sparkMLlib程序的时候 出现 java.lang.AbstractMethodError错误,at org.apache.spark.internal.Logging$class.initializeLogIfNecessary(Logging.scala:99)

。。。balabalabala

这个一般是包的版本出现了问题,

我当时用的包 spark-mllib 2.1.0 改成 2.3.0错误解决。

libraryDependencies += "org.apache.spark" % "spark-mllib_2.11" % "2.3.0"      

build.sbt具体内容容下:

name := "Simple Project"
version := "1.0"
scalaVersion := "2.11.8"
libraryDependencies += "org.apache.spark" % "spark-core_2.11" % "2.1.0"
libraryDependencies += "org.apache.hbase" % "hbase-client" % "1.1.2"
libraryDependencies += "org.apache.hbase" % "hbase-common" % "1.1.2"
libraryDependencies += "org.apache.hbase" % "hbase-server" % "1.1.2"
//libraryDependencies += "org.apache.spark" % "spark-sql" % "8.0.15"
libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.2.0"
libraryDependencies += "mysql" % "mysql-connector-java" % "8.0.15"
libraryDependencies += "org.apache.spark" %% "spark-hive" % "2.3.0"
libraryDependencies += "org.apache.spark" % "spark-mllib_2.11" % "2.3.0"
           

继续阅读