2017-08-03 159 views
1

我想使用hbase hortonworks连接器。 github guideHortonworks shc未解决的依赖关系

但我不知道如何将它导入到我的项目中。 我有以下build.sbt:

name := "project" 

version := "1.0" 

scalaVersion := "2.11.8" 

libraryDependencies ++= Seq(
    "org.apache.spark" % "spark-core_2.11" % "2.2.0", 
    "org.apache.spark" % "spark-sql_2.11" % "2.2.0", 
    "org.scala-lang" % "scala-compiler" % "2.11.8", 
    "com.hortonworks" % "shc" % "1.1.2-2.1-s_2.11-SNAPSHOT" 
) 

,这让我的follwing未解决的依赖:

Error:Error while importing SBT project:
...
[warn] ==== local: tried [warn] ivy.xml [warn] ==== public: tried [warn]
https://repo1.maven.org/maven2/com/hortonworks/shc/1.1.2-2.1-s_2.11-SNAPSHOT/shc-1.1.2-2.1-s_2.11-SNAPSHOT.pom [info] Resolving jline#jline;2.12.1 ... [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] ::
UNRESOLVED DEPENDENCIES :: [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: com.hortonworks#shc;1.1.2-2.1-s_2.11-SNAPSHOT: not found [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] [warn] Note: Unresolved dependencies path: [warn] com.hortonworks:shc:1.1.2-2.1-s_2.11-SNAPSHOT (build.sbt#L8-14) [warn] +- default:project_2.11:1.0 [trace] Stack trace suppressed: run 'last *:ssExtractDependencies' for the full output. [trace] Stack trace suppressed: run 'last :update' for the full output. [error] (:ssExtractDependencies) sbt.ResolveException: unresolved dependency: com.hortonworks#shc;1.1.2-2.1-s_2.11-SNAPSHOT: not found [error] (*:update) sbt.ResolveException: unresolved dependency: com.hortonworks#shc;1.1.2-2.1-s_2.11-SNAPSHOT: not found [error] Total time: 7 s, completed 3 août 2017 11:36:37

回答

0

我的建议是不要去使用Spark的最最新的版本,因为所有的最新版本有一些错误需要修复。尝试使用2.1.2火花版本,而不是2.2.0,并转到maven存储库试试这个link

在这里,你会得到火花的所有相关依赖关系。

0

在您的解决方案中,您需要添加代表存储库的resolvers行。

scalaVersion := "2.11.12" 

val sparkVersion = "2.1.0" 

resolvers += "Hortonworks Repository" at "http://repo.hortonworks.com/content/repositories/releases/" 

libraryDependencies += "org.apache.spark" %% "spark-core" % sparkVersion 
libraryDependencies += "org.apache.spark" %% "spark-sql" % sparkVersion 

libraryDependencies ++= Seq(
    "com.hortonworks" % "shc-core" % "1.1.1-2.1-s_2.11" 
)