Я относительно новичок в SBT и работаю над проектом, который требует подключения Spark к реестру схем Cloudera (который ранее был реестром схем Hortonworks до того, как Cloudera приобрела HWX). В целях тестирования я пытаюсь запустить тестовый код на своем локальном компьютере.
Я пытаюсь добавить зависимость, которая требовала от преобразователя указывать (насколько я понимаю) правильный репозиторий.
name := "KafkaClouderaSchemaRegistry"
version := "0.1"
scalaVersion := "2.11.12"
evictionWarningOptions in update := EvictionWarningOptions.default.withWarnTransitiveEvictions(false)
assemblyMergeStrategy in assembly := {
case PathList("META-INF", xs @ _*) => MergeStrategy.discard
case x => MergeStrategy.first
}
lazy val raiz = (project in file("."))
.settings(mainClass in Compile := Some("TestApplication"))
resolvers += "Hortonworks" at "https://repo.hortonworks.com/content/repositories/releases"
libraryDependencies ++= Seq(
"com.hortonworks.registries" % "schema-registry-serdes" % "0.8.0",
"org.apache.kafka" % "kafka-clients" % "2.0.0",
"com.typesafe" % "config" % "1.3.4",
"ch.qos.logback" % "logback-classic" % "1.1.3" % Runtime,
"com.hortonworks" % "spark-schema-registry" % "1.1.0.3.1.5.14-1"
)
Я получаю следующее исключение, когда sbt пытается импортировать все зависимости:
[warn] io problem while parsing ivy file: https://repo.hortonworks.com/content/repositories/releases/com/hortonworks/spark-schema-registry/1.1.0.3.1.5.14-1/spark-schema-registry-1.1.0.3.1.5.14-1.pom: Impossible to load parent for file:/home/gustavo/.ivy2/cache/com.hortonworks/spark-schema-registry/ivy-1.1.0.3.1.5.14-1.xml.original. Parent=com.hortonworks#spark-schema-registry-parent;1.1.0.3.1.5.14-1
[warn] module not found: com.hortonworks#spark-schema-registry;1.1.0.3.1.5.14-1
[warn] ==== local: tried
[warn] /home/gustavo/.ivy2/local/com.hortonworks/spark-schema-registry-parent/1.1.0.3.1.5.14-1/ivys/ivy.xml
[warn] ==== public: tried
[warn] https://repo1.maven.org/maven2/com/hortonworks/spark-schema-registry-parent/1.1.0.3.1.5.14-1/spark-schema-registry-parent-1.1.0.3.1.5.14-1.pom
[warn] ==== local-preloaded-ivy: tried
[warn] /home/gustavo/.sbt/preloaded/com.hortonworks/spark-schema-registry-parent/1.1.0.3.1.5.14-1/ivys/ivy.xml
[warn] ==== local-preloaded: tried
[warn] file:////home/gustavo/.sbt/preloaded/com/hortonworks/spark-schema-registry-parent/1.1.0.3.1.5.14-1/spark-schema-registry-parent-1.1.0.3.1.5.14-1.pom
[warn] ==== Hortonworks: tried
[warn] https://repo.hortonworks.com/content/repositories/releases/com/hortonworks/spark-schema-registry-parent/1.1.0.3.1.5.14-1/spark-schema-registry-parent-1.1.0.3.1.5.14-1.pom
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.hortonworks#spark-schema-registry;1.1.0.3.1.5.14-1: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn] Note: Unresolved dependencies path:
[warn] com.hortonworks:spark-schema-registry:1.1.0.3.1.5.14-1 (/home/gustavo/Projetos/KafkaClouderaSchemaRegistryConnection/build.sbt#L19-26)
[warn] +- kafkaclouderaschemaregistry:kafkaclouderaschemaregistry_2.11:0.1
Я проверил pom на https://repo.hortonworks.com/content/repositories/releases/com/hortonworks/spark-schema-registry/1.1.0.3.1.5.14-1/spark-schema-registry-1.1.0.3.1.5.14-1.pom и похоже указывает на неопределенную / несуществующую родительскую зависимость:
<parent>
<groupId>com.hortonworks</groupId>
<artifactId>spark-schema-registry-parent</artifactId>
<version>1.1.0.3.1.5.14-1</version>
<relativePath>../pom.xml</relativePath>
</parent>
Есть ли обходные пути для импорта этой зависимости?
Спасибо