2016-01-28 28 views
7

Cercando di convertire XML in JSON in Trident STORM Il mio codice ha funzionato bene nella versione tempesta 0.9.1 e ora abbiamo aggiornato a Ultima versione di Storm 0.10.0 e stiamo ricevendo gli errori di sotto se avete qualche idea su la causa per favore fammi sapere?Jackson errori di lancio

11752 [Thread-56-b-1] ERROR b.s.util - Async loop died! 
java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.JavaType.isReferenceType()Z 
    at com.fasterxml.jackson.databind.deser.BasicDeserializerFactory.findDefaultDeserializer(BasicDeserializerFactory.java:1522) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.deser.BeanDeserializerFactory.findStdDeserializer(BeanDeserializerFactory.java:167) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.deser.BeanDeserializerFactory.createBeanDeserializer(BeanDeserializerFactory.java:132) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.deser.DeserializerCache._createDeserializer2(DeserializerCache.java:403) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.deser.DeserializerCache._createDeserializer(DeserializerCache.java:352) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.deser.DeserializerCache._createAndCache2(DeserializerCache.java:264) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.deser.DeserializerCache._createAndCacheValueDeserializer(DeserializerCache.java:244) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.deser.DeserializerCache.findValueDeserializer(DeserializerCache.java:142) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.DeserializationContext.findRootValueDeserializer(DeserializationContext.java:461) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.ObjectMapper._findRootDeserializer(ObjectMapper.java:3804) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3698) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2714) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.tda.trident.bolt.HdfsStateConvertor$HdfsFileOptions.execute(HdfsStateConvertor.java:278) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.tda.trident.bolt.HdfsStateConvertor.updateState(HdfsStateConvertor.java:462) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.tda.trident.bolt.HdfsUpdater.updateState(HdfsUpdater.java:15) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at com.tda.trident.bolt.HdfsUpdater.updateState(HdfsUpdater.java:9) ~[StormTridentXmlNew-0.0.1-SNAPSHOT.jar:?] 
    at storm.trident.planner.processor.PartitionPersistProcessor.finishBatch(PartitionPersistProcessor.java:98) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at storm.trident.planner.SubtopologyBolt.finishBatch(SubtopologyBolt.java:152) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at storm.trident.topology.TridentBoltExecutor.finishBatch(TridentBoltExecutor.java:253) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at storm.trident.topology.TridentBoltExecutor.checkFinish(TridentBoltExecutor.java:286) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at storm.trident.topology.TridentBoltExecutor.execute(TridentBoltExecutor.java:360) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at backtype.storm.daemon.executor$fn__6214$tuple_action_fn__6216.invoke(executor.clj:670) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at backtype.storm.daemon.executor$mk_task_receiver$fn__6137.invoke(executor.clj:426) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at backtype.storm.disruptor$clojure_handler$reify__5713.onEvent(disruptor.clj:58) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:125) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:99) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:80) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at backtype.storm.daemon.executor$fn__6214$fn__6227$fn__6278.invoke(executor.clj:808) ~[storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at backtype.storm.util$async_loop$fn__543.invoke(util.clj:475) [storm-core-0.10.0.2.3.2.0-2950.jar:0.10.0.2.3.2.0-2950] 
    at clojure.lang.AFn.run(AFn.java:22) [clojure-1.6.0.jar:?] 
    at java.lang.Thread.run(Thread.java:744) [?:1.7.0_45] 

Il mio schermo maven output durante la creazione di POM è come mostrato di seguito.

[INFO] --- maven-shade-plugin:1.4:shade (default) @ StormTridentXmlNew --- 
[INFO] Including org.apache.hadoop:hadoop-auth:jar:2.7.1.2.3.2.0-2950 in the shaded jar. 
[INFO] Including org.apache.curator:curator-framework:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.storm:storm-hdfs:jar:0.10.0.2.3.2.0-2950 in the shaded jar. 
[INFO] Including org.yaml:snakeyaml:jar:1.11 in the shaded jar. 
[INFO] Including com.hmsonline:storm-jms:jar:0.2.2 in the shaded jar. 
[INFO] Including org.apache.geronimo.specs:geronimo-jms_1.1_spec:jar:1.1.1 in the shaded jar. 
[INFO] Including com.tibco.ems:tibjms:jar:5.1 in the shaded jar. 
[INFO] Including org.springframework:spring-beans:jar:4.1.3.RELEASE in the shaded jar. 
[INFO] Including org.springframework:spring-core:jar:4.1.3.RELEASE in the shaded jar. 
[INFO] Including commons-logging:commons-logging:jar:1.2 in the shaded jar. 
[INFO] Including org.springframework:spring-context:jar:4.1.3.RELEASE in the shaded jar. 
[INFO] Including org.springframework:spring-aop:jar:4.1.3.RELEASE in the shaded jar. 
[INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar. 
[INFO] Including org.springframework:spring-expression:jar:4.1.3.RELEASE in the shaded jar. 
[INFO] Including org.springframework:spring-jms:jar:4.1.3.RELEASE in the shaded jar. 
[INFO] Including org.springframework:spring-messaging:jar:4.1.3.RELEASE in the shaded jar. 
[INFO] Including org.springframework:spring-tx:jar:4.1.3.RELEASE in the shaded jar. 
[INFO] Including com.fasterxml.jackson.core:jackson-core:jar:2.6.5 in the shaded jar. 
[INFO] Including com.fasterxml.jackson.core:jackson-annotations:jar:2.6.5 in the shaded jar. 
[INFO] Including com.fasterxml.jackson.core:jackson-databind:jar:2.6.5 in the shaded jar. 
[INFO] Including com.fasterxml.jackson.dataformat:jackson-dataformat-xml:jar:2.6.5 in the shaded jar. 
[INFO] Including com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.6.5 in the shaded jar. 
[INFO] Including org.codehaus.woodstox:stax2-api:jar:3.1.4 in the shaded jar. 
[INFO] Including org.codehaus.woodstox:woodstox-core-asl:jar:4.4.1 in the shaded jar. 
[INFO] Including javax.xml.stream:stax-api:jar:1.0-2 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-client:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.7.1 in the shaded jar. 
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.7.1 from the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-yarn-server-common:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-yarn-api:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.7.1 in the shaded jar. 
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.7.1 from the shaded jar. 
[INFO] Including javax.xml.bind:jaxb-api:jar:2.2.2 in the shaded jar. 
[INFO] Including javax.activation:activation:jar:1.1 in the shaded jar. 
[INFO] Including com.sun.jersey:jersey-client:jar:1.9 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-annotations:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-common:jar:2.7.1 in the shaded jar. 
[INFO] Including com.google.guava:guava:jar:11.0.2 in the shaded jar. 
[INFO] Including commons-cli:commons-cli:jar:1.2 in the shaded jar. 
[INFO] Including org.apache.commons:commons-math3:jar:3.1.1 in the shaded jar. 
[INFO] Including xmlenc:xmlenc:jar:0.52 in the shaded jar. 
[INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar. 
[INFO] Including commons-codec:commons-codec:jar:1.4 in the shaded jar. 
[INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar. 
[INFO] Including commons-net:commons-net:jar:3.1 in the shaded jar. 
[INFO] Including commons-collections:commons-collections:jar:3.2.1 in the shaded jar. 
[INFO] Including javax.servlet:servlet-api:jar:2.5 in the shaded jar. 
[INFO] Including org.mortbay.jetty:jetty:jar:6.1.26 in the shaded jar. 
[INFO] Including org.mortbay.jetty:jetty-util:jar:6.1.26 in the shaded jar. 
[INFO] Including javax.servlet.jsp:jsp-api:jar:2.1 in the shaded jar. 
[INFO] Including com.sun.jersey:jersey-core:jar:1.9 in the shaded jar. 
[INFO] Including com.sun.jersey:jersey-json:jar:1.9 in the shaded jar. 
[INFO] Including org.codehaus.jettison:jettison:jar:1.1 in the shaded jar. 
[INFO] Including com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 in the shaded jar. 
[INFO] Including com.sun.jersey:jersey-server:jar:1.9 in the shaded jar. 
[INFO] Including asm:asm:jar:3.1 in the shaded jar. 
[INFO] Including log4j:log4j:jar:1.2.17 in the shaded jar. 
[INFO] Including net.java.dev.jets3t:jets3t:jar:0.9.0 in the shaded jar. 
[INFO] Including org.apache.httpcomponents:httpclient:jar:4.1.2 in the shaded jar. 
[INFO] Including org.apache.httpcomponents:httpcore:jar:4.1.2 in the shaded jar. 
[INFO] Including com.jamesmurty.utils:java-xmlbuilder:jar:0.4 in the shaded jar. 
[INFO] Including commons-lang:commons-lang:jar:2.6 in the shaded jar. 
[INFO] Including commons-configuration:commons-configuration:jar:1.6 in the shaded jar. 
[INFO] Including commons-digester:commons-digester:jar:1.8 in the shaded jar. 
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar. 
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar. 
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.10 from the shaded jar. 
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.10 from the shaded jar. 
[INFO] Including org.apache.avro:avro:jar:1.7.4 in the shaded jar. 
[INFO] Including com.thoughtworks.paranamer:paranamer:jar:2.3 in the shaded jar. 
[INFO] Including org.xerial.snappy:snappy-java:jar:1.0.4.1 in the shaded jar. 
[INFO] Including com.google.protobuf:protobuf-java:jar:2.5.0 in the shaded jar. 
[INFO] Including com.google.code.gson:gson:jar:2.2.4 in the shaded jar. 
[INFO] Including com.jcraft:jsch:jar:0.1.42 in the shaded jar. 
[INFO] Including org.apache.curator:curator-client:jar:2.7.1 in the shaded jar. 
[INFO] Including org.apache.curator:curator-recipes:jar:2.7.1 in the shaded jar. 
[INFO] Including com.google.code.findbugs:jsr305:jar:3.0.0 in the shaded jar. 
[INFO] Including org.apache.htrace:htrace-core:jar:3.1.0-incubating in the shaded jar. 
[INFO] Including org.apache.zookeeper:zookeeper:jar:3.4.6 in the shaded jar. 
[INFO] Including io.netty:netty:jar:3.7.0.Final in the shaded jar. 
[INFO] Including org.apache.commons:commons-compress:jar:1.4.1 in the shaded jar. 
[INFO] Including org.tukaani:xz:jar:1.0 in the shaded jar. 
[INFO] Including org.apache.hadoop:hadoop-hdfs:jar:2.7.1 in the shaded jar. 
[INFO] Including commons-daemon:commons-daemon:jar:1.0.13 in the shaded jar. 
[INFO] Including io.netty:netty-all:jar:4.0.23.Final in the shaded jar. 
[INFO] Including xerces:xercesImpl:jar:2.9.1 in the shaded jar. 
[INFO] Including org.fusesource.leveldbjni:leveldbjni-all:jar:1.8 in the shaded jar. 
[INFO] Replacing original artifact with shaded artifact. 
+0

Si prega di inviare il tuo pom.xml. Mi piacerebbe provarlo. – Bnrdo

risposta

0

L'ultima versione di Storm sta avendo jackson-core-2.3.1.jar nella sua cartella lib e il mio jar grasso che creo usando maven sta avendo un'altra versione delle dipendenze di jackson. Questo è il motivo per cui quando invio il mio jar in storm stormo viene lanciato questi errori di metodo No in fase di esecuzione ..

Ho cambiato il mio POM per utilizzare la stessa versione delle dipendenze di jackson che tempesta utilizza e tutto funziona bene.

+0

Significato, in realtà non volevi Jackson 2.6? – Marco99

+0

Ho bisogno di xml per fare il json marshalling. Jackson ha questa caratteristica nella versione che STORM usa internamente e che sarà sufficiente per me. – RAJESH

5

Sembra che tu abbia molte versioni di vasetti Jackson e il vostro percorso di classe si riferisce alcuni Jackson vaso prima di 2,6 in fase di esecuzione.

Classe ResolvedType ha introdotto isReferenceType() dalla versione 2.6 in poi. Si prega di fare riferimento link qui sotto:

http://googleweblight.com/?lite_url=http://fasterxml.github.io/jackson-core/javadoc/2.6/com/fasterxml/jackson/core/type/ResolvedType.html&ei=ochB8Ipc&lc=en-IN&geid=10&s=1&m=71&ts=1454581842&sig=ALL1Aj7I2EAu3AoKmOu6FKbtFTTuKU02Bg#a-isReferenceType()

favore, assicurarsi di riferimento la versione destra o uno superiore in fase di esecuzione. Se non richiesto, puoi rimuovere/eliminare i vecchi vasi Jackson.

Spero che questo aiuti.

0

Questo problema sembra provenire da più versioni di classi di jackson nel classpath. Puoi rimuovere le versioni indesiderate. Al momento della stesura di questo articolo. La versione corrente di Jackson Isis 2.7.1.