Hello Everyone,
Thank you for the time and help. I had the Kafka Producer running, but am
having some trouble now.
1) Using Maven, I wrote a Kafka Producer similar to the one found here:
https://github.com/pppsunil/HelloKafka/blob/master/src/main/java/com/spnotes/kafka/HelloKafkaProducer.java
2) I am using these jar files: kafka_2.10-0.8.2-beta.jar,
kafka-clients-0.8.2-beta.jar, metrics-core-2.2.0.jar,
scala-library-2.10.4.jar, slf4j-api-1.5.6.jar, slf4j-log4j12-1.5.6.jar
3) I used to submit it via spark-submit script on my ec2-instance, but I
realized it was not good practice and want to submit it via the java
script.
4) I did javac -cp "jar files" HKP.java and got a .class file
5) I did jar cmf manifest.mf (just the class and version) test.jar
HPK.class and got the jar file test.jar
6) I try to run it doing java -cp "jar files" -jar test.jar and I am
getting some "NoClassDefFoundErrors" first I had to download the slf4j-api
jar and now I am getting NoClassDefFoundError:
kafka/producer/ProducerConfig even though I have the Kafka jar files needed
and these 4 jar files worked when doing it through the spark-submit script.
Any suggestions are much appreciated!
Thanks!
Thank you for the time and help. I had the Kafka Producer running, but am
having some trouble now.
1) Using Maven, I wrote a Kafka Producer similar to the one found here:
https://github.com/pppsunil/HelloKafka/blob/master/src/main/java/com/spnotes/kafka/HelloKafkaProducer.java
2) I am using these jar files: kafka_2.10-0.8.2-beta.jar,
kafka-clients-0.8.2-beta.jar, metrics-core-2.2.0.jar,
scala-library-2.10.4.jar, slf4j-api-1.5.6.jar, slf4j-log4j12-1.5.6.jar
3) I used to submit it via spark-submit script on my ec2-instance, but I
realized it was not good practice and want to submit it via the java
script.
4) I did javac -cp "jar files" HKP.java and got a .class file
5) I did jar cmf manifest.mf (just the class and version) test.jar
HPK.class and got the jar file test.jar
6) I try to run it doing java -cp "jar files" -jar test.jar and I am
getting some "NoClassDefFoundErrors" first I had to download the slf4j-api
jar and now I am getting NoClassDefFoundError:
kafka/producer/ProducerConfig even though I have the Kafka jar files needed
and these 4 jar files worked when doing it through the spark-submit script.
Any suggestions are much appreciated!
Thanks!