You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to run a Kafka Connect S3 sink container using confluent s3 plugin
DockerFile
FROM bitnami/kafka:latest
# Create the plugins directoryRUN mkdir -p /opt/bitnami/kafka/plugins
# Set the command to start Kafka Connect with the provided configurationCMD ["/opt/bitnami/kafka/bin/connect-standalone.sh", "/bitnami/kafka/config/connect-standalone.properties", "/bitnami/kafka/config/s3-sink.properties"]
[2024-07-23 08:09:57,660] INFO Kafka Connect worker initialization took 6771ms (org.apache.kafka.connect.cli.AbstractConnectCli:141)
[2024-07-23 08:09:57,660] INFO Kafka Connect starting (org.apache.kafka.connect.runtime.Connect:51)
[2024-07-23 08:09:57,662] INFO Herder starting (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:107)
[2024-07-23 08:09:57,662] INFO Worker starting (org.apache.kafka.connect.runtime.Worker:231)
[2024-07-23 08:09:57,662] INFO Starting FileOffsetBackingStore with file /tmp/connect.offsets (org.apache.kafka.connect.storage.FileOffsetBackingStore:63)
[2024-07-23 08:09:57,664] INFO Worker started (org.apache.kafka.connect.runtime.Worker:241)
[2024-07-23 08:09:57,664] INFO Herder started (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:110)
[2024-07-23 08:09:57,664] INFO Initializing REST resources (org.apache.kafka.connect.runtime.rest.RestServer:219)
[2024-07-23 08:09:57,686] INFO Adding admin resources to main listener (org.apache.kafka.connect.runtime.rest.RestServer:234)
[2024-07-23 08:09:57,728] INFO DefaultSessionIdManager workerName=node0 (org.eclipse.jetty.server.session:334)
[2024-07-23 08:09:57,728] INFO No SessionScavenger set, using defaults (org.eclipse.jetty.server.session:339)
[2024-07-23 08:09:57,729] INFO node0 Scavenging every 660000ms (org.eclipse.jetty.server.session:132)
[2024-07-23 08:09:57,879] WARN unavailable (org.eclipse.jetty.server.handler.ContextHandler.ROOT:2374)
java.lang.IllegalArgumentException
at jersey.repackaged.org.objectweb.asm.ClassVisitor.<init>(ClassVisitor.java:79)
at jersey.repackaged.org.objectweb.asm.ClassVisitor.<init>(ClassVisitor.java:64)
at org.glassfish.jersey.server.internal.scanning.AnnotationAcceptingListener$AnnotatedClassVisitor.<init>(AnnotationAcceptingListener.java:172)
at org.glassfish.jersey.server.internal.scanning.AnnotationAcceptingListener$AnnotatedClassVisitor.<init>(AnnotationAcceptingListener.java:156)
at org.glassfish.jersey.server.internal.scanning.AnnotationAcceptingListener.<init>(AnnotationAcceptingListener.java:124)
at org.glassfish.jersey.server.internal.scanning.AnnotationAcceptingListener.newJaxrsResourceAndProviderListener(AnnotationAcceptingListener.java:96)
at org.glassfish.jersey.server.ResourceConfig.scanClasses(ResourceConfig.java:903)
at org.glassfish.jersey.server.ResourceConfig._getClasses(ResourceConfig.java:864)
at org.glassfish.jersey.server.ResourceConfig.getClasses(ResourceConfig.java:773)
at org.glassfish.jersey.server.ResourceConfig$RuntimeConfig.<init>(ResourceConfig.java:1216)
at org.glassfish.jersey.server.ResourceConfig$RuntimeConfig.<init>(ResourceConfig.java:1187)
at org.glassfish.jersey.server.ResourceConfig.createRuntimeConfig(ResourceConfig.java:1183)
at org.glassfish.jersey.server.ApplicationHandler$RuntimeConfigConfigurator.init(ApplicationHandler.java:184)
at org.glassfish.jersey.server.ApplicationHandler.lambda$initialize$0(ApplicationHandler.java:294)
at java.base/java.util.Arrays$ArrayList.forEach(Arrays.java:4204)
at org.glassfish.jersey.server.ApplicationHandler.initialize(ApplicationHandler.java:294)
at org.glassfish.jersey.server.ApplicationHandler.<init>(ApplicationHandler.java:261)
at org.glassfish.jersey.servlet.WebComponent.<init>(WebComponent.java:311)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:154)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:339)
at javax.servlet.GenericServlet.init(GenericServlet.java:244)
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:632)
at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:415)
at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750)
at java.base/java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:357)
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:510)
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
at java.base/java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:310)
at java.base/java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:735)
at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:762)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:774)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.apache.kafka.connect.runtime.rest.RestServer.initializeResources(RestServer.java:285)
at org.apache.kafka.connect.runtime.rest.ConnectRestServer.initializeResources(ConnectRestServer.java:44)
at org.apache.kafka.connect.runtime.Connect.start(Connect.java:55)
at org.apache.kafka.connect.cli.AbstractConnectCli.startConnect(AbstractConnectCli.java:143)
at org.apache.kafka.connect.cli.AbstractConnectCli.run(AbstractConnectCli.java:94)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:182)
[2024-07-23 08:09:57,884] ERROR Failed to start Connect (org.apache.kafka.connect.cli.AbstractConnectCli:145)
org.apache.kafka.connect.errors.ConnectException: Unable to initialize REST resources
at org.apache.kafka.connect.runtime.rest.RestServer.initializeResources(RestServer.java:287)
at org.apache.kafka.connect.runtime.rest.ConnectRestServer.initializeResources(ConnectRestServer.java:44)
at org.apache.kafka.connect.runtime.Connect.start(Connect.java:55)
at org.apache.kafka.connect.cli.AbstractConnectCli.startConnect(AbstractConnectCli.java:143)
at org.apache.kafka.connect.cli.AbstractConnectCli.run(AbstractConnectCli.java:94)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:182)
Caused by: javax.servlet.ServletException: org.glassfish.jersey.servlet.ServletContainer-112ca081==org.glassfish.jersey.servlet.ServletContainer@3617b3c7{jsp=null,order=-1,inst=true,async=true,src=EMBEDDED:null,STARTED}
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:650)
at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:415)
at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750)
at java.base/java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:357)
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:510)
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
at java.base/java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:310)
at java.base/java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:735)
at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:762)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:774)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.apache.kafka.connect.runtime.rest.RestServer.initializeResources(RestServer.java:285)
... 5 more
Caused by: java.lang.IllegalArgumentException
at jersey.repackaged.org.objectweb.asm.ClassVisitor.<init>(ClassVisitor.java:79)
at jersey.repackaged.org.objectweb.asm.ClassVisitor.<init>(ClassVisitor.java:64)
at org.glassfish.jersey.server.internal.scanning.AnnotationAcceptingListener$AnnotatedClassVisitor.<init>(AnnotationAcceptingListener.java:172)
at org.glassfish.jersey.server.internal.scanning.AnnotationAcceptingListener$AnnotatedClassVisitor.<init>(AnnotationAcceptingListener.java:156)
at org.glassfish.jersey.server.internal.scanning.AnnotationAcceptingListener.<init>(AnnotationAcceptingListener.java:124)
at org.glassfish.jersey.server.internal.scanning.AnnotationAcceptingListener.newJaxrsResourceAndProviderListener(AnnotationAcceptingListener.java:96)
at org.glassfish.jersey.server.ResourceConfig.scanClasses(ResourceConfig.java:903)
at org.glassfish.jersey.server.ResourceConfig._getClasses(ResourceConfig.java:864)
at org.glassfish.jersey.server.ResourceConfig.getClasses(ResourceConfig.java:773)
at org.glassfish.jersey.server.ResourceConfig$RuntimeConfig.<init>(ResourceConfig.java:1216)
at org.glassfish.jersey.server.ResourceConfig$RuntimeConfig.<init>(ResourceConfig.java:1187)
at org.glassfish.jersey.server.ResourceConfig.createRuntimeConfig(ResourceConfig.java:1183)
at org.glassfish.jersey.server.ApplicationHandler$RuntimeConfigConfigurator.init(ApplicationHandler.java:184)
at org.glassfish.jersey.server.ApplicationHandler.lambda$initialize$0(ApplicationHandler.java:294)
at java.base/java.util.Arrays$ArrayList.forEach(Arrays.java:4204)
at org.glassfish.jersey.server.ApplicationHandler.initialize(ApplicationHandler.java:294)
at org.glassfish.jersey.server.ApplicationHandler.<init>(ApplicationHandler.java:261)
at org.glassfish.jersey.servlet.WebComponent.<init>(WebComponent.java:311)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:154)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:339)
at javax.servlet.GenericServlet.init(GenericServlet.java:244)
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:632)
... 19 more
[2024-07-23 08:09:57,884] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:67)
[2024-07-23 08:09:57,885] INFO Stopping REST server (org.apache.kafka.connect.runtime.rest.RestServer:354)
[2024-07-23 08:09:57,887] INFO Stopped o.e.j.s.ServletContextHandler@6a9164d1{/,null,STOPPED} (org.eclipse.jetty.server.handler.ContextHandler:1159)
[2024-07-23 08:09:57,894] INFO Stopped http_8083@1f50f75{HTTP/1.1, (http/1.1)}{0.0.0.0:8083} (org.eclipse.jetty.server.AbstractConnector:383)
[2024-07-23 08:09:57,894] INFO node0 Stopped scavenging (org.eclipse.jetty.server.session:149)
[2024-07-23 08:09:57,898] INFO REST server stopped (org.apache.kafka.connect.runtime.rest.RestServer:383)
[2024-07-23 08:09:57,898] INFO Herder stopping (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:115)
[2024-07-23 08:09:57,899] INFO Worker stopping (org.apache.kafka.connect.runtime.Worker:248)
[2024-07-23 08:09:57,899] INFO Stopped FileOffsetBackingStore (org.apache.kafka.connect.storage.FileOffsetBackingStore:71)
[2024-07-23 08:09:57,900] INFO Metrics scheduler closed (org.apache.kafka.common.metrics.Metrics:684)
[2024-07-23 08:09:57,900] INFO Closing reporter org.apache.kafka.common.metrics.JmxReporter (org.apache.kafka.common.metrics.Metrics:688)
[2024-07-23 08:09:57,900] INFO Metrics reporters closed (org.apache.kafka.common.metrics.Metrics:694)
[2024-07-23 08:09:57,900] INFO App info kafka.connect for 100.64.0.23:8083 unregistered (org.apache.kafka.common.utils.AppInfoParser:88)
[2024-07-23 08:09:57,900] INFO Worker stopped (org.apache.kafka.connect.runtime.Worker:269)
[2024-07-23 08:09:57,901] INFO Herder stopped (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:126)
[2024-07-23 08:09:57,901] INFO Kafka Connect stopped (org.apache.kafka.connect.runtime.Connect:72)
Need your help on fixing this.
The text was updated successfully, but these errors were encountered:
I'm trying to run a Kafka Connect S3 sink container using confluent s3 plugin
DockerFile
build command
docker build -t kafka-connect-s3:10.5.13 .
downloaded all the plugins from confluent
https://www.confluent.io/hub/confluentinc/kafka-connect-s3
list of plugins
connect-standalone.properties
s3-sink.properties
run container
podman run -d --name my-kafka-connect-s3 --restart=unless-stopped -v /root/kafka-connect:/bitnami/kafka/config -v /root/k-connect:/opt/bitnami/kafka/plugins -e CLASSPATH=/opt/bitnami/kafka/plugins/* kafka-connect-s3:10.5.13
error from container log
podman logs kafka-connect-s3:10.5.13
Need your help on fixing this.
The text was updated successfully, but these errors were encountered: