Question

Installation inquiry, StreamSets Data Collector

  • 30 April 2023
  • 3 replies
  • 63 views

Is there any way to install it locally?
Can't login to StreamSets Control Hub after installing with dockerThe login error is as follows.
java.lang.RuntimeException: DPM Login failed, status code '403': {"message":"Authentication failed"}	at com.streamsets.datacollector.cli.sch.SchAdmin.retrieveUserToken(SchAdmin.java:264)	at com.streamsets.datacollector.cli.sch.SchAdmin.enableDPM(SchAdmin.java:82)	at com.streamsets.datacollector.restapi.AdminResource.enableDPM(AdminResource.java:142)	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)	at java.lang.reflect.Method.invoke(Method.java:498)	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144)	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161)	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:160)	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99)	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389)	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347)	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)	at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326)	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)	at org.glassfish.jersey.internal.Errors.process(Errors.java:315)	at org.glassfish.jersey.internal.Errors.process(Errors.java:297)	at org.glassfish.jersey.internal.Errors.process(Errors.java:267)	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317)	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)	at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473)	at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427)	at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)	at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)	at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:760)	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1617)	at com.streamsets.datacollector.http.GroupsInScopeFilter.lambda$doFilter$0(GroupsInScopeFilter.java:75)	at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:44)	at com.streamsets.datacollector.http.GroupsInScopeFilter.doFilter(GroupsInScopeFilter.java:74)	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)	at com.streamsets.datacollector.restapi.rbean.rest.RestResourceContextFilter.doFilter(RestResourceContextFilter.java:30)	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)	at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:310)	at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:264)	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)	at com.streamsets.datacollector.http.LocaleDetectorFilter.doFilter(LocaleDetectorFilter.java:27)	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)	at org.eclipse.jetty.servlets.HeaderFilter.doFilter(HeaderFilter.java:117)	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)	at com.streamsets.pipeline.http.MDCFilter.doFilter(MDCFilter.java:35)	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:501)	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1592)	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1296)	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1562)	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1211)	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)	at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:239)	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:221)	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)	at org.eclipse.jetty.server.Server.handle(Server.java:500)	at com.streamsets.lib.security.http.LimitedMethodServer.handle(LimitedMethodServer.java:29)	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:386)	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:562)	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:378)	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:270)	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:388)	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)	at java.lang.Thread.run(Thread.java:750)

 

I used a Google account.
Please help me. thank you

3 replies

Userlevel 3
Badge

As the message says, Data Collector is now a headless engine. You'd do design in the Pipelines section of Platform rather than by accessing Data Collector directly. 

If you're using the DataOps Platform, you should be deploying Data Collector deployments from within the Platform rather than trying to register separately-started SDC instances back to SCH. Can you try by creating a deployment in Platform and then report back?

After deploying in the form of a docker image on the platform and trying again, the following message is confirmed.

Question 1. How can I solve the message on the attached screen?

Question 2. How can I use StreamSets Data Collector in an environment where there is no external Internet connection?
 

StreamSets Data Collector is currently under review for implementation.Please answer the question.thank you
Userlevel 3
Badge

If you're using the DataOps Platform, you should be deploying Data Collector deployments from within the Platform rather than trying to register separately-started SDC instances back to SCH. Can you try by creating a deployment in Platform and then report back?

Reply