I have a StreamSets Data Collector running in Docker and when I run a pipeline with Kafka Consumer I am seeing these error messages:
The configuration = was supplied but isn't a known config
The configuration schema.registry.url = was supplied but isn't a known config
How do I get past this error?
Best answer by DashView original
The most probable cause of this is network connectivity. You should ensure that the Kafka endpoint is accessible from within Data Collector's Docker container. Here are a couple of things you can try:
Then from the Docker container, run:
And if you are running Kafka cluster on AWS, set the security group of your MSK cluster to be the same as your client machine and your Data Collector's EC2 instance's security groups. Then, add an inbound rule to that security group allowing "all traffic" from itself (the security group). For more details on this, click here.