Skip to main content

How to set up proxy for Data Collector and Transformer in DataOps platform?


antonio.rosario
StreamSets Employee

If you want to set up a proxy configuration for Data Collector and Transformer you can do it from the DataOps Platform.

When you are creating your Deployment, advance to the second step. There, in Configure Deployment tab, go to Advanced Configuration. Then, go to Proxy tab. Here you can set up the parameters you need, for HTTP and HTTPS connection.

 

For HTTP:

http.proxyHost=
http.proxyPort=
http.proxyUser=
http.proxyPassword=

For HTTPS:

https.proxyHost=
https.proxyPort=
https.proxyUser=
https.proxyPassword=

Additionally, you want to exclude some hostnames from being proxied, you can set up the following parameter:

http.nonProxyHosts=

Here you can found an example of proxy server with authentication:

http.proxyHost=111.22.3.444
http.proxyPort=3128
http.proxyUser=REDACTED
http.proxyPassword=REDACTED
https.proxyHost=111.22.3.444
https.proxyPort=3128
https.proxyUser=REDACTED
https.proxyPassword=REDACTED
http.nonProxyHosts=111.222.33.*
jdk.http.auth.tunneling.disabledSchemes=

Note: These properties definitions configure Data Collector to use the same proxy server for both the HTTP and HTTPS protocol handler when the proxy server requires authentication. Note that after the deployment is saved, values defined for the user and password properties display as REDACTED, as shown below. Data Collector is configured to use additional non-proxy hosts.

0 replies

Be the first to reply!

Reply