Note: Connection to Hive and Impala with JDBC stages are NOT supported.
StreamSets comes bundled with the open-source Hive JDBC driver in the Hive Metadata processor, the Hive Metastore destination, and the Hive Query executor.
Here are some examples of JDBC URL String based on the driver that the user installed. For the exact string, please see also documentation of the driver that you are using.
Using the default driver, URLs will look like the following:
- Unsecured: jdbc:hive2://hive-server2-host.company.com:10000/dbName
- LDAP Auth: jdbc:hive2://hive-server2-host.company.com:10000/dbName;user=username;password=*******
- Kerberos: jdbc:hive2://hive-server2-host.company.com:10000/dbName;principal=hive/hive-server2-host.company.com@COMPANY.COM
- SSL + Kerberos: jdbc:hive2://hive-server2-host.company.com:10000/dbName;principal=hive/hive-server2-host.company.com@COMPANY.COM;ssl=true;sslTrustStore=/path/to/truststore.jks
Cloudera also provides a Hive driver. Using the Cloudera Hive driver:
- Unsecured: jdbc:hive2://hive-server2-host.company.com:10000/dbName
- LDAP Auth: jdbc:hive2://hive-server2-host.company.com:10000/dbName;AuthMech=3;UID=username;PWD=*******
- Kerberos: jdbc:hive2://hive-server2-host.company.com:10000/dbName;AuthMech=1;KrbRealm=COMPANY.COM;KrbHostFQDN=hive-server2-host.company.com;KrbServiceName=hive
- SSL + Kerberos: jdbc:hive2://hive-server2-host.company.com:10000/dbName;AuthMech=1;KrbRealm=COMPANY.COM;KrbHostFQDN=hive-server2-host.company.com;KrbServiceName=hive;SSL=1;SSLKeyStore=/path/to/truststore.jks
Cloudera also has an Impala driver. Using the Cloudera Impala driver:
- Unsecured: jdbc:impala://impala-daemon-host.company.com:21050/dbName
- LDAP Auth: jdbc:impala://impala-daemon-host.company.com:21050/dbName;AuthMech=3;UID=username;PWD=*******
- Kerberos: jdbc:impala://impala-daemon-host.company.com:21050/dbName;AuthMech=1;KrbRealm=COMPANY.COM;KrbHostFQDN=impala-daemon-host.company.com;KrbServiceName=impala
- SSL + Kerberos: jdbc:impala://impala-daemon-host.company.com:21050/dbName;AuthMech=1;KrbRealm=COMPANY.COM;KrbHostFQDN=impala-daemon-host.company.com;KrbServiceName=impala;SSL=1;SSLKeyStore=/path/to/truststore.jks
Adam Kunicki
August 10, 2021 23:56