Question

Streamset testframework isn't working

  • 21 May 2024
  • 2 replies
  • 49 views

Hi, 

 

Using this blog (https://www.phdata.io/blog/how-to-install-streamsets-test-framework/) by Priya Janjanam, I’m trying to setup Streamsets test framework on my local Windows machine. 

 

My local Windows machine has Docker install. I’ve downgraded my python version from 3.12 to python version 3.6 and I followed the instructions in the blog to install framework library and checking the version. However, when I entering the commands below:-

stf build extras

 

I get the following error message

2024-05-21 02:12:03 PM [INFO] [streamsets.testframework.cli] Pulling Docker image streamsets/testframework-4.x:latest ...
Traceback (most recent call last):
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\lib\site-packages\docker\api\client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\lib\site-packages\requests\models.py", line 960, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localnpipe/v1.44/containers/96469dcef92ad643a10283978bfa0ba7caaa0e794cefa99ccad5a398dd4e6d75/archive?path=%2Froot%2Ftestframework%2Fstreamsets%2Ftestframework%2Fcli%5Ccli.ini

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\wongp1\AppData\Local\Programs\Python\Python36\lib\runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "C:\Users\wongp1\AppData\Local\Programs\Python\Python36\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\Scripts\stf.exe\__main__.py", line 7, in <module>
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\lib\site-packages\streamsets\testframework\cli\__init__.py", line 150, in main
    ini_parser.read_string(_read_ini_file(client, docker_image))
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\lib\site-packages\streamsets\testframework\cli\__init__.py", line 366, in _read_ini_file
    path=os.path.join(DOCKER_IMAGE_CLI_DIR, 'cli.ini'))
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\lib\site-packages\docker\utils\decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\lib\site-packages\docker\api\container.py", line 748, in get_archive
    self._raise_for_status(res)
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\lib\site-packages\docker\api\client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "C:\Users\wongp1\PycharmProjects\Streamset-testing\venv36\lib\site-packages\docker\errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localnpipe/v1.44/containers/96469dcef92ad643a10283978bfa0ba7caaa0e794cefa99ccad5a398dd4e6d75/archive?path=%2Froot%2Ftestframework%2Fstreamsets%2Ftestframework%2Fcli%5Ccli.ini: Not Found ("Could not find the file /root/testframework/streamsets/testframework/cli\cli.ini in container 96469dcef92ad643a10283978bfa0ba7caaa0e794cefa99ccad5a398dd4e6d75")
 

Can someone help me fix my error message? thanks

 


2 replies

Hi @wongp1,

According to the official documentation for setting up Streamsets Test Framework, the following command is sufficient

 “$ pip3 install streamsets-testframework”

you can also check that the installation is successful or not by using the command

“$ stf --version”

Official Site : “Installation — StreamSets Test Framework 4.0.0 documentation

and the “stf build extras” command is basically used for building external libraries although at the initial stage of installation it’s not required.

Use “stf --version”, I confirm the library is installed. 

Can you get the test framework to work your Windows developer’s machine?

Reply