Skip to content

Latest commit

 

History

History
77 lines (63 loc) · 1.96 KB

File metadata and controls

77 lines (63 loc) · 1.96 KB

Python computing node

Python computing node for otl_interpreter

Getting Started

Deploy on host machine

Prerequisites

You need:

  • python 3.9.7

Deploy

  1. Install virtual environment from requirements.txt:
    python3 -m venv ./venv
    source ./venv/bin/activate
    pip install -r ./requirements.txt
  2. Configure computing_node.conf:
    cp ./python_computing_node/rest.conf.example ./python_computing_node/rest.conf
  3. Deploy otl interpreter or just run kafka
  4. Launch python computing node server:
    python ./python_computing_node/main.py

Deploy with conda

Prerequisites

  1. Miniconda
  2. Conda-Pack

Deploy

  1. Create virtual environment for project:

    make dev
  2. Configure computing_node.conf.

  3. To activate virtual environment:

    conda activate ./venv
  4. Deploy otl interpreter or just run kafka

  5. Launch python computing node server:

python ./python_computing_node/main.py

Deployment

  1. Unpack tar archive to destination directory
  2. Create config
    cp ./python_computing_node/computing_node.conf.example ./python_computing_node/computing_node.conf
  3. Unpack one or more execution environments in execution environment directory. For example see pp_exec_env
  4. Run start.sh

Built With

  • Conda
  • python 3.9.7
    And python packages:
    • aiokafka==0.7.2
    • kafka-python==2.0.2
    • aiohttp==3.8.1
    • gunicorn==20.1.0
    • bottle==0.12.19

Versioning

We use SemVer for versioning. For the versions available, see the tags on this repository.

License

See the LICENSE.md file for details