Preparing System

This section outlines the steps required to prepare your system to install NCP

Update the local package index:

sudo apt update -y

Install Docker & Docker-compose:

Install docker-CLI:

Install

curl -fsSL https://get.docker.com -o get-docker.sh
sudo sh get-docker.sh

Verify

ubuntu@NCP:~$ docker --version
Docker version 25.0.0, build e758fe5
ubuntu@NCP:~$

Install docker-compose:

sudo curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose

sudo chmod +x /usr/local/bin/docker-compose

Installing NVIDIA GPU Drivers:

Install GPU Drivers:

sudo apt install nvidia-utils-535 -y
sudo apt install ubuntu-drivers-common -y
sudo apt install nvidia-driver-535 -y

Reboot the system:

sudo reboot

Installing NVIDIA Toolkit:

We will leverage the container toolkit provided by NVIDIA to deploy the NCP backend as an additional docker container along with NCP services packaged as containers.

Install NVIDIA Container toolkit:

curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg   && curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list |     sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' |     sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list   &&     sudo apt-get update

sudo apt-get install -y nvidia-container-toolkit

Configure the toolkit:

Configure

sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker

Verify

sudo docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi

Verify GPU Acess to Docker