Triton Inference Server

docker run --rm -p8000:8000 -p8001:8001 -p8002:8002 
-v C:\Users\j\.models:/models 
nvcr.io/nvidia/tritonserver:25.05-trtllm-python-py3 tritonserver 
--model-repository=/models

curl -v localhost:8000/v2/health/ready

Docker catalog here. Quick start here.

Install make utility on Windows

##### run on powershell and confirm when required

winget install --id=GnuWin32.Make  -e

## Once installed go to below path

C:\Program Files (x86)\GnuWin32\bin

## Add the above path to env PATH variable
## Open cmd propmt and type 

make

Install and Run Locally DeepSeek Janus-Pro on Windows and Python - Corre...

NginX Proxy Manager is a free, open source, GUI for the NginX Reverse Pr...