Running Uncensored AI via Runpod

Runpod - https://runpod.io

Uncensored Model -  https://huggingface.co/TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

TextGen WebUI - https://github.com/oobabooga/text-generation-webui

Fixing chromadbd installation ERROR: Failed building wheel for hnswlib

When trying to install chromadb on a python environment, using

$ pip install chromadb

This error below might show up:

[...]

      x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/tmp/pip-build-env-lorq5gen/overlay/lib/python3.10/site-packages/pybind11/include -I/tmp/pip-build-env-lorq5gen/overlay/lib/python3.10/site-packages/numpy/core/include -I./hnswlib/ -I/home/p/Documents/dev/python/openai/include -I/usr/include/python3.10 -c ./python_bindings/bindings.cpp -o build/temp.linux-x86_64-cpython-310/./python_bindings/bindings.o -O3 -march=native -fopenmp -DVERSION_INFO=\"0.7.0\" -std=c++14 -fvisibility=hidden
      In file included from /tmp/pip-build-env-lorq5gen/overlay/lib/python3.10/site-packages/pybind11/include/pybind11/detail/../attr.h:13,
                       from /tmp/pip-build-env-lorq5gen/overlay/lib/python3.10/site-packages/pybind11/include/pybind11/detail/class.h:12,
                       from /tmp/pip-build-env-lorq5gen/overlay/lib/python3.10/site-packages/pybind11/include/pybind11/pybind11.h:13,
                       from /tmp/pip-build-env-lorq5gen/overlay/lib/python3.10/site-packages/pybind11/include/pybind11/functional.h:12,
                       from ./python_bindings/bindings.cpp:2:
      /tmp/pip-build-env-lorq5gen/overlay/lib/python3.10/site-packages/pybind11/include/pybind11/detail/../detail/common.h:266:10: fatal error: Python.h: No such file or directory
        266 | #include 
            |          ^~~~~~~~~~
      compilation terminated.
      error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for hnswlib
Failed to build hnswlib
ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects

On a Linux system the solution to fix the error above is to install 2 missing libraries:

$ sudo apt install python3-dev

$ sudo apt-get install build-essential -y