geulpu 0.20.0

Source: pypi.org

Read original source

At a glance

A deterministic local LLM engine and debugger — bit-reproducible GGUF inference on your own GPU, written in the geul language (Windows x64 app with CUDA or Vulkan, Linux x86-64 app with CUDA)