https://fossengineer.com/koboldcpp/
Local LLMs with koboldcpp