About

I really care about free and open source culture. At least since the release of Meta's Llama 2 and it's obscure "Open Source" license, these Kind of pseudo-"Open Source" licenses are spreading like cancer in the world of AI models. But there are still some models that are getting released under really free licensees like Apache 2 or Creative Commons Licensees.

Since the Llama.cpp Project is releasing software to run converted and quantized large language models on consumer-grade PC's , there has grown an ecosystem and a need for quantized models that can be run with this software. theBlokedoes a really great job in providing large amounts of the newest available models as .gguffiles, the file format for quantized models used by Llama.cpp. Unfortunately, he appears to be less interested in the licensing aspects of these models and primarily focuses on their performance (which is quite understandable). Don't get this wrong: Some genuinely open-source models are incredibly powerful. However, some of them appear neglected, receiving less attention. This led me to make a deliberate choice to focus on models with genuinely free licenses.

Explore the collection, and you'll find various finetuned models, all released under real open-source licenses.

Website maddes8cht.github.io profile for maddes8cht on Stack Exchange, a network of free, community-driven Q&A sites profile of maddes8cht on GitHub, where the world build software HuggingFace profile of maddes8cht Twitter profile of maddes8cht