What does HackerNews think of distribution?

The toolkit to pack, ship, store, and deliver container content

Language: Go

Under the hood it does a few things I'll shed some light on (at a high level!):

1. Running the model: it's built on the open-source (and amazing) llama.cpp project for running quantized (i.e. compressed) models like Llama 2 (launched yesterday) that will fit in memory on even a commodity Mac. It's similar to their "server" example as a starting point.

2. Downloading and storing models: models are distributed in a way that ensures their integrity and re-usability as much as possible (since they are large files!). For this we use a similar approach as Docker (https://github.com/distribution/distribution)

3. Creating custom models: models can be extended with this new idea we're experimenting with: a Modelfile. What this will do is effectively add "layers" to a model so you can distribute model data together and keep them self-contained. This builds on what I mentioned in 2 – our hope is this will make it easier to extend models like Llama 2 to your own use cases (e.g. a character).

The Apache projects page literally lists "Apache" in front of each of the projects you just mentioned. If I go to the apache streams github page it's url is https://github.com/apache/streams not https://github.com/streams/streams.

Contrast that when I go to the Docker distribution github page the url is https://github.com/distribution/distribution. You don't see anything wrong with that nomenclature? I'm the only one?