What does HackerNews think of llm?

Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙

Language: Rust

StableLM: A new open-source language model | Apr 2023

Expand Context ↕

https://github.com/rustformers/llama-rs

StableLM: A new open-source language model | Apr 2023

Expand Context ↕

Hi! I'm a maintainer of https://github.com/rustformers/llama-rs. We're planning to expand our model support soon.

Llama.cpp 30B runs with only 6GB of RAM now | Apr 2023

I'm curious if someone will have to port these enhancements elsewhere, ie: https://github.com/rustformers/llama-rs