Drop-in replacement for OpenAI running LLMs on consumer-grade hardware with no GPU required. It's an API to run ggml compatible models: llama, gpt4all, rwkv, whisper, vicuna, koala, gpt4all-j, ...
(NewsNation) — New Jersey’s attorney general has filed a lawsuit against the private prison company that operates Delaney Hall, alleging state health officials were denied full access to the ICE ...