diff --git a/docs/content/features/model-gallery.md b/docs/content/features/model-gallery.md index bc8e524c6988..d9abc2cdb6ff 100644 --- a/docs/content/features/model-gallery.md +++ b/docs/content/features/model-gallery.md @@ -54,6 +54,26 @@ Both views use the same model selection and store the view, search, filter, and selection in the URL. Installing from Explore does not move you away from the catalog; the entry updates in place when the operation finishes. +## NeoHorse-1-9B + +Install NeoHorse-1-9B with automatic selection between Q4_K_M, Q5_K_M, and Q8_0 GGUF builds: + +```bash +local-ai models install neohorse-1-9b-q4 +``` + +To select Q8_0 explicitly: + +```bash +local-ai models install neohorse-1-9b-q4 --variant neohorse-1-9b-q8 +``` + +[NeoHorse-1-9B](https://huggingface.co/TokenRhythm/NeoHorse-1-9B) is a text-only +Qwen3.5-9B fine-tune for coding, reasoning, and tool use. These builds use +llama.cpp, the embedded Jinja chat template, and a 32,768-token default context. +The publisher's [GGUF files](https://huggingface.co/TokenRhythm/NeoHorse-1-9B-GGUF) +are pinned to a revision and verified with SHA256 checksums. + ## NeoHorse-1-4B Install NeoHorse-1-4B with automatic selection between Q4_K_M, Q6_K, and Q8_0 GGUF builds: diff --git a/gallery/index.yaml b/gallery/index.yaml index 92832226e41e..b61f3bf712f6 100644 --- a/gallery/index.yaml +++ b/gallery/index.yaml @@ -15036,6 +15036,108 @@ - filename: llama-cpp/mmproj/mmproj-Qwen_Qwen3.5-2B-f16.gguf sha256: 044a0ea136cca70711ae16e23b24d754b44eab6f2462d187aee4d7c7a9503d36 uri: https://huggingface.co/bartowski/Qwen_Qwen3.5-2B-GGUF/resolve/main/mmproj-Qwen_Qwen3.5-2B-f16.gguf +- &neohorse-1-9b + name: neohorse-1-9b-q4 + url: github:mudler/LocalAI/gallery/virtual.yaml@master + urls: + - https://huggingface.co/TokenRhythm/NeoHorse-1-9B + - https://huggingface.co/TokenRhythm/NeoHorse-1-9B-GGUF + license: apache-2.0 + tags: + - llm + - gguf + - cpu + - gpu + - reasoning + - coding + - tools + variants: + - model: neohorse-1-9b-q5 + - model: neohorse-1-9b-q8 + description: | + NeoHorse-1-9B is TokenRhythm's text-only Qwen3.5-9B fine-tune for coding, + reasoning, and tool use. This build uses Q4_K_M GGUF weights with the + embedded Jinja chat template and a 32K-token default context. + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + options: + - use_jinja:true + parameters: + model: NeoHorse-1-9B-Q4_K_M.gguf + temperature: 1 + top_p: 0.95 + top_k: 20 + min_p: 0 + presence_penalty: 1.5 + repeat_penalty: 1 + template: + use_tokenizer_template: true + files: + - filename: NeoHorse-1-9B-Q4_K_M.gguf + uri: https://huggingface.co/TokenRhythm/NeoHorse-1-9B-GGUF/resolve/ddcb4c939b5392c86a9d2733c7c0ed30db2554fd/NeoHorse-1-9B-Q4_K_M.gguf + sha256: a412add5457474d898ef0bf0cdbc057f7ffc3ea5cedba997c5123d36f116a957 + +- !!merge <<: *neohorse-1-9b + name: neohorse-1-9b-q5 + variants: [] + description: | + NeoHorse-1-9B is TokenRhythm's text-only Qwen3.5-9B fine-tune for coding, + reasoning, and tool use. This build uses Q5_K_M GGUF weights with the + embedded Jinja chat template and a 32K-token default context. + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + options: + - use_jinja:true + parameters: + model: NeoHorse-1-9B-Q5_K_M.gguf + temperature: 1 + top_p: 0.95 + top_k: 20 + min_p: 0 + presence_penalty: 1.5 + repeat_penalty: 1 + template: + use_tokenizer_template: true + files: + - filename: NeoHorse-1-9B-Q5_K_M.gguf + uri: https://huggingface.co/TokenRhythm/NeoHorse-1-9B-GGUF/resolve/ddcb4c939b5392c86a9d2733c7c0ed30db2554fd/NeoHorse-1-9B-Q5_K_M.gguf + sha256: 26eeb64e3835647277d820020e5c2468e9b202103c09978a186815c3391d5e15 + +- !!merge <<: *neohorse-1-9b + name: neohorse-1-9b-q8 + variants: [] + description: | + NeoHorse-1-9B is TokenRhythm's text-only Qwen3.5-9B fine-tune for coding, + reasoning, and tool use. This build uses Q8_0 GGUF weights with the + embedded Jinja chat template and a 32K-token default context. + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + options: + - use_jinja:true + parameters: + model: NeoHorse-1-9B-Q8_0.gguf + temperature: 1 + top_p: 0.95 + top_k: 20 + min_p: 0 + presence_penalty: 1.5 + repeat_penalty: 1 + template: + use_tokenizer_template: true + files: + - filename: NeoHorse-1-9B-Q8_0.gguf + uri: https://huggingface.co/TokenRhythm/NeoHorse-1-9B-GGUF/resolve/ddcb4c939b5392c86a9d2733c7c0ed30db2554fd/NeoHorse-1-9B-Q8_0.gguf + sha256: 519869730bda973ec50bb3ac42cd874569e5f3a57c3e0d5d23a2b5040e93310f + - &neohorse-1-4b name: neohorse-1-4b-q4 url: github:mudler/LocalAI/gallery/virtual.yaml@master