Hugging Face's logo

dr-ry
/
Foundation-Sec-8B-Instruct-GGUF

Text Generation
GGUF
English
llama.cpp
quantized
conversational
Model card Files
xet
Community

Foundation-Sec-8B-Instruct — GGUF (Q4_K_M)

Public GGUF quantization (Q4_K_M) for local inference (llama.cpp / LM Studio / Ollama).

  • File: Foundation-Sec-8B-Instruct-Q4_K_M.gguf
  • Pull via Git LFS.
Downloads last month
19
GGUF
Model size
8B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for dr-ry/Foundation-Sec-8B-Instruct-GGUF

Base model

meta-llama/Llama-3.1-8B
Finetuned
fdtn-ai/Foundation-Sec-8B
Finetuned
fdtn-ai/Foundation-Sec-8B-Instruct
Quantized
(10)
this model