Skip to content

Commit

Permalink
cleanup
Browse files Browse the repository at this point in the history
  • Loading branch information
augchan42 committed Nov 26, 2023
1 parent edc7e13 commit 661e0fe
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion _posts/2023-11-26-Its Hard to find an Uncensored Model.md
Original file line number Diff line number Diff line change
Expand Up @@ -125,7 +125,7 @@ filtered dataset further to see why.

## Spectacular Reddit Post on Huggingface Transformers / Llama.cpp / GGUF /GGML

https://www.reddit.com/r/LocalLLaMA/comments/178el7j/transformers_llamacpp_gguf_ggml_gptq_other_animals/
[Awesome Breakdown Post](https://www.reddit.com/r/LocalLLaMA/comments/178el7j/transformers_llamacpp_gguf_ggml_gptq_other_animals/)

Some clarifications/findings from the above:
GGML isn't necessarily quantized. I ran the GGML converter on my GPT-J float 16 model. It remained float 16,
Expand Down

0 comments on commit 661e0fe

Please sign in to comment.