Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
homarp
on Sept 7, 2023
|
parent
|
context
|
favorite
| on:
Running a 180B parameter LLM on a single Apple M2 ...
https://www.reddit.com/r/LocalLLaMA/comments/16bynin/falcon_...
has some more data like sample answers with various level of quantizations
and
https://huggingface.co/TheBloke/Falcon-180B-Chat-GGUF
if you want to try
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
and https://huggingface.co/TheBloke/Falcon-180B-Chat-GGUF if you want to try