Sebastix on Nostr: Should I go with trying to import ? There are too many models to pick one at first. I ...

Should I go with https://github.com/ollama/ollama trying to import https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B?

There are too many models to pick one at first. I guess I have to start simple.

Where are the local LLM experts here? #askNostr

quoting
nevent1q…k2qx

Whoohoo one of my Turing RK1 32GB compute modules on my Turing Pi 2 board is up and running with Ubuntu Server 22.04

https://docs.turingpi.com/docs/turing-rk1-specs-and-io-ports

🥸
This thing has a NPU, which is completely new to me. What can I do with it? Use it for a local LLM?

https://docs.turingpi.com/docs/turing-rk1-neural-processing-unit-npu