jb55 on Nostr: used open-webui for the first time with llama.cpp ROCM server + AMD RX 5700 + llama-3 ...
used open-webui for the first time with llama.cpp ROCM server + AMD RX 5700 + llama-3 8B instruct. very slick local ai workflow. speed is very fast. slightly dumber but its not too bad.
Published at
2024-12-02 21:49:20 GMTEvent JSON
{
"id": "5b45958a0ed9f2c516eeb2bb517ea4e89d9e32a0d3ed8e898dcf3e74d863e813",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1733176160,
"kind": 1,
"tags": [
[
"client",
"Damus Notedeck"
]
],
"content": "used open-webui for the first time with llama.cpp ROCM server + AMD RX 5700 + llama-3 8B instruct. very slick local ai workflow. speed is very fast. slightly dumber but its not too bad.\n\nhttps://cdn.jb55.com/s/9cd2bd25b17cba21.png",
"sig": "768684afaa8ac51cd38ed7f80a5ace70f18e926a64d1eaa437857786c302cdbefebd36e7fdde5740d13cd804c74a8e11f8043366445e8db2bc35432014cdcfa5"
}
