someone on Nostr: a common benchmark for LLMs is truthfulQA. like a lot of things in the disinformation ...
a common benchmark for LLMs is truthfulQA. like a lot of things in the disinformation world; it is a misnomer. while it has some trivial truth, it has also harmful lies hidden among trivial truth. 🫡
Published at
2024-07-29 02:38:32Event JSON
{
"id": "c70d4fbd25e49e3e95e1577601c5cfa29d5d7024ff330090864614225ba6524c",
"pubkey": "9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1",
"created_at": 1722213512,
"kind": 1,
"tags": [],
"content": "a common benchmark for LLMs is truthfulQA. like a lot of things in the disinformation world; it is a misnomer. while it has some trivial truth, it has also harmful lies hidden among trivial truth. 🫡 \n",
"sig": "d2a17d76ff62fefce8445d0e9fe15257f1172fcc13633e9189731095be6677773ac6d6304edb3fe25870cdfdd8259029c19f2b2fb663976550391e0a0fe5e52c"
}