RLHF tells you what you want to hear.
2026-09-19
RLHF trains a model to match what people like. That is not the same as doing the work. The clip's point is that disappointment is built in: the score is preference, not the job.
Jev creator @CompleteSkeptic on why RLHF is guaranteed to disappoint
Jev creator @CompleteSkeptic on why RLHF is guaranteed to disappoint - because it tells you what you want to hear.
we want to automate everything and yet our models are literally tuned to optimize for human feedback.