third-party evaluation partner
@usgraphics (i have some obvious thoughts for things i would change — make the model take shorter turns, do RLHF for *asking good questions* and deferring to the user for important decisions — but it feels like the actual science of HCI would have better ideas if we still knew how to do it)