third-party evaluation partner
@usgraphics at present, it seems like both the design of the harnesses and the trend of RLing the models for “agentic” work over longer time horizons — i.e. optimizing for the human *not* in the loop — does not feel like a user experience that respects the user’s intelligence and agency