In reply to @nickcammarata

@nickcammarata I am on the record a while ago (around the time I was arguing with Paul and Jacob Hilton about RLHF work having been bad, so around Jan 2023) about expecting RLHF to produce sycophancy problems. Might dig up the comments. I was most worried the labs would end up