rohit
Current models are so powerful that this problems gotten worse, because going in subtly wrong directions can be hard to detect! Y'day I realized that Astra had been running an eval on some random synthetic subset of the data instead of the bench, as I asked. Cost me a day!
Andrew Ho
Yesterday I asked Astra to categorize several business meal expenses and to add more description based on short snippets I provided. It did not add more description and instead spammed some slop into my spreadsheet, and I pointed this out, and it apologized. Do people with the