Mixedbread
Despite sticking to standard practices and datasets, the resulting models are strong performers. They are some of the best long-context models around, and the 17M one matches ColBERTv2 with 1/6th the parameters and 1/3rd the embed dimension: a perfect edge device retriever!