Mixedbread
In the process, we also conducted many ablations to understand what makes a ColBERT model better, and what does not. Among other things, we find that the embedding dimension can be lowered quite aggressively while retaining most of the model's performance.