The “opposite” of a GPU is kinda weird. Graphcore has a strange chip (IPU) that loves tiny batches...but is also massively parallel. It used to cost ~$100k. Now you can get one on Ebay for $160 bucks. The catch is it's almost impossible to use.
See Tweet