IBM brings its Spyre AI accelerator into PyTorch as a native device
IBM has integrated its Spyre inference accelerator into PyTorch through a new library, torch-spyre. The company says the implementation delivers up to 1.7× faster prefill and 2.4× faster decoding on its Granite 3.3 8B model.Watch Desk analy
Open discussion →