Generative AI At The Cutting Edge
Generative AI has seized everyone’s attention through the combination of creativity, versatility, and scale. However, the boom in scale that has rendered this possible has become a problem in itself, with AI training and inference becoming the pace-setting compute workload of the 2020s. This is a major barrier to bringing the possibilities of the new AIs to the edge – which might be where much of their potential value lies.