Jailbroken PS5 Achieves Over 100 Tokens/Second for Local AI Models

A modified PlayStation 5 console has demonstrated the capability to run local artificial intelligence models at a speed exceeding 100 tokens per second. This significant advancement was achieved through a fork of the PS5LM project, which has been adapted to run natively on the console.

The jailbroken PS5 leverages its central processing unit (CPU) for AI computations while also accessing the graphics processing unit (GPU) and additional RAM. This integration allows for more complex and faster AI processing directly on the gaming hardware, opening up new possibilities for on-device AI applications beyond traditional gaming.