Running real-time speech transcription locally on MacBooks demands extreme energy efficiency. We benchmarked whisper.cpp across CoreML ANE, Metal GPU, and ARM NEON CPU quantization.
"The Apple Neural Engine delivers 4x lower energy consumption during continuous background transcription compared to GPU shaders."
Our benchmark results highlight why optimizing model layer placement across the ANE and CPU is crucial for battery life on thin-and-light laptops.