Running Real-time Voice AI on Cortex-A: What Actually Matters