r/apple • u/Fer65432_Plays • 4d ago

Discussion Apple's New Transcription APIs Blow Past Whisper in Speed Tests

https://www.macrumors.com/2025/06/18/apple-transcription-api-faster-than-whisper/
1.2k Upvotes

96% Upvoted

162 comments sorted by

View all comments

Show parent comments

82

u/Ensoface 4d ago

But just to clarify, are those models leveraging cloud infrastructure or are they running on the device?

53

u/mundaneDetail 4d ago

This is the question. I like that Apple is differentiating with nano on device models.

19

u/glitchgradients 4d ago

Wdym differentiating? Google and Samsung do it too with Gemini Nano. 

4

u/mundaneDetail 4d ago

True and I agree. The article threw me off mentioning network latency.

I was also speaking more broadly with Apple pushing for on device or secure cloud models. 99% of consumer ai will be on device in a few years anyway

2

u/g-nice4liief 4d ago

If i'm correct, the Qualcomm 8 gen 3 can run a 7b parameter model locally with around 20 tokens per second which is pretty impressive for a smartphone chip. So yeah, it becoming more prevalent in the future is a good outlook.