Apple begins beta testing Audio Intelligence features for Apple Watch, including Live Rewind and Siri Recaps
Apple has started beta testing its Audio Intelligence features for the Apple Watch Series 12 and Apple Watch Ultra 4, first for developers in iOS 27.3. The four opt-in features are sound recognition, song recognition (via Shazam), Live Rewind and Siri Recaps. The last two listen to conversations, and Apple has designed them around privacy concerns raised by AI recording wearables such as Meta's AI glasses. The article is product news and reports no vulnerability, incident or exploitation.
Detalhes técnicos
- Lightweight AI models on the S11 chip detect a conversation the wearer is part of. The raw audio is processed in a dedicated buffer inside a secure enclave and is reachable only by the paired iPhone, through a secure pairing mechanism.
- On the iPhone, on-device processing converts the audio into condensed text. The text is encrypted and sent to Apple's Private Cloud Compute (PCC) to generate the recap. The recap and the summarizations used to create it are deleted from PCC immediately afterwards.
- Recaps are accessible only to the user and are encrypted when synced across the user's Apple devices.
- Live Rewind shows the last 15 seconds of speech as text. Unsaved snippets are deleted after 30 seconds. A chime and an animation signal to bystanders that something was captured.
- Siri Recaps does not identify speakers, save raw audio or produce word-for-word transcripts. It omits sensitive data such as government identifiers, financial and authentication data and certain personal identifiers. It does not record while the user listens to music on headphones or uses noise cancellation. Unreviewed recaps are deleted within seven days.
- Users can enable Recaps manually or on a schedule, and can turn them off at any time from Control Center.
Remediação
No remediation is required. Privacy-conscious users and administrators can leave the features disabled, since they are opt-in, or restrict Siri Recaps to a schedule.
Linha do tempo
-
Apple begins beta testing Audio Intelligence features for Apple Watch, including Live Rewind and Siri Recaps
ler a análise desta fonte ocultar
Apple has started beta testing its Audio Intelligence features for the Apple Watch Series 12 and Apple Watch Ultra 4, first for developers in iOS 27.3. The four opt-in features are sound recognition, song recognition (via Shazam), Live Rewind and Siri Recaps. The last two listen to conversations, and Apple has designed them around privacy concerns raised by AI recording wearables such as Meta's AI glasses. The article is product news and reports no vulnerability, incident or exploitation.
Technical Details
- Lightweight AI models on the S11 chip detect a conversation the wearer is part of. The raw audio is processed in a dedicated buffer inside a secure enclave and is reachable only by the paired iPhone, through a secure pairing mechanism.
- On the iPhone, on-device processing converts the audio into condensed text. The text is encrypted and sent to Apple's Private Cloud Compute (PCC) to generate the recap. The recap and the summarizations used to create it are deleted from PCC immediately afterwards.
- Recaps are accessible only to the user and are encrypted when synced across the user's Apple devices.
- Live Rewind shows the last 15 seconds of speech as text. Unsaved snippets are deleted after 30 seconds. A chime and an animation signal to bystanders that something was captured.
- Siri Recaps does not identify speakers, save raw audio or produce word-for-word transcripts. It omits sensitive data such as government identifiers, financial and authentication data and certain personal identifiers. It does not record while the user listens to music on headphones or uses noise cancellation. Unreviewed recaps are deleted within seven days.
- Users can enable Recaps manually or on a schedule, and can turn them off at any time from Control Center.
Remediation
No remediation is required. Privacy-conscious users and administrators can leave the features disabled, since they are opt-in, or restrict Siri Recaps to a schedule.