Apple begins beta testing Audio Intelligence for Apple Watch

New features for Apple Watch Series 12 and Ultra 4 include Live Rewind and Siri Recaps to help users remember conversations.

Apple begins beta testing Audio Intelligence for Apple Watch
Photo: TechCrunch

Apple is rolling out beta testing for its AI-powered Audio Intelligence technology for the Apple Watch. Initially for developers in the iOS 27.3 update, the technology was first announced at the company's Surprise and Shine hardware event in September. The features are available for Apple Watch Series 12 and Apple Watch Ultra 4 wearers.

The technology includes four opt-in features: detecting important sounds, identifying songs, catching up on conversations, and taking notes. Sound recognition helps deaf and hard-of-hearing users identify sirens, alarms, or doorbells, while song recognition uses the Shazam app to identify music. Live Rewind allows users to see a text snippet of what was said in the last 15 seconds by double-pressing the digital crown.

Siri Recaps allows users to take high-level notes of conversations through summaries consisting of a short sentence and bullet points. The feature identifies key points such as important dates, deadlines, or pricing, but does not identify speakers, save raw audio, or provide word-for-word transcriptions. Users can save these recaps to the Notes app or Journal app, but if they do nothing, the recaps delete themselves within seven days.

Apple designed the features to respect privacy following backlash to AI recording devices like Meta's AI glasses. To signal recording, an audible chime and animation appear when the digital crown is double-pressed. The technology relies on the S11 chip, built-in microphones, and Apple Intelligence models running on the iPhone.

The system uses a secure enclave in the always-on processor to handle a dedicated audio buffer, which prevents the raw audio from being accessible to anyone, including Apple. Lightweight AI models on the S11 chip detect if a wearer is part of a conversation before transferring the audio to the iPhone's secure enclave for processing.

Key facts

  • Audio Intelligence features are entering beta testing for developers in the iOS 27.3 update.
  • The features include Live Rewind, which displays a text snippet of the last 15 seconds of conversation.

Three perspectives

Neutral

Apple is testing new AI-powered Audio Intelligence features for the Apple Watch Series 12 and Ultra 4.

Positive

The technology can help deaf and hard-of-hearing users identify important sounds like sirens or doorbells.

Negative

The features that listen to human conversations, Live Rewind and Siri Recaps, have arrived following backlash to AI recording devices.

Your week in news, every Wednesday

The biggest stories of the week for your edition, in your inbox every Wednesday morning, your time. Free, and you can unsubscribe at any time.

Choose your news coverage

Please choose and confirm your coverage.

All sections

Edition