Apple today announced a suite of accessibility features that will use Apple Intelligence. The new features will be coming later this year. New capabilities are coming for several accessibility features, including Accessibility Reader, Magnifier, Voice Control, and VoiceOver. Also on its way are AI generated subtitles, as well as the ability for wheelchair users to control their rides via the Apple Vision Pro.
The announcement is part of Apple’s annual tradition of previewing new accessibility features ahead of the upcoming Global Accessibility Awareness Day, which is celebrated on the third Thursday of May each year.
The new Apple Intelligence-powered features coming later this year include:
- VoiceOver Image Explorer will use Apple Intelligence to produce more detailed descriptions of images throughout the system. Users will even be able to receive descriptions of photographs, scanned bills, and personal records. A quick press of the iPhone’s Action button will allow users to ask questions about what the camera viewfinder is seeing, asking follow-up questions in natural language.
- Magnifier also uses Apple Intelligence to provide visual descriptions to its high-contrast interface for users with low vision, also accessible via the Action button. It will also offer support for spoken commands like “zoom in” or “turn on flashlight.”
- Voice Control will use natural language input to allow users to describe onscreen elements conversationally, rather than being required to memorize exact label names or numbers.
- Accessibility Reader will gain support for more complex document layouts including scientific articles with multiple columns, images, and tables, plus on-demand summaries and built-in translation. On-demand summaries provide readers the option to get an overview of the article before diving into the details. And users will be able to read text in their native language while retaining custom formatting, font, and colors.
- Generated Subtitles will use on-device speech recognition to automatically transcribe spoken audio in uncaptioned video content. The feature can display transcriptions of spoken audio automatically when captions or subtitles are not already provided, including in clips recorded on iPhone, received from friends and family, or streamed online, across the iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. The feature will initially be available only in English in the U.S. and Canada.
- Power Wheelchair Control for Apple Vision Pro allows users who cannot operate a joystick to use the headset’s precision eye-tracking system as an alternative input method for controlling their wheelchairs. The feature will initially launch with support for the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections.
Smaller additions also coming later this year include:
- Vehicle Motion Cues for visionOS to help reduce motion sickness when using Vision Pro as a passenger in a moving vehicle.
- Apple Vision Pro support for face gestures for performing taps and system actions, plus a new way to select elements with one’s eyes while using Dwell Control.
- Made for iPhone hearing aids will offer more reliable pairing and handoff between Apple devices, as well as an improved setup experience across iOS, iPadOS, macOS, and visionOS.
- Name Recognition, will expand to more than 50 languages globally. The feature notifies users who are deaf or hard of hearing if someone says their name.
- Larger Text support is coming to tvOS, allowing viewers with low vision to increase on-screen text size.
- Sony Access controllers will be supported as a game controller on iOS, iPadOS, and macOS, with full button and thumbstick customization and support for combining two controllers.
- FaceTime will boast a new API to allow sign language interpretation app developers to add a human interpreter to an ongoing video call.
- Touch Accommodations will offer a new way to personalize setup in iOS and iPadOS.
The Hikawa Grip & Stand for iPhone is now available on the Apple online store globally, offering three new colors. The new MagSafe accessory, designed by Los Angeles-based Bailey Hikawa, was developed with accessibility in mind. The adaptive grip and stand helps users hold their iPhone in the way that works best for them. The unique adaptive accessory is available globally for the first time, via a collaboration between Hikawa and PopSockets.
On May 20, Apple The Grove in Los Angeles will host a Today at Apple session with Hikawa, author Shane Burcaw, and actor Alex Barone. Apple says the trio will “discuss the role of iPhone as a pivotal assistive technology, and how accessible design can create inclusive, delightful experiences for everyone.”
All of the announced features are expected to arrive later this year, likely as a part of iOS 27, iPadOS 27, macOS 27, tvOS 27, and visionOS 27, all of which are expected to be unveiled at WWDC next month, with a public release around September.
