Apple has shown off some innovative accessibility features that will allow iPhone and Apple Watch users with disabilities new tools to navigate the world. The new features, according to the company’s news release, will help users with navigation, communication, hearing, and other tasks.
Door Detection is Apple’s newest navigation tool, which will assist blind or low-vision users in locating a door within a few feet of their destination. Door Detection uses a LiDAR scanner, camera, and on-device machine learning to tell users the distance between them and the door they’re approaching, as well as whether the door is open or closed, whether it has a knob or handle, and whether it can be pushed or pulled open, as well as read the signs and symbols around it.
Apple Watch Mirroring is a feature that allows people with motor and physical limitations to control their Apple Watch from their iPhone. Using Voice Control and Switch Control instead of tapping the Apple Watch display, you can see what’s on the watch on your iPhone screen due to AirPlay. They can also use hand movements like double-pinching to answer or end a phone call, play or stop media, snap pictures, or restart workouts, which can be highly useful for people who are without limbs or hands.
Live captions will be available for deaf and hard-of-hearing users on not only the iPhone but also the iPad and Mac. This function will assist users in comprehending the context of any audio media content and conservation, whether held in person, over the phone, via FaceTime, or through video conferencing. Live Captions will attribute auto-transcribed language to call participants in FaceTime group chats, making it easier for deaf and hard-of-hearing users to tell who’s speaking. Caption size can also be changed to make captions easier to read.
These new features were unveiled in honor of Global Accessibility Awareness Day, and they seek to make impaired users’ lives easier than ever. Later this year, they will be distributed as updates.