SwanBitcoin445X250

Apple iPhone with iOS16 and camera-assisted object location using AR
NEARBY INTERACTION: An iOS 16 update will enable hands-free interactions with nearby smart devices

Apple users will be able to switch on smart devices such as e-bikes, speakers and other accessories from an iPhone or Apple Watch running the forthcoming iOS 16 update without needing to unlock their own device or take it out of their bag or pocket via third-party apps that use both ultra wideband (UWB) and Bluetooth Low Energy (BLE) technology.

Apple has released an update to its Nearby Interaction framework[1] that allows developers and accessory manufacturers to incorporate proximity-based functionalities such as object detection and device activation into apps that will be able to communicate with other devices even when the app is running in the background and the user is not actively interacting with it.

The framework update will also enable more precise camera-assisted object location and allow enhanced artificial reality (AR) content so apps will be able to direct users to objects such as museum exhibits more accurately and allow them to locate objects in the “AR world”, Apple says.

To date, developers have been able to access the UWB technology in Apple’s U1 chip in order to use Nearby Interaction (NI) in apps to “allow users to point to other devices, find friends, and show controls or other UI based on distance and direction to an accessory,” Apple’s Jon Schoenberg explains in a video recorded during the company’s recent Worldwide Developer Conference 2022[2].

“However, when your app transitions to the background or when the user locks the screen on iOS and watchOS, any running NI sessions are suspended until the application returns to the foreground.

“This means you needed to focus on hands-on user experiences when interacting with your accessory.

Hands-free interaction

“Starting in iOS 16,

Read more from our friends at NFC World