Sony has been improving the software to display AR images on mobile devices without lags. SmartAR is software that can extract the feature points of an image taken by a camera, match them with registered images and recognize the structure of a space while estimating the movement of a camera. It does not require “markers,” which work as triggers that are used to select information or video to be superimposed. Also, it can display an AR image as if a virtual object is placed on a real object.
According to a researcher It is now possible to display AR images that accurately follow input images, and users feel that the AR images are more natural.
After the improvement of the software, it was employed for the main function of Sony Computer Entertainment Inc’s “PlayStation Vita” portable game console, and several games using SmartAR were released. Moreover, the software is now used to promote the sales of the Sony Group’s movie and music software.