According to a blog post on the Microsoft website, the updated app will automatically detect whiteboards, documents and business cards in real time and the camera settings would intelligently adjust to these types of photos. It appears that once the shutter clicks, the app uses AI to enhance the image, in a way that it crops edges, boosts color and tone, sharpening focus and tweaking the angle to render the image in a straight-on perspective.
It has become a habit for many smartphone users to use their phone cameras to capture almost every moment passing in each day, both in daylight or at night. Microsoft then, has taken a step further to make iOS users to enjoy more out of this habit by using Microsoft Pix, not only when they help them to easily take beautiful pictures using artificial intelligence but now to also take pictures of documents, whiteboards and, business cards, to look extremely great.
Josh Weisberg, a principal program manager in the Computational Photography Group within Microsoft’s research organization in Redmond, Washington, said they have data that shows people are taking a lot of whiteboard photos at work, that they are doing a lot of document scanning.
Weisberg’s team recently released an update based on the app data and customer feedback on Microsoft Pix, that includes enhanced deep-learning capabilities around image understanding to address several productivity scenarios. Meanwhile, for those who want to download now, it is available on iTunes presently.
On another note, the ‘Microsoft’s Pix’s image correction and alignment algorithms are similar to those found on Microsoft Office Lens, a mobile app used to take pictures of whiteboards and documents that can be saved to OneDrive or converted into editable applications such as Word and PowerPoint.
Though, there are a bit of differences between both apps yet they are complimentary. While Microsoft Pix is out front pushing the boundaries of using AI to take pictures of everything from a snapshot of your new watch to the whiteboard in your morning meeting, Office Lens remains the best tool to easily integrate productivity images across the suite of Office products.
Also, the productivity scenarios added to Microsoft Pix is a part of a broader push to enhance the app’s ability to infer user intent and offer intelligent actions. “In this case, we get you a much better photo of a whiteboard without any effort on your part,” Weisberg said. “In the future, we will continue to improve Pix’s AI capabilities to work on your behalf and save you time and give you better results.” He assured.
To make it more interactive, the productivity scenarios which is the update to Microsoft Pix comes with a set of effects that can be applied to images on whiteboards and documents, like adding lines to a whiteboard image so that it looks like a sheet of notebook paper. These effects leverage on the same style transfer technology that the Microsoft Pix team released in June, 2017.
Weisberg reinstate that the team had the idea that the styles that was shipped a few months ago shouldn’t be limited to just fun photos and that was why they built a number of effects that are more appropriate for these productivity types.