Facebook's AI image search can 'see' what's in photos

facebook-and-039;s-ai-image-search-can--and-039;see-and-039;-what-and-039;s-in-photos photo 1

If you forget to tag or add a description when uploading a photo or gallery to Facebook, it can be tough to find an image when you need it. Or at least it used to be. The social network revealed today that it built an AI image search system that can "see" things in your photos even when you forget to add the aforementioned identifiers. Facebook says the system uses its Lumos platform to understand the content of photos and videos and quickly sort through the items you've uploaded.

This means that if even if you can't remember when a photo was taken, if you remember the content, you might still be able to find it with ease. Facebook gives the example of searching for "black shirt photo" and the system being able to "see" all of your photos with a black shirt, even if they aren't tagged as such. This also means that you'll be able to sort through photos your friends have shared to find what you're looking for rather than having to rely on tags and text descriptions.

Of course, for this to work Lumos has to be able to recognize objects when they appear in photos. Facebook developers used deep learning and a neural network to train the system to identify objects using tens of millions of photos with the proper annotations. By doing so, the image search can pick up on scenes, objects, animals, places, attractions and clothing items. The system also factors in some degree of diversity so the search results aren't a bunch of similar images. Not only is this handy with search, but it will also help Facebook describe images and video to users who are visually impaired.

facebook-and-039;s-ai-image-search-can--and-039;see-and-039;-what-and-039;s-in-photos photo 2

Recommended stories

How to Crop an Image in Photoshop

Cropping photos is one of the most basic, but important, photo editing skills. A crooked horizon or something distracting on the edge can ruin a great image.

More stories

How to Keep People from Knowing You Read Their Message in Google Hangouts

There’s a new trend in the world of instant messaging: letting other people see when you’ve read their message. I can see how this is helpful, but it’s also sometimes annoying—what if you read a message but can’t respond immediately? For many people, they feel like it makes them look rude,

Wearable Tech... For your....DOG?!

From Fitbits to Apple Watches, wearable technology has taken center stage when it comes to monitoring health, keeping track of notifications and even a general...

How to Change Drive Icons in Windows

If you’ve ever wished you could change the icon Windows uses for a drive in File Explorer, then you’re in luck. We have two ways to show you how to do just that.