April 30, 2018

Facebook Analyzes Billions of Instagram Posts to Train AI Algorithm

Facebook uses your snack and holiday photos on Instagram to teach artificial intelligence (AI) to recognize objects in images. This was announced on the annual Facebook developers summit in 2018, also known as F8. Thanks to the accurate tags that we, the users, assign to our Instagram images, Facebook managed to build an AI which is 1-2% more accurate than the AI’s of e.g. Google (Google Vision API) and Amazon (Amazon Recognition).

Facebook developers summit 2018

We rely almost entirely on hand-curated, human-labeled data sets. If a person hasn’t spent the time to label something specific in an image, even the most advanced computer vision systems won’t be able to identity it” said Mike Schroepfer. Even so, due to the analysis of billions of Instagram posts with tags, Facebook has still found a way to collect relevant information from photos without tags.

Facebook uses  this information for purely practical reasons, however it may still raise some questions. Not a lot of users are aware of the fact that their photos are actually being analyzed so Facebook can train AI’s. However, this information makes the fight against propaganda actions, violence and spam much easier.

This is why we are so focused on core AI research. We require new breakthroughs, and we require new technologies to solve problems all of us want to solve.

According to our last tests of the four tech giants (Google, Amazon, IBM and Microsoft), Google and Microsoft scored the highest on the accuracy test of recognizing objects in images based on the samples. We will soon test the real accuracy of Facebook’s AI, so keep tuned for more updates.

How do we use it?

At SquareMoon we use AI algorithms to help organizations improve their images on a bigger scale. We do that for images for corporate websites as well as for social media and other communication channels.

With this technology we are able to analyze thousands of ads at the same time. Based on this information we can advise you on the exact characteristics of an image that have the most influence on metrics like engagement and other conversion points. This means that you can create even more effective advertisements that have bigger positive impact on your campaign.

Do you want to know what this can mean for your organization? Send us an email or give us a call!