Microsoft Image + Emotion Recognizer

Last updated 26 days ago

Microsoft's Image and Emotion Recognizer services puts the power of some of the most advanced open artificial intelligence tools in your image-based apps

The Image Recognizer returns information about visual content found in an image while the Emotion Recognizer detects emotions from images containing a single face.

Set up

No set up is required.

Thunkable provides its own API key by default for your convenience but if you expect your users to upload more than 1,000 images per month, please create your own free account with Microsoft Cognitive Services (current free limit is 30,000 images per month).

Property

Description

Subscription Key

Thunkable provides its own subscription key as DEFAULT. You can add your own if you expect your users to upload more than 1,000 images per month

Server Url

Distinct Url required for the Computer Vision API. Do not change the DEFAULT unless you are trying to access this component from China, in which case you need to provide a different server Url

Microsoft Image Recognizer

The Image Recognizer returns information about visual content found in an image and provides a set of tags and its best single line description

The sample appThunkableagram: AI-powered Instagramuses the Image Recognizer to auto-caption images

Select an image and let Microsoft's Image Recognizer detect its contents

Functionality

Event

Description

Post Image (path)

Uploads the image (specified by the path) to the Microsoft Cognitive Service

Got Response (description, descriptionScore, tags, responseCode, responseContent)

If okay ('responseCode' = 200), returns a one line 'description', a 'description score' (confidence between 0 and 1), and a set of image 'tags'. If not okay, will return an explanation for the error ('responseContent')

Microsoft Emotion Recognizer

The Emotion Recognizer detects emotions from images containing a single face. The emotions detected are anger, contempt, disgust, fear, happiness, neutral, sadness, and surprise. These emotions are understood to be cross-culturally and universally communicated with particular facial expressions

Take a picture with a single face and let Microsoft's Emotion Recognizer detect its emotion

Functionality

Event

Description

Post Image (path)

Uploads the image (specified by the path) to the Microsoft Cognitive Service

Got Response (mostLikelyEmotion, mostLikelyEmotionScore, tags, responseCode, responseContent)

If okay ('responseCode' = 200), returns the 'most likely emotion' and a 'most likely emotion score' (confidence between 0 and 1). If not okay, will return an explanation for the error ('responseContent')