Human Generated Data

Title

Untitled (four photographs: child in high chair celebrating first birthday with cake)
Date

c. 1935, printed later
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6803

Human Generated Data

Title

Untitled (four photographs: child in high chair celebrating first birthday with cake)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 98.1
Person 98.1
Person 97.8
Person 96
Collage 95.8
Poster 95.8
Advertisement 95.8
Person 94.2
Newborn 81.3
Baby 81.3
Meal 77.4
Food 77.4
Plant 72.1
Dish 59.6
Person 58.8
Screen 56.6
Electronics 56.6

Clarifai
created on 2019-11-16

people 100
group 99.8
adult 98.9
man 98.1
medicine 98.1
many 98
hospital 97.3
child 96.8
woman 96.7
leader 96.6
baby 96.3
several 95.9
room 95.6
indoors 95.3
illustration 95
furniture 94.6
portrait 92.5
two 91
family 91
illness 90.1

Imagga
created on 2019-11-16

kin 45.4
furniture 26
china cabinet 18.9
screen 17.1
child 16.9
furnishing 16.7
cabinet 15.1
happy 14.4
people 12.3
money 11.9
person 11.8
happiness 11
smile 10.7
family 10.7
white 10.6
television 10.4
home 10.4
portrait 10.3
black 10.2
covering 10.1
smiling 10.1
bookcase 10.1
cute 10
childhood 9.8
old 9.7
kid 9.7
business 9.7
little 9.7
one 9.7
food 9.5
table 9.5
love 9.5
expression 9.4
desk 9.4
window 9.3
health 9
currency 9
man 8.7
boy 8.7
dinner 8.4
pink 8.4
adorable 8.3
banking 8.3
cash 8.2
object 8
office 8
financial 8
paper 7.9
sweet 7.9
face 7.8
teddy 7.7
gourmet 7.6
finance 7.6
human 7.5
fun 7.5
savings 7.4
holding 7.4
decoration 7.2
looking 7.2
wealth 7.2
religion 7.2
bank 7.2
adult 7.1
male 7.1
interior 7.1

Google
created on 2019-11-16

Photograph 96.9
Picture frame 89.9
Snapshot 84.3
Room 71.4
Photography 70.6
Photographic paper 63.9
Art 58.1
Collection 57.1
Black-and-white 56.4
Photograph album 55.9

Microsoft
created on 2019-11-16

posing 97.5
text 91.4
food 89.5
human face 85.3
gallery 84.4
baby 83.9
person 78.9
tableware 75.4
bunch 60.8
old 58.8
room 58.5
table 54.3
picture frame 36.8
painting 15.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 51.3%
Happy 54.6%
Confused 45%
Calm 45.1%
Angry 45.1%
Disgusted 45%
Surprised 45.1%
Fear 45.1%
Sad 45%

AWS Rekognition

Age 0-3
Gender Male, 52.1%
Disgusted 45%
Happy 45%
Angry 45%
Confused 45%
Calm 54.5%
Fear 45%
Sad 45.5%
Surprised 45%

AWS Rekognition

Age 0-3
Gender Female, 50.5%
Fear 45%
Happy 45.3%
Calm 54.5%
Sad 45.2%
Angry 45%
Surprised 45%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 0-3
Gender Female, 50.2%
Angry 45.8%
Calm 48.9%
Surprised 45.4%
Confused 45.2%
Disgusted 45.1%
Happy 46%
Sad 47%
Fear 46.6%

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%

Captions

Microsoft

a group of people posing for a photo 65.3%
a group of people posing for the camera 65.2%
a group of people posing for a picture 65.1%