Human Generated Data

Title

Untitled (family portrait of four adults with baby, four framed photos on wall)

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10381

Human Generated Data

Title

Untitled (family portrait of four adults with baby, four framed photos on wall)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.2
Clothing 99.2
Person 99
Human 99
Person 98.8
Person 98.6
Person 98.3
Furniture 97.5
Footwear 90.7
Shoe 90.7
People 76.3
Room 74.3
Indoors 74.3
Shorts 73.9
Sailor Suit 71.5
Couch 67.5
Chair 63.9
Flooring 62.3
Female 60.6
Girl 60.6
Face 60
Kid 57.5
Child 57.5
Shoe 57.2
Door 55

Imagga
created on 2022-01-23

person 32.4
man 31.6
people 31.2
hospital 30.8
male 29.1
chair 24.7
child 23
happy 20.7
adult 20.6
family 20.5
room 19.3
home 19.1
domestic 18.6
women 17.4
mother 17.4
smiling 17.4
sitting 17.2
indoors 16.7
smile 16.4
senior 15.9
lifestyle 15.2
old 14.6
seat 14.5
mature 13.9
boy 13.9
happiness 13.3
father 13
portrait 12.9
patient 12.9
elderly 12.4
medical 12.4
together 12.3
professional 12.1
work 11.9
indoor 11.9
two 11.9
health 11.8
barber chair 11.6
retirement 11.5
kid 11.5
daughter 11.5
hairdresser 11.3
cheerful 10.6
looking 10.4
wheeled vehicle 10.3
men 10.3
nurse 10.3
children 10
tricycle 9.9
care 9.9
interior 9.7
retired 9.7
son 9.7
parent 9.7
holiday 9.3
clothing 9.2
holding 9.1
furniture 9
vehicle 8.7
couple 8.7
wheelchair 8.7
student 8.6
reading 8.6
classroom 8.5
grandfather 8.5
enjoying 8.5
joy 8.3
shop 8.3
fashion 8.3
book 8.2
alone 8.2
outdoors 8.2
aged 8.1
disabled 7.9
worker 7.8
standing 7.8
couch 7.7
casual 7.6
leisure 7.5
style 7.4
teenager 7.3
new 7.3
dress 7.2
handsome 7.1
working 7.1
little 7.1
kin 7
modern 7

Google
created on 2022-01-23

Footwear 98.2
Smile 90.8
Dress 87
Vintage clothing 74.5
Classic 71.3
Sitting 67.9
Event 67.5
Monochrome 67.3
Child 62.7
Stock photography 61.9
Room 61.8
Lap 61.7
History 58.3
Retro style 56.5
Hat 55.5
Chair 52.5
Family 52.1
Pattern 51.1

Microsoft
created on 2022-01-23

person 99.1
floor 98.7
wall 97.7
clothing 97.6
posing 95
smile 93.1
footwear 90.8
indoor 87.6
furniture 69.7
old 52.7
chair 50.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 99.8%
Calm 91.2%
Angry 2.4%
Surprised 1.9%
Sad 1.4%
Confused 1.3%
Disgusted 1.1%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 70-80
Gender Male, 99.8%
Angry 38.3%
Calm 25.6%
Surprised 15.1%
Disgusted 7.3%
Fear 5.1%
Sad 4.7%
Happy 2.1%
Confused 1.7%

AWS Rekognition

Age 37-45
Gender Female, 99.9%
Calm 94.2%
Surprised 2.2%
Confused 1.3%
Happy 0.9%
Sad 0.4%
Fear 0.4%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 27-37
Gender Female, 99.7%
Happy 94.5%
Calm 2.1%
Surprised 0.8%
Disgusted 0.7%
Confused 0.7%
Sad 0.4%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 97.3%
Calm 96.1%
Sad 1.3%
Confused 1.1%
Angry 0.8%
Surprised 0.3%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.5%
Calm 95.7%
Angry 1.2%
Sad 1.1%
Surprised 0.6%
Confused 0.5%
Disgusted 0.4%
Happy 0.4%
Fear 0.4%

AWS Rekognition

Age 19-27
Gender Female, 81.1%
Sad 45.6%
Fear 25%
Calm 19.6%
Happy 2.9%
Surprised 2.2%
Confused 1.9%
Angry 1.7%
Disgusted 1%

AWS Rekognition

Age 21-29
Gender Male, 97.3%
Calm 71.2%
Sad 14.3%
Fear 5%
Confused 3.3%
Disgusted 3%
Angry 1.5%
Happy 1.2%
Surprised 0.5%

AWS Rekognition

Age 12-20
Gender Male, 99.4%
Calm 65.1%
Confused 20.7%
Sad 5.1%
Angry 3.5%
Surprised 2.4%
Fear 1.2%
Disgusted 1%
Happy 0.9%

AWS Rekognition

Age 13-21
Gender Male, 89.8%
Calm 96.1%
Sad 1.5%
Fear 0.6%
Surprised 0.5%
Angry 0.4%
Disgusted 0.3%
Happy 0.3%
Confused 0.2%

Microsoft Cognitive Services

Age 70
Gender Male

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 50
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99%
Shoe 90.7%
Chair 63.9%

Captions

Microsoft

a group of people posing for a photo 97.4%
a group of people posing for the camera 97.3%
a group of people posing for a picture 97.2%