Human Generated Data

Title

Untitled (family portrait in living room, two children on floor in front of man in wheelchair)

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10360

Human Generated Data

Title

Untitled (family portrait in living room, two children on floor in front of man in wheelchair)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Tie 99.6
Accessory 99.6
Accessories 99.6
Tie 99.5
Tie 99.1
Person 98.9
Human 98.9
Person 98.9
Person 98.5
Person 98
Person 97.9
Person 97.7
Person 97.1
Person 97.1
People 97
Person 96.9
Apparel 96.4
Clothing 96.4
Person 95.9
Person 95.3
Footwear 94.6
Shoe 94.6
Person 94.2
Person 94.2
Overcoat 93.9
Coat 93.9
Person 93.7
Person 92.5
Person 91.9
Suit 91.8
Tie 91
Family 87.8
Chair 85.4
Furniture 85.4
Female 72.7
Indoors 70.6
Room 70.6
Tie 70.3
Suit 65
Suit 64.9
Suit 64.6
Shoe 63.6
Couch 62.3
Crowd 62
Tuxedo 56.9
Sitting 56.9
Photography 55.7
Face 55.7
Photo 55.7
Portrait 55.7

Imagga
created on 2022-01-23

kin 100
people 34.5
person 25.7
male 25.7
man 24.2
group 22.5
adult 20.9
happy 19.4
black 18.7
portrait 17.4
fashion 17.3
men 17.2
silhouette 16.5
family 16
women 15.8
couple 14.8
smiling 14.4
lifestyle 14.4
fun 14.2
happiness 13.3
pretty 13.3
friends 13.1
friendship 13.1
team 12.5
businessman 12.3
together 12.2
cute 12.2
smile 12.1
youth 11.9
attractive 11.9
active 11.7
model 11.6
business 11.5
child 11.4
sexy 11.2
love 11
teen 11
style 10.4
sibling 10.2
girls 10
playing 10
mother 9.9
dress 9.9
sport 9.9
human 9.7
body 9.6
brunette 9.6
boy 9.6
room 9.5
sitting 9.4
professional 9.3
leisure 9.1
teenager 9.1
cheerful 8.9
to 8.8
success 8.8
two 8.5
studio 8.3
holding 8.2
pose 8.1
lady 8.1
hair 7.9
standing 7.8
face 7.8
diversity 7.7
casual 7.6
enjoying 7.6
dancer 7.5
joy 7.5
school 7.3
children 7.3
music 7.2
looking 7.2
home 7.2
holiday 7.2
handsome 7.1
teacher 7.1
posing 7.1
kid 7.1
daughter 7
indoors 7
dance 7

Google
created on 2022-01-23

Photograph 94.2
Coat 89.8
Social group 82.3
Suit 81.6
Snapshot 74.3
Event 72.6
Classic 72.2
Vintage clothing 70.4
Formal wear 69.1
Chair 69.1
Team 68.3
Family reunion 67.9
Blazer 67.1
Font 64.7
Sitting 64.1
History 62.1
Room 61.8
Family 51.5
Retro style 50

Microsoft
created on 2022-01-23

person 100
clothing 98.7
posing 97.9
smile 97.2
group 95.6
wall 95.1
man 92.4
footwear 85.7
woman 76
people 70.1
text 66.2
human face 64.4
suit 59.7
old 43.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Happy 79.6%
Angry 16.8%
Surprised 1%
Disgusted 0.8%
Confused 0.7%
Fear 0.4%
Sad 0.3%
Calm 0.3%

AWS Rekognition

Age 14-22
Gender Female, 95.8%
Calm 99.5%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 73.8%
Happy 17.7%
Surprised 2.7%
Confused 1.9%
Angry 1.6%
Fear 1%
Disgusted 0.7%
Sad 0.5%

AWS Rekognition

Age 0-3
Gender Male, 98.9%
Calm 99.7%
Sad 0.1%
Happy 0%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 100%
Happy 97.9%
Calm 1.1%
Surprised 0.4%
Angry 0.1%
Sad 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 99.5%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 44%
Angry 20.2%
Confused 15.9%
Happy 7.3%
Disgusted 4.2%
Sad 4%
Fear 3.1%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Female, 75.4%
Happy 54.9%
Calm 22.7%
Surprised 5.6%
Angry 4.7%
Confused 4%
Disgusted 2.9%
Sad 2.8%
Fear 2.4%

AWS Rekognition

Age 18-24
Gender Female, 99.9%
Calm 44.7%
Happy 30.6%
Surprised 9.6%
Confused 7.3%
Fear 3.1%
Angry 3%
Sad 1%
Disgusted 0.8%

AWS Rekognition

Age 51-59
Gender Female, 100%
Calm 100%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Sad 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 68-78
Gender Female, 98.6%
Calm 98.7%
Surprised 0.4%
Angry 0.4%
Disgusted 0.2%
Happy 0.1%
Sad 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 49-57
Gender Female, 100%
Calm 98.7%
Surprised 0.6%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 2-8
Gender Male, 100%
Happy 94.8%
Calm 3.7%
Surprised 0.6%
Sad 0.4%
Confused 0.2%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 82.5%
Happy 4.7%
Confused 2.8%
Disgusted 2.6%
Surprised 2.3%
Angry 2%
Sad 1.5%
Fear 1.5%

AWS Rekognition

Age 6-16
Gender Female, 62.7%
Happy 89.5%
Calm 7%
Surprised 1.6%
Confused 0.6%
Fear 0.4%
Disgusted 0.4%
Angry 0.3%
Sad 0.2%

AWS Rekognition

Age 70-80
Gender Male, 100%
Calm 98.8%
Surprised 0.8%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Happy 0%
Sad 0%
Fear 0%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 53
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 69
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.6%
Person 98.9%
Shoe 94.6%
Suit 91.8%

Captions

Microsoft

a group of people posing for a photo 98.7%
a group of people posing for the camera 98.6%
a group of people posing for a picture 98.5%