Human Generated Data

Title

Untitled (family portrait in living room, four children and one adult on floor in front)
Date

c. 1955
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10363

Human Generated Data

Title

Untitled (family portrait in living room, four children and one adult on floor in front)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Accessories 100
Tie 100
Accessory 100
Tie 99.9
Person 99.6
Human 99.6
Person 99.1
Person 99.1
Person 98.9
Person 98.5
Person 98
Person 97.9
Person 96.3
Person 95
Person 94.7
Person 94.7
Person 94.4
Tie 93.9
Person 93.9
Person 92.2
Person 91.9
Coat 91.8
Clothing 91.8
Suit 91.8
Overcoat 91.8
Apparel 91.8
Person 89.5
People 86.3
Person 85.2
Person 84.8
Suit 84.2
Person 77
Person 75.8
Crowd 74.4
Audience 74.4
Person 73.9
Person 73.5
Face 72.4
Tie 71.8
Tie 70.7
Tie 64.5
Suit 61.9
Suit 61
Person 55

Imagga
created on 2022-01-23

kin 100
people 31.8
person 24.3
man 24.3
male 22.1
adult 20.4
group 19.3
child 18.8
men 17.2
happy 16.9
happiness 16.4
family 16
room 16
women 15.8
dress 15.3
couple 14.8
fashion 14.3
portrait 14.2
business 14
love 13.4
black 13.3
silhouette 13.2
businessman 13.2
mother 12.5
smiling 12.3
fun 12
two 11.8
team 11.6
together 11.4
pretty 11.2
lifestyle 10.8
student 10.7
interior 10.6
indoors 10.5
sexy 10.4
home 10.4
world 10.1
daughter 9.8
cheerful 9.7
style 9.6
professional 9.6
boy 9.6
teacher 9.5
education 9.5
joy 9.2
indoor 9.1
girls 9.1
attractive 9.1
lady 8.9
kid 8.9
smile 8.5
casual 8.5
retro 8.2
childhood 8.1
celebration 8
standing 7.8
scene 7.8
luxury 7.7
hand 7.6
elegance 7.5
togetherness 7.5
friends 7.5
grandfather 7.4
parent 7.3
new 7.3
father 7.3
businesswoman 7.3
success 7.2
classroom 7.2
clothing 7.2
suit 7.2
school 7.2

Google
created on 2022-01-23

Photograph 94.2
Coat 86
Suit 81.9
Vintage clothing 74.2
Family reunion 74.1
Event 73.6
Team 68.3
Crew 68
Formal wear 65.2
Room 62.6
History 61.9
Font 59.8
Sitting 55.1
Classic 54.8
Family pictures 53.6
Monochrome 53.2
Family 53.1

Microsoft
created on 2022-01-23

person 100
posing 100
group 99.1
clothing 99.1
wall 98.7
smile 97.8
human face 97.4
man 92
woman 87.1
old 66.8
team 52.6
dressed 41.4
step 36.1
crowd 0.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Female, 100%
Happy 69.6%
Angry 13.8%
Disgusted 4.3%
Surprised 3.9%
Fear 3.4%
Sad 2.3%
Calm 1.5%
Confused 1.2%

AWS Rekognition

Age 39-47
Gender Male, 99.3%
Calm 89.5%
Happy 8%
Confused 0.6%
Angry 0.6%
Surprised 0.4%
Disgusted 0.4%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Female, 100%
Calm 25.3%
Surprised 22.5%
Sad 19.5%
Fear 12.5%
Confused 6.6%
Disgusted 5.6%
Happy 5%
Angry 3%

AWS Rekognition

Age 29-39
Gender Female, 99.9%
Happy 77.3%
Angry 15.9%
Calm 1.7%
Fear 1.5%
Surprised 1.5%
Disgusted 1.3%
Sad 0.5%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Female, 95.9%
Happy 96.9%
Calm 0.7%
Surprised 0.6%
Angry 0.5%
Disgusted 0.4%
Sad 0.4%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Male, 100%
Happy 95.1%
Calm 4.1%
Confused 0.2%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 2-8
Gender Male, 100%
Happy 99.2%
Calm 0.4%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Happy 53.4%
Calm 32.6%
Surprised 7.1%
Angry 2.3%
Fear 1.7%
Disgusted 1.2%
Confused 1.1%
Sad 0.6%

AWS Rekognition

Age 21-29
Gender Male, 100%
Happy 76.1%
Angry 16.1%
Surprised 4%
Fear 1%
Sad 0.7%
Disgusted 0.7%
Calm 0.7%
Confused 0.7%

AWS Rekognition

Age 45-53
Gender Male, 100%
Happy 58%
Calm 22.7%
Surprised 6.6%
Angry 3.2%
Disgusted 2.9%
Confused 2.3%
Sad 2.2%
Fear 2.1%

AWS Rekognition

Age 23-33
Gender Female, 85.2%
Happy 85.3%
Surprised 5.6%
Fear 2.3%
Angry 2.1%
Disgusted 1.6%
Confused 1.2%
Calm 1%
Sad 0.8%

AWS Rekognition

Age 58-66
Gender Female, 100%
Calm 85.9%
Surprised 7.6%
Confused 2.6%
Sad 1.4%
Happy 1%
Angry 0.5%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 50-58
Gender Female, 100%
Calm 85.2%
Happy 9.4%
Angry 1.5%
Surprised 1.3%
Disgusted 1.2%
Confused 1%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Happy 97.9%
Surprised 0.6%
Angry 0.4%
Fear 0.3%
Disgusted 0.3%
Calm 0.2%
Confused 0.2%
Sad 0.1%

AWS Rekognition

Age 58-66
Gender Male, 99.6%
Surprised 46%
Calm 42.7%
Happy 6%
Angry 2.7%
Sad 1%
Disgusted 0.7%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 63-73
Gender Female, 99.9%
Calm 99%
Surprised 0.4%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 9-17
Gender Female, 93.9%
Calm 94.2%
Happy 2.5%
Surprised 1.1%
Angry 0.9%
Sad 0.5%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 1-7
Gender Female, 100%
Happy 99.9%
Calm 0%
Surprised 0%
Angry 0%
Disgusted 0%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 14-22
Gender Female, 52%
Calm 99.8%
Sad 0.1%
Happy 0%
Angry 0%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Happy 99.6%
Surprised 0.1%
Angry 0.1%
Calm 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0%

AWS Rekognition

Age 48-54
Gender Male, 99.3%
Happy 94.8%
Calm 2.1%
Fear 0.7%
Surprised 0.7%
Disgusted 0.5%
Sad 0.4%
Confused 0.4%
Angry 0.4%

AWS Rekognition

Age 22-30
Gender Female, 99.7%
Happy 94.5%
Calm 2.2%
Surprised 1.8%
Angry 0.7%
Confused 0.3%
Fear 0.2%
Sad 0.2%
Disgusted 0.1%

AWS Rekognition

Age 73-83
Gender Male, 100%
Calm 93.8%
Surprised 3.1%
Happy 0.7%
Angry 0.6%
Confused 0.6%
Disgusted 0.5%
Sad 0.5%
Fear 0.3%

AWS Rekognition

Age 63-73
Gender Male, 100%
Calm 55.6%
Sad 20.5%
Happy 12.1%
Surprised 5%
Angry 2.4%
Disgusted 2.1%
Confused 1.4%
Fear 0.9%

AWS Rekognition

Age 43-51
Gender Male, 100%
Happy 96.9%
Surprised 1.3%
Calm 0.4%
Disgusted 0.4%
Fear 0.3%
Angry 0.3%
Confused 0.3%
Sad 0.1%

AWS Rekognition

Age 0-3
Gender Female, 99.6%
Happy 72.2%
Calm 15.8%
Sad 9.7%
Confused 1.1%
Surprised 0.4%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 70
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 53
Gender Female

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 64
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 66
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 100%
Person 99.6%
Suit 91.8%

Captions

Microsoft

a group of people posing for a photo 98.7%
a group of people posing for the camera 98.6%
a group of people posing for a picture 98.5%