Human Generated Data

Title

Untitled (family portrait in living room, two children on floor in front of man in wheelchair)
Date

c. 1955
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10361

Human Generated Data

Title

Untitled (family portrait in living room, two children on floor in front of man in wheelchair)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Accessory 99.1
Tie 99.1
Accessories 99.1
Tie 98.9
Person 98.8
Human 98.8
Person 98.6
Person 98.1
Person 98.1
Person 97.9
Person 97.8
Person 97.7
Person 97.5
Person 97.5
Person 96.6
People 96.6
Person 94.3
Person 94.2
Person 93.9
Apparel 92.4
Clothing 92.4
Person 92.1
Person 91.5
Tie 90.5
Person 89.7
Footwear 86
Shoe 86
Tie 85.2
Tie 85.1
Family 84
Furniture 82.3
Chair 82.3
Coat 76.2
Overcoat 76.2
Sitting 73.3
Shoe 71.8
Female 67
Suit 65.9
Crowd 62.7
Girl 60
Person 58.3
Person 43.9

Imagga
created on 2022-01-23

kin 100
people 37.9
man 31.6
male 26.4
group 25
person 24.3
businessman 22.9
business 21.2
adult 18.5
professional 16.9
men 16.3
team 16.1
happy 15
silhouette 14.9
couple 14.8
women 14.2
meeting 14.1
room 13.8
family 13.3
together 13.1
portrait 12.9
black 12.8
smile 12.1
office 12
fun 12
smiling 11.6
boy 11.3
friends 11.3
pretty 11.2
brass 11.2
youth 11.1
work 11
happiness 11
child 10.6
success 10.4
wind instrument 10.3
executive 10.1
lifestyle 10.1
dress 9.9
holding 9.9
suit 9.9
active 9.9
handsome 9.8
fashion 9.8
job 9.7
mother 9.6
education 9.5
teamwork 9.3
teenager 9.1
attractive 9.1
businesswoman 9.1
interior 8.8
classroom 8.7
standing 8.7
love 8.7
cute 8.6
corporate 8.6
friendship 8.4
teen 8.3
girls 8.2
style 8.2
looking 8
to 8
working 7.9
indoors 7.9
two 7.6
businesspeople 7.6
successful 7.3
cheerful 7.3
lady 7.3
outfit 7.2
romance 7.1
musical instrument 7.1
worker 7.1
kid 7.1

Google
created on 2022-01-23

Photograph 94.2
Coat 89.8
Suit 83.6
Formal wear 75.3
Snapshot 74.3
Event 74
Blazer 72.2
Classic 70.2
Vintage clothing 70.1
Team 69.9
Family reunion 69.7
History 65.8
Sitting 65.8
Font 63.6
Monochrome 59.2
Room 57.6
Lap 55.7
Crew 53.9
Retro style 52.5
Chair 52.1

Microsoft
created on 2022-01-23

person 100
clothing 99.1
posing 98.7
group 96.4
wall 96.2
smile 95.1
man 94.3
footwear 87.8
text 78.3
woman 75.5
human face 67.8
people 62.5
team 41.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 73.3%
Happy 16.1%
Surprised 4.5%
Fear 1.6%
Confused 1.3%
Disgusted 1.1%
Angry 1%
Sad 0.9%

AWS Rekognition

Age 51-59
Gender Female, 100%
Happy 99.6%
Surprised 0.3%
Angry 0%
Calm 0%
Fear 0%
Sad 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 45-51
Gender Male, 100%
Happy 95.9%
Calm 1.3%
Surprised 1.3%
Angry 0.6%
Fear 0.4%
Disgusted 0.3%
Confused 0.2%
Sad 0.1%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Happy 99.8%
Surprised 0.1%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%
Calm 0%
Sad 0%

AWS Rekognition

Age 66-76
Gender Female, 99.7%
Calm 96.6%
Happy 1.1%
Surprised 0.7%
Angry 0.6%
Disgusted 0.5%
Confused 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Female, 98.4%
Happy 85.6%
Angry 7.5%
Surprised 2.1%
Confused 1.2%
Disgusted 1.2%
Calm 1%
Sad 0.7%
Fear 0.7%

AWS Rekognition

Age 20-28
Gender Female, 99.4%
Calm 88.3%
Happy 3.9%
Surprised 2.8%
Confused 1.8%
Angry 1.3%
Fear 1%
Sad 0.6%
Disgusted 0.3%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 66.4%
Happy 8.7%
Angry 8%
Confused 5.2%
Disgusted 4.1%
Surprised 2.8%
Fear 2.5%
Sad 2.2%

AWS Rekognition

Age 13-21
Gender Female, 82.6%
Calm 99.6%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Male, 88.4%
Calm 99.7%
Surprised 0.1%
Happy 0.1%
Confused 0%
Sad 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 52-60
Gender Female, 99.6%
Calm 69%
Surprised 25.5%
Fear 4%
Confused 0.5%
Disgusted 0.4%
Sad 0.2%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 25-35
Gender Female, 97.7%
Happy 91.3%
Calm 4%
Surprised 1.3%
Angry 0.9%
Confused 0.8%
Sad 0.6%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Calm 99.6%
Happy 0.2%
Confused 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 2-10
Gender Male, 100%
Happy 79.6%
Calm 16.8%
Confused 0.9%
Sad 0.6%
Surprised 0.6%
Angry 0.6%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 10-18
Gender Female, 91.7%
Happy 99.5%
Surprised 0.3%
Calm 0.1%
Confused 0.1%
Fear 0%
Disgusted 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 73-83
Gender Male, 100%
Calm 74.6%
Surprised 21%
Happy 1.9%
Angry 0.8%
Confused 0.7%
Disgusted 0.6%
Sad 0.2%
Fear 0.2%

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.1%
Person 98.8%
Shoe 86%
Suit 65.9%

Captions

Microsoft

a group of people posing for a photo 98.5%
a group of people posing for the camera 98.4%
a group of people posing for a picture 98.3%