Human Generated Data

Title

Untitled (family reunion portrait taken in living room)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3031

Human Generated Data

Title

Untitled (family reunion portrait taken in living room)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 99.7
Human 99.7
Person 99.2
Person 99.1
Shorts 98.6
Clothing 98.6
Apparel 98.6
Person 98
Person 97.9
Person 97.6
Person 97.2
Person 96.3
Person 96
Person 95.6
Person 95.5
Person 93.4
People 89.6
Tie 89.5
Accessories 89.5
Accessory 89.5
Tie 84.1
Person 83.8
Person 82.5
Tie 80.4
Face 79.9
Person 76.1
Female 75.1
Coat 73.4
Overcoat 73.4
Suit 73.4
Tie 72.8
Stage 72.6
Indoors 72.6
Furniture 70.2
Chair 70.2
Kid 68.9
Child 68.9
Dress 68.4
Person 67.4
Room 66.5
Shoe 64.1
Footwear 64.1
Crowd 62.2
Photography 62.1
Photo 62.1
Girl 61
Shoe 52.8

Imagga
created on 2022-01-21

silhouette 30.6
people 30.1
person 30
man 27
gymnasium 25
sport 24.4
male 22.7
runner 21.5
men 21.5
athlete 20.9
athletic facility 19.4
black 19.2
contestant 19
sunset 18
player 17.7
active 17.4
adult 16.7
exercise 16.3
facility 15.8
fun 15
group 14.5
lifestyle 14.4
brass 13.7
youth 12.8
human 12.7
leisure 12.4
businessman 12.4
wind instrument 12.3
boy 12.2
sky 12.1
happy 11.9
kin 11.8
fitness 11.7
run 11.6
motion 11.1
joy 10.9
team 10.7
child 10.6
hand 10.6
success 10.5
business 10.3
friendship 10.3
action 10.2
art 10.2
ball 10.1
golfer 10.1
beach 10.1
teenager 10
dance 9.7
summer 9.6
together 9.6
body 9.6
play 9.5
party 9.5
happiness 9.4
dark 9.2
vacation 9
activity 9
outdoors 9
musical instrument 8.8
couple 8.7
women 8.7
sea 8.6
dancer 8.5
energy 8.4
evening 8.4
power 8.4
training 8.3
competition 8.2
freedom 8.2
recreation 8.1
water 8
performer 7.9
love 7.9
travel 7.7
jump 7.7
grunge 7.7
outdoor 7.6
health 7.6
dusk 7.6
healthy 7.6
field 7.5
sign 7.5
friends 7.5
life 7.4
teen 7.3
girls 7.3
looking 7.2
celebration 7.2
smile 7.1
portrait 7.1
family 7.1

Google
created on 2022-01-21

Font 81.9
Suit 71.2
Chair 70.5
Vintage clothing 68
Event 67.9
Room 67.4
Crew 67.1
Monochrome 66.6
Art 66.5
Ball 65.4
Team 64.1
Photo caption 64.1
Monochrome photography 63.9
Illustration 63
Stock photography 61.7
Player 61.3
T-shirt 60.9
History 60.4
Classic 57.5
Team sport 57.3

Microsoft
created on 2022-01-21

text 96.2
person 94.9
clothing 88.3
outdoor 85.1
player 74
man 67.5
posing 62.6
group 61

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 95.1%
Calm 75.8%
Surprised 15.6%
Happy 4.9%
Angry 1%
Fear 0.9%
Disgusted 0.8%
Confused 0.8%
Sad 0.2%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Happy 83.4%
Calm 5.3%
Disgusted 3.1%
Angry 2.7%
Sad 1.9%
Surprised 1.6%
Confused 1.4%
Fear 0.4%

AWS Rekognition

Age 45-51
Gender Male, 97.9%
Happy 47%
Calm 22.9%
Fear 8.1%
Angry 7.6%
Surprised 6%
Sad 4.6%
Disgusted 2.1%
Confused 1.6%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Sad 94.3%
Calm 2.5%
Angry 1.3%
Happy 0.6%
Disgusted 0.4%
Surprised 0.4%
Fear 0.3%
Confused 0.3%

AWS Rekognition

Age 39-47
Gender Male, 99.3%
Calm 73.9%
Happy 22%
Sad 1.8%
Confused 0.6%
Disgusted 0.6%
Fear 0.5%
Angry 0.4%
Surprised 0.3%

AWS Rekognition

Age 23-31
Gender Female, 70.1%
Calm 83.2%
Surprised 14.5%
Sad 0.6%
Fear 0.5%
Happy 0.4%
Disgusted 0.3%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 45-51
Gender Female, 94.7%
Happy 86.8%
Calm 9.3%
Sad 1.1%
Surprised 1%
Fear 0.7%
Confused 0.4%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 45-51
Gender Male, 99%
Sad 49.4%
Happy 45.2%
Calm 1.6%
Angry 1.1%
Confused 1%
Disgusted 0.7%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 45-51
Gender Male, 95.1%
Sad 38.2%
Calm 19.1%
Happy 17.3%
Confused 7.5%
Angry 6.1%
Surprised 5.8%
Disgusted 3.7%
Fear 2.3%

AWS Rekognition

Age 37-45
Gender Female, 66.1%
Sad 32%
Happy 23.2%
Surprised 20.2%
Calm 12.8%
Confused 4.6%
Angry 2.9%
Disgusted 2.8%
Fear 1.6%

AWS Rekognition

Age 34-42
Gender Male, 87.1%
Calm 87.4%
Happy 11.5%
Sad 0.4%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 43-51
Gender Male, 98.6%
Surprised 54.9%
Calm 31.9%
Fear 4.6%
Sad 3.2%
Happy 2.5%
Confused 1.1%
Disgusted 0.9%
Angry 0.8%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Happy 59.4%
Sad 20%
Angry 13.3%
Calm 3.8%
Fear 1.2%
Surprised 0.9%
Disgusted 0.8%
Confused 0.6%

AWS Rekognition

Age 33-41
Gender Male, 78.5%
Happy 40.5%
Sad 34%
Calm 8%
Surprised 6.8%
Angry 4.3%
Fear 4%
Disgusted 1.5%
Confused 0.9%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 69%
Happy 24.8%
Angry 2.1%
Surprised 1.3%
Sad 1.2%
Disgusted 0.6%
Confused 0.6%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Male, 99.6%
Calm 49.8%
Sad 32.5%
Happy 12.4%
Angry 1.8%
Fear 1.1%
Confused 1%
Disgusted 0.7%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.7%
Tie 89.5%
Shoe 64.1%

Captions

Microsoft

a group of people posing for a photo 89.8%
a group of people posing for a picture 89.7%
a group of people posing for the camera 89.6%