Human Generated Data

Title

Untitled (six family members with white tags on lapels seated on stone steps)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11298

Human Generated Data

Title

Untitled (six family members with white tags on lapels seated on stone steps)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 100
Clothing 100
Person 99.6
Human 99.6
Sunglasses 99.2
Accessories 99.2
Accessory 99.2
Person 99
Person 98.6
Hat 98.3
Person 96.6
Person 95.9
Person 95
Tie 93.9
Tie 92.6
Suit 92.3
Overcoat 92.3
Coat 92.3
Sun Hat 92.3
Tie 90.9
Hat 87.7
People 85.7
Suit 82.3
Cowboy Hat 81.8
Hat 76.7
Face 73.6
Suit 69.3
Hat 63.3
Tuxedo 56.9
Officer 55.4
Military 55.4
Military Uniform 55.4
Tie 51.7

Imagga
created on 2022-01-23

man 43
kin 39.6
male 34.7
businessman 30
people 27.9
business 27.3
suit 27.3
military uniform 27.3
person 26.7
adult 25.9
clothing 24.5
portrait 23.3
uniform 21.9
office 21.7
team 18.8
black 18.7
executive 18.5
businesswoman 18.2
corporate 18
group 17.7
happy 17.5
happiness 16.4
face 16.3
meeting 16
bow tie 15.7
professional 15.4
success 15.3
smiling 14.5
boss 14.3
tie 14.2
covering 14
manager 14
couple 13.9
men 13.7
confident 13.6
smile 13.5
consumer goods 13.5
attractive 13.3
businesspeople 13.3
job 13.3
successful 12.8
colleagues 12.6
family 12.4
formal 12.4
necktie 12.2
cheerful 12.2
standing 12.2
teamwork 12
work 11.8
hat 10.7
handsome 10.7
partners 10.7
partnership 10.6
hair 10.3
fashion 9.8
together 9.6
brunette 9.6
staff 9.6
elegant 9.4
communication 9.2
jacket 9.2
vintage 9.1
dress 9
style 8.9
coworkers 8.8
looking 8.8
home 8.8
love 8.7
corporation 8.7
workplace 8.6
expression 8.5
old 8.4
hand 8.3
mother 8
lifestyle 7.9
building 7.9
women 7.9
guy 7.8
performer 7.8
head 7.5
human 7.5
senior 7.5
holding 7.4
retro 7.4
indoor 7.3
sexy 7.2
romantic 7.1
interior 7.1
garment 7
modern 7
look 7

Google
created on 2022-01-23

Hat 94.9
Photograph 94.2
Sun hat 91.7
Coat 89.9
Headgear 83.2
Suit 79.7
People 79.4
Collar 77.8
Classic 74.6
Snapshot 74.3
Vintage clothing 72.8
Fedora 71.8
Event 71.4
Smile 67.9
Tree 64.7
Stock photography 63
History 59.3
Blazer 59.2
Formal wear 57.4
Retro style 55.5

Microsoft
created on 2022-01-23

person 99.8
outdoor 99.6
military uniform 98
hat 97.9
clothing 93.2
man 92.6
fashion accessory 91.5
old 88.6
group 88
text 79
fedora 79
posing 76.3
people 74.7
cowboy hat 67.6
suit 66.7
peaked cap 54

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 70-80
Gender Male, 100%
Calm 55.5%
Happy 39.1%
Sad 2.8%
Surprised 0.7%
Disgusted 0.6%
Angry 0.5%
Confused 0.4%
Fear 0.4%

AWS Rekognition

Age 59-67
Gender Male, 99.9%
Happy 99.8%
Surprised 0%
Calm 0%
Disgusted 0%
Sad 0%
Fear 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 56-64
Gender Female, 86.6%
Calm 67.6%
Happy 30.3%
Sad 0.8%
Fear 0.5%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 54-62
Gender Female, 99.8%
Calm 81.6%
Happy 8.1%
Surprised 4.8%
Confused 1.6%
Disgusted 1.2%
Sad 1%
Angry 0.9%
Fear 0.8%

AWS Rekognition

Age 66-76
Gender Male, 100%
Calm 95.6%
Happy 1.4%
Sad 0.9%
Angry 0.5%
Fear 0.5%
Disgusted 0.5%
Confused 0.4%
Surprised 0.3%

AWS Rekognition

Age 57-65
Gender Male, 99.4%
Calm 80.3%
Angry 8.8%
Happy 2.9%
Sad 2.4%
Confused 2.2%
Surprised 1.4%
Disgusted 1.1%
Fear 0.9%

Microsoft Cognitive Services

Age 61
Gender Female

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 70
Gender Male

Microsoft Cognitive Services

Age 70
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Sunglasses 99.2%
Hat 98.3%
Tie 93.9%
Suit 92.3%

Captions

Microsoft

a group of people in uniform posing for a photo 98.7%
a group of people posing for a photo 98.2%
a group of people in uniform posing for a picture 98.1%