Human Generated Data

Title

Untitled (group of men and two women drinking, Pennsylvania)
Date

1941, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.255
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of men and two women drinking, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.9
Apparel 99.9
Coat 99.2
Overcoat 99.2
Accessories 99.1
Tie 99.1
Accessory 99.1
Human 98.7
Person 98.7
Person 97.5
Person 97.3
Person 97
Person 96.4
Person 96
Person 95.5
Tie 94.3
Tuxedo 93.7
Tie 92.2
Person 90.1
Tie 86.1
Suit 83.7
Person 83.3
Fashion 78.3
Robe 78.3
Evening Dress 78.2
Gown 78.2
Bar Counter 73
Pub 73
Female 65.7
Suit 65
Beverage 65
Drink 65
Glass 64.7
Wedding 62.1
Alcohol 61.9
Performer 58.5
Wedding Gown 57.7
Party 57.7
Furniture 57.4
Face 56.5

Imagga
created on 2022-01-08

kin 54.9
people 34
man 33.6
businessman 31.8
business 29.7
person 27.7
corporate 27.5
adult 25.8
professional 25.7
businesswoman 25.4
male 24.2
group 23.4
executive 22.1
happy 21.3
golfer 21.2
office 20.9
team 20.6
teamwork 20.4
businesspeople 19.9
suit 19.1
women 19
smiling 18.8
couple 18.3
success 16.9
work 16.5
player 16.4
meeting 16
together 15.8
successful 15.6
confident 15.5
attractive 15.4
smile 15
portrait 14.9
men 14.6
holding 14
two 13.5
happiness 13.3
job 13.3
standing 13
lifestyle 13
contestant 12.9
room 12.7
colleagues 12.6
pretty 12.6
cheerful 12.2
sitting 12
20s 11.9
black 11.8
communication 11.8
partnership 11.5
worker 10.9
diverse 10.8
partner 10.6
diversity 10.6
ethnic 10.5
talking 10.4
career 10.4
building 10.3
employee 9.9
child 9.9
classroom 9.8
working 9.7
groom 9.6
style 9.6
student 9.5
manager 9.3
fashion 9
dress 9
buddy 8.9
mother 8.9
looking 8.8
partners 8.7
brunette 8.7
boss 8.6
workplace 8.6
tie 8.5
modern 8.4
occupation 8.2
family 8
indoors 7.9
love 7.9
businesswomen 7.8
businessmen 7.8
education 7.8
table 7.8
clothing 7.7
leadership 7.7
staff 7.6
smart 7.5
study 7.5
home 7.2
face 7.1

Google
created on 2022-01-08

Smile 98
Coat 91.5
Standing 86.4
Style 83.9
Black-and-white 83.4
Suit 80.7
Formal wear 77.6
Vintage clothing 76.3
Event 73.9
Blazer 72
Monochrome photography 71.8
Classic 70.5
Monochrome 69.4
Happy 67.6
Room 67
Team 66.9
Stock photography 62.7
History 62
Art 61.8
White-collar worker 57.7

Microsoft
created on 2022-01-08

person 100
posing 99.7
clothing 97.7
wall 97.6
group 97.1
smile 95.8
standing 92.8
suit 92.5
man 91.4
people 89.4
human face 72.2
text 69
black 68.5
woman 64.6
black and white 50.3
old 50.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Male, 99.8%
Happy 49.2%
Sad 36.8%
Fear 5.6%
Calm 2.8%
Surprised 1.7%
Angry 1.6%
Disgusted 1.2%
Confused 1%

AWS Rekognition

Age 30-40
Gender Female, 99.8%
Happy 89.9%
Calm 3.9%
Disgusted 2.1%
Angry 1.3%
Fear 1.1%
Sad 0.8%
Surprised 0.6%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Male, 99.5%
Happy 99%
Surprised 0.3%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Calm 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Happy 92.5%
Angry 1.3%
Sad 1.3%
Confused 1.1%
Disgusted 1%
Calm 1%
Surprised 0.9%
Fear 0.9%

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 81%
Calm 6.9%
Sad 6.2%
Surprised 2.1%
Angry 1.2%
Fear 1%
Confused 0.8%
Disgusted 0.8%

AWS Rekognition

Age 20-28
Gender Male, 100%
Angry 74.8%
Sad 11.7%
Fear 4.5%
Calm 3.4%
Surprised 1.9%
Confused 1.5%
Disgusted 1.3%
Happy 0.9%

AWS Rekognition

Age 21-29
Gender Male, 100%
Happy 72.8%
Angry 13.4%
Sad 4.7%
Fear 4.5%
Surprised 1.6%
Confused 1.4%
Calm 0.9%
Disgusted 0.6%

AWS Rekognition

Age 35-43
Gender Male, 100%
Happy 52.1%
Calm 18.7%
Angry 6.7%
Disgusted 6%
Confused 5.8%
Surprised 5.7%
Sad 3.5%
Fear 1.5%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Happy 31.3%
Calm 24.5%
Surprised 15.9%
Sad 7.1%
Angry 6.7%
Disgusted 5.1%
Confused 4.9%
Fear 4.4%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Angry 77.6%
Happy 19.3%
Surprised 1.1%
Disgusted 0.8%
Fear 0.5%
Calm 0.4%
Sad 0.2%
Confused 0.1%

AWS Rekognition

Age 28-38
Gender Female, 72.2%
Calm 98.6%
Sad 0.7%
Fear 0.4%
Angry 0.1%
Confused 0%
Disgusted 0%
Happy 0%
Surprised 0%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 49
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Possible
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.1%
Person 98.7%
Suit 83.7%

Captions

Microsoft

a group of people posing for a photo 99.3%
a group of people posing for the camera 99.2%
a group of people posing for a picture 99.1%