Human Generated Data

Title

Untitled (wedding guests at reception with drinks and cigars)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.49

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (wedding guests at reception with drinks and cigars)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Apparel 99.8
Clothing 99.8
Overcoat 99.4
Coat 99.4
Accessory 99.2
Tie 99.2
Accessories 99.2
Person 99
Human 99
Tie 99
Person 98.9
Person 98.8
Person 97.4
Tie 96.4
Tuxedo 96.2
Suit 96
Person 94.6
Person 94.3
Person 94.1
Person 93.3
Person 92
Suit 86.2
Tie 85.6
Face 81.1
Tie 79.6
Suit 79.5
Person 79
Party 78.1
People 76.7
Female 62
Crowd 58.5
Indoors 57.5
Furniture 57.2
Performer 55.4
Tie 53.9

Clarifai
created on 2019-03-25

group 99.8
people 99.7
group together 99.3
adult 98
four 97.4
leader 96.9
several 96.7
five 96.5
portrait 95
facial expression 95
woman 95
administration 94.8
man 94.8
actress 93.5
three 92
many 91.9
offspring 90.1
actor 87.6
wear 87.6
musician 87.4

Imagga
created on 2019-03-25

golfer 54.7
player 42.3
person 41
man 35.6
people 35.1
contestant 33.2
male 30.5
happy 27.6
adult 27.4
businessman 27.3
professional 23.6
business 22.5
group 21.7
smiling 21.7
businesswoman 20.9
kin 20.7
office 20.1
team 19.7
couple 19.2
life 19
teamwork 17.6
together 17.5
women 17.4
corporate 17.2
businesspeople 17.1
meeting 16.9
happiness 16.4
smile 16.4
men 16.3
lifestyle 15.9
room 15.5
confident 15.5
attractive 15.4
portrait 14.9
holding 14.8
teacher 14.8
pretty 14.7
successful 14.6
cheerful 14.6
family 14.2
job 14.1
executive 13.8
two 13.5
dress 13.5
love 13.4
work 13.3
classroom 13.1
child 13
success 12.9
indoors 12.3
standing 12.2
working 11.5
home 11.2
mother 10.9
handsome 10.7
colleagues 10.7
student 10.6
boy 10.4
suit 9.9
fashion 9.8
diverse 9.8
partner 9.7
style 9.6
diversity 9.6
tie 9.5
groom 9.3
interior 8.8
well dressed 8.8
partners 8.7
brunette 8.7
table 8.6
worker 8.6
partnership 8.6
collar 8.6
staff 8.6
ethnic 8.6
clothing 8.5
modern 8.4
looking 8
to 8
building 7.9
color 7.8
black 7.7
workplace 7.6
career 7.6
communication 7.6
doctor 7.5
fun 7.5
20s 7.3
friendly 7.3
romantic 7.1

Google
created on 2019-03-25

Photograph 95.7
Event 81.1
Fun 70.4
Formal wear 68.1
Dress 63
Family 61.8
Black-and-white 56.4
Vintage clothing 55.9
Tuxedo 54.4
Gentleman 51.3

Microsoft
created on 2019-03-25

person 100
posing 99.7
wall 99.3
standing 98
indoor 93.8
group 91.7
people 60.2
old 53.7
dressed 25.2
formal 11
wedding 4.2
music 3.2
black and white 2.8
school 2.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 94.3%
Confused 2.1%
Angry 1.7%
Surprised 1.6%
Sad 1.1%
Happy 80.4%
Calm 12.2%
Disgusted 0.9%

AWS Rekognition

Age 30-47
Gender Male, 54.6%
Sad 45.3%
Calm 45.4%
Happy 53.4%
Surprised 45.3%
Angry 45.1%
Disgusted 45.2%
Confused 45.2%

AWS Rekognition

Age 23-38
Gender Male, 99.9%
Disgusted 0.6%
Angry 1.5%
Sad 1.7%
Happy 0.8%
Calm 91.9%
Confused 2.5%
Surprised 1%

AWS Rekognition

Age 6-13
Gender Male, 99.2%
Happy 95.2%
Disgusted 0.4%
Calm 0.6%
Surprised 0.4%
Confused 0.8%
Angry 0.6%
Sad 1.9%

AWS Rekognition

Age 45-63
Gender Male, 98.6%
Calm 1.1%
Sad 3%
Disgusted 1.2%
Happy 86.3%
Confused 1.7%
Angry 3.3%
Surprised 3.3%

AWS Rekognition

Age 26-43
Gender Male, 98%
Sad 2.2%
Disgusted 0.9%
Calm 84.7%
Happy 6%
Confused 3.2%
Surprised 1.9%
Angry 1.2%

AWS Rekognition

Age 14-25
Gender Female, 98.7%
Confused 1.2%
Sad 48.4%
Calm 4.1%
Happy 34.6%
Surprised 6.1%
Angry 4.2%
Disgusted 1.5%

AWS Rekognition

Age 35-52
Gender Female, 55%
Angry 45.1%
Calm 45.1%
Happy 54.5%
Surprised 45.1%
Sad 45.1%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Male, 54.3%
Happy 45.2%
Calm 50.9%
Angry 45.9%
Disgusted 45.1%
Confused 45.4%
Surprised 45.5%
Sad 46.9%

AWS Rekognition

Age 26-43
Gender Male, 52.5%
Angry 46.4%
Sad 46.4%
Happy 46%
Calm 46.6%
Surprised 45.7%
Confused 45.7%
Disgusted 48.2%

AWS Rekognition

Age 35-52
Gender Male, 98.7%
Calm 3.5%
Disgusted 6.7%
Confused 2.8%
Happy 56.5%
Surprised 12.2%
Angry 13%
Sad 5.3%

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 45
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.2%
Person 99%
Suit 96%

Captions

Microsoft

a group of people posing for a photo 99.3%
a group of people posing for the camera 99.2%
a group of people posing for a picture 99.1%