Human Generated Data

Title

Untitled (guests at wedding reception)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.44

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (guests at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Human 99.1
Person 99.1
Person 98.3
Person 98
Person 97.3
Face 89.4
Pub 87.3
Bar Counter 85
Clothing 76.4
Apparel 76.4
Hat 76.4
Tie 72.4
Accessory 72.4
Accessories 72.4
Person 72.3
Drink 67.1
Beverage 67.1
People 64.6
Dating 58.6
Hair 58
Cap 56.9

Clarifai
created on 2019-03-25

people 100
group 99.1
adult 98.9
two 97.6
man 96.1
woman 96
administration 95.3
group together 94.2
several 94.2
sit 93.7
wear 91.2
recreation 90.2
actress 89.8
leader 89.3
four 89.2
music 89.2
many 88.6
three 86.8
portrait 84.5
furniture 83.5

Imagga
created on 2019-03-25

man 37.6
adult 33.4
people 32.9
male 32.8
person 27.8
happy 27.6
business 27.3
office 26.6
businessman 24.7
corporate 22.3
executive 21.7
bartender 21.5
bow tie 20.6
couple 20
businesspeople 19.9
sitting 19.8
work 19.6
professional 19.6
businesswoman 19.1
men 18.9
happiness 18.8
group 18.5
suit 18.2
meeting 17.9
face 17.8
computer 17.6
attractive 17.5
portrait 17.5
smiling 16.6
indoor 16.4
job 15.9
smile 15.7
cheerful 15.4
team 15.2
handsome 15.2
communication 15.1
desk 15.1
worker 15
necktie 14.7
black 14.6
table 14.4
women 14.2
together 14
laptop 13.8
indoors 13.2
manager 13
teamwork 13
working 12.4
success 12.1
pretty 11.9
love 11.8
colleagues 11.7
formal 11.5
casual 11
two 11
businessmen 10.7
corporation 10.6
staff 10.5
fun 10.5
looking 10.4
confident 10
employee 9.9
home 9.6
workplace 9.5
grandma 9.4
friends 9.4
mature 9.3
horizontal 9.2
inside 9.2
successful 9.2
leisure 9.1
holding 9.1
room 8.9
color 8.9
businesswomen 8.8
conference 8.8
brunette 8.7
partner 8.7
lifestyle 8.7
30s 8.7
four 8.6
boss 8.6
talking 8.6
tie 8.5
females 8.5
career 8.5
barroom 8.5
company 8.4
glasses 8.3
occupation 8.2
20s 8.2
garment 8.1
clothing 8
sexy 8
day 7.8
good mood 7.8
discussion 7.8
busy 7.7
jacket 7.7
diversity 7.7
leadership 7.7
youth 7.7
student 7.6
fashion 7.5
joy 7.5
world 7.5
dress 7.2
celebration 7.2
romantic 7.1
family 7.1

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.5
indoor 92.5
people 55.4
black and white 24.5
retro 13.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 98.8%
Disgusted 0.4%
Surprised 2.3%
Confused 0.6%
Calm 0.1%
Happy 96.3%
Angry 0.3%
Sad 0%

AWS Rekognition

Age 35-52
Gender Female, 87.4%
Angry 1.8%
Calm 12.3%
Happy 79.4%
Confused 3%
Disgusted 0.5%
Surprised 1.1%
Sad 2.1%

AWS Rekognition

Age 20-38
Gender Female, 96.7%
Angry 16%
Surprised 8.4%
Sad 36.1%
Calm 6.6%
Confused 9.5%
Happy 4.4%
Disgusted 19%

AWS Rekognition

Age 23-38
Gender Male, 68.7%
Angry 2.5%
Disgusted 3.7%
Surprised 1.2%
Sad 1.3%
Confused 2.6%
Calm 1.8%
Happy 87%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 76.4%
Tie 72.4%

Captions

Microsoft

a group of people posing for the camera 96.8%
a group of people posing for a photo 94.9%
a group of people taking a selfie 86.5%