Human Generated Data

Title

Untitled (group of wedding guests)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8588
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of wedding guests)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.7
Apparel 99.7
Hat 99.5
Person 99.3
Human 99.3
Person 98.5
Face 98.5
Person 98.1
Person 98
Person 97.7
Person 94.5
Sailor Suit 88.6
Suit 80.4
Coat 80.4
Overcoat 80.4
Smile 79
Portrait 74.8
Photography 74.8
Photo 74.8
Sleeve 71.6
Outdoors 70.6
Shirt 70.6
Suit 70.5
Female 67.1
People 63.1
Icing 62.3
Food 62.3
Dessert 62.3
Cake 62.3
Cream 62.3
Creme 62.3
Person 61.7
Suit 58.5
Man 58.4
Nature 57.2
Sunglasses 56.1
Accessories 56.1
Accessory 56.1
Officer 55.3
Military 55.3
Military Uniform 55.3

Imagga
created on 2022-01-09

man 47.7
male 41.2
person 37.2
people 29.6
adult 26.8
portrait 26.5
business 23.7
professional 23.5
businessman 22.9
men 22.3
work 21.2
face 19.9
handsome 19.6
bow tie 17.5
happy 17.5
office 17.3
corporate 17.2
executive 16.1
job 15.9
clothing 15.1
black 15
necktie 14.9
worker 14.4
happiness 14.1
computer 13.6
looking 13.6
mask 13.5
tie 13.3
medical 13.2
guy 12.8
suit 12.3
smiling 12.3
smile 12.1
confident 11.8
working 11.5
attractive 11.2
student 11.1
glasses 11.1
garment 10.9
color 10.6
desk 10.4
hat 10.2
occupation 10.1
coat 10.1
hand 9.9
human 9.7
indoors 9.7
laboratory 9.6
serious 9.5
education 9.5
uniform 9.5
college 9.5
equipment 9.5
day 9.4
doctor 9.4
mature 9.3
indoor 9.1
jacket 9.1
team 9
scientist 8.8
lab 8.7
standing 8.7
hands 8.7
profession 8.6
businesspeople 8.5
adults 8.5
casual 8.5
horizontal 8.4
patient 8.2
laptop 8.2
success 8
hospital 8
hair 7.9
employee 7.9
bright 7.9
couple 7.8
chemistry 7.7
modern 7.7
two 7.6
research 7.6
biology 7.6
career 7.6
senior 7.5
manager 7.4
camera 7.4
emotion 7.4
safety 7.4
protection 7.3
science 7.1
medicine 7
look 7

Google
created on 2022-01-09

Shirt 94.1
Black 89.6
Smile 88.8
Coat 87.9
Sleeve 87.2
Style 83.8
Black-and-white 82.8
Font 80.3
Eyewear 77.9
Collar 74.7
Crew 70.2
Monochrome photography 69.9
Monochrome 69.4
Vintage clothing 67.8
Uniform 66.3
Event 65.8
Hat 64.7
Room 63.3
History 61.8
Team 60.9

Microsoft
created on 2022-01-09

text 99.3
person 98.8
clothing 95.4
smile 94.6
human face 92.4
man 87.4
black and white 73.6
posing 71.2

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 97.5%
Happy 98.7%
Calm 0.5%
Confused 0.3%
Surprised 0.3%
Sad 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 99.6%
Happy 83.8%
Sad 6.4%
Surprised 3.2%
Calm 2.8%
Confused 1.8%
Disgusted 1.1%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 100%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 99.4%
Calm 48.5%
Sad 20.6%
Angry 9.8%
Surprised 9.2%
Confused 4.9%
Disgusted 4.1%
Fear 1.5%
Happy 1.4%

AWS Rekognition

Age 31-41
Gender Male, 83%
Calm 97.1%
Happy 1.7%
Surprised 0.4%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.5%
Person 99.3%
Suit 80.4%

Captions

Microsoft

a group of people posing for a photo 97.8%
a group of people posing for the camera 97.7%
a group of people posing for a picture 97.6%

Text analysis

Amazon

17743
use

Google

19743· MAMT8
19743·
MAMT8