Human Generated Data

Title

Untitled (men and women around a bar staring to their left)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4714

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women around a bar staring to their left)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 100
Apparel 100
Coat 100
Overcoat 100
Tuxedo 99.6
Person 99
Human 99
Person 98.7
Person 98.5
Person 97.7
Person 96.8
Dress 94.2
Person 93.5
Blazer 91.3
Jacket 91.3
Suit 90.2
Furniture 87.9
Shirt 86.8
Suit 86.4
Tie 83.4
Accessory 83.4
Accessories 83.4
Table 82.6
Dining Table 82.5
Wedding 78.7
Bridegroom 78.7
Robe 78.1
Fashion 78.1
Person 77.3
Gown 76.7
People 73.4
Man 70.8
Face 69.1
Female 69
Portrait 67.8
Photography 67.8
Photo 67.8
Indoors 67.3
Sunglasses 66.5
Wedding Gown 66.3
Chair 63.1
Evening Dress 59.4
Crystal 57.7
Plant 57.4
Flower 57.4
Blossom 57.4
Reception 57.4
Crowd 56.3
Girl 55.3
Tie 54.1
Person 46.8

Imagga
created on 2022-01-29

specialist 60.5
doctor 58.3
coat 52
professional 51.2
man 51.1
medical 49.5
hospital 48.3
lab coat 47.3
nurse 45.3
male 40.5
person 39.3
adult 38.7
clinic 37.7
medicine 36.2
people 35.7
health 34.1
stethoscope 31.5
job 31
work 29.9
care 29.7
office 29
occupation 28.4
looking 28
business 28
mature 27.9
team 27.8
happy 27.6
smiling 26.1
portrait 25.9
doctors 25.6
working 24.8
uniform 24.7
practitioner 24.7
businessman 23.9
confident 23.7
clinical 22.5
colleagues 21.4
patient 21.3
laboratory 21.2
indoor 21
worker 20.7
handsome 20.5
teamwork 20.4
smile 20
group 19.4
bright 19.3
surgeon 19
men 18.9
profession 18.2
businesspeople 18.1
desk 18
computer 17.6
elderly 17.3
face 16.4
teacher 15.9
attractive 15.4
casual 15.3
lifestyle 15.2
indoors 15
camera 14.8
associates 14.8
physician 14.7
corporate 14.6
30s 14.4
senior 14.1
color 13.9
garment 13.8
coworkers 13.8
clothing 13.7
consultant 13.7
illness 13.4
look 13.2
treatment 12.9
general practitioner 12.9
20s 12.8
businesswoman 12.7
40s 12.7
expertise 12.6
educator 12.3
friendly 11.9
day 11.8
busy 11.6
holding 11.6
staff 11.5
couple 11.3
meeting 11.3
standing 11.3
horizontal 10.9
good mood 10.8
lab 10.7
practice 10.7
human 10.5
research 10.5
success 10.5
student 10.4
technology 10.4
sitting 10.3
women 10.3
suit 10.1
successful 10.1
heal 9.8
modern 9.8
science 9.8
middle aged 9.7
examination 9.7
assistant 9.7
cooperation 9.7
exam 9.6
table 9.5
healthy 9.5
happiness 9.4
two 9.3
healing 9.3
room 9.2
clinician 8.9
businessmen 8.8
partner 8.7
light 8.7
sick 8.7
mid adult 8.7
corporation 8.7
test 8.7
golfer 8.7
partnership 8.7
pharmacist 8.5
glasses 8.3
laptop 8.2
lady 8.1
chemical 8.1
home 8
intern 7.9
expert 7.9
crew 7.9
50s 7.8
diagnosis 7.8
scientist 7.8
medication 7.8
surgery 7.8
workers 7.8
2 7.8
listening 7.7
old 7.7
workplace 7.6
cheerful 7.3
life 7.2
building 7.1

Google
created on 2022-01-29

Coat 92.9
Tie 90.4
Gesture 85.3
Black-and-white 84.9
Style 83.8
Suit 82.3
White-collar worker 75.7
Curtain 75.1
Monochrome 74.6
Monochrome photography 74.5
Formal wear 74.4
Blazer 74.1
Event 72.3
Chair 71.4
Window 69
Flower 64.9
Vintage clothing 64.4
Room 63.7
Stock photography 63.4
Table 61.9

Microsoft
created on 2022-01-29

person 91.9
indoor 87.5
wedding dress 79.2
suit 78.5
wedding 77.2
black and white 75.4
clothing 73.2
text 72.5
tableware 60.8
bride 59
vase 58.3
posing 56.4
conference room 10.5

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.3%
Calm 99.2%
Surprised 0.3%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 99.7%
Calm 29.2%
Sad 23.2%
Confused 17.9%
Surprised 14.4%
Happy 5.9%
Fear 3.7%
Disgusted 3.1%
Angry 2.6%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Calm 96%
Sad 1.7%
Confused 0.8%
Surprised 0.4%
Disgusted 0.4%
Happy 0.3%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 23-33
Gender Male, 93.9%
Calm 27.9%
Happy 20.5%
Confused 19.2%
Sad 16.2%
Surprised 6.3%
Angry 5.8%
Disgusted 2.8%
Fear 1.4%

AWS Rekognition

Age 37-45
Gender Male, 92.6%
Surprised 35.4%
Calm 31.3%
Happy 11.3%
Sad 9.7%
Fear 5.2%
Angry 3.3%
Disgusted 2.6%
Confused 1.3%

AWS Rekognition

Age 30-40
Gender Female, 83.1%
Happy 99.5%
Surprised 0.2%
Calm 0.1%
Fear 0.1%
Sad 0%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 51-59
Gender Male, 98.9%
Surprised 34.9%
Calm 32%
Sad 7.5%
Confused 5.9%
Fear 5.9%
Angry 5.2%
Happy 4.3%
Disgusted 4.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Suit 90.2%
Tie 83.4%
Sunglasses 66.5%

Captions

Microsoft

a group of people posing for a photo 95.1%
a group of people posing for the camera 95%
a group of people posing for a picture 94.9%

Text analysis

Amazon

YT33A2
CEAO YT33A2
CEAO