Human Generated Data

Title

Untitled (couple dancing at wedding reception)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12114

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple dancing at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.8
Apparel 99.8
Person 99.7
Human 99.7
Person 99.2
Hat 98.9
Person 95.2
Face 93.6
Person 93.1
Shirt 85.8
Furniture 82.6
Chair 82.6
Tie 80.2
Accessories 80.2
Accessory 80.2
Suit 78.2
Coat 78.2
Overcoat 78.2
Sailor Suit 77.9
Person 77.8
Dish 76.4
Meal 76.4
Food 76.4
Portrait 71.3
Photo 71.3
Photography 71.3
Head 70
Clinic 66.4
Female 64.9
Indoors 64.7
Table 63.8
Building 63.3
Housing 63.3
Man 63.2
Sunglasses 63
Steamer 59.3
Teeth 58.6
Lip 58.6
Mouth 58.6
Wedding 57.9
Bridegroom 57.9
Crowd 57.7
Scientist 57
Performer 56.6
Lab Coat 55.9
Room 55.6
Dessert 55.2
Cream 55.2
Creme 55.2

Imagga
created on 2022-01-22

lab coat 65.7
coat 57.6
man 47.8
person 40.3
male 38.3
professional 38.3
patient 35.5
people 34.1
doctor 32.9
medical 32.7
nurse 28.9
adult 28.4
hospital 28.3
work 25.9
clinic 24.8
working 24.8
health 23
team 22.4
pharmacist 22.1
business 21.9
garment 21.4
smiling 21
happy 20.7
job 20.4
businessman 20.3
medicine 20.3
indoors 20.2
worker 19.6
office 19.4
colleagues 18.5
desk 18
laboratory 17.4
sitting 17.2
teamwork 16.7
lab 16.5
health professional 16.5
occupation 16.5
men 16.3
meeting 16
clothing 16
table 15.6
businesswoman 15.5
30s 15.4
computer 15.2
talking 15.2
student 14.9
mature 14.9
businesspeople 14.2
science 14.2
case 14.2
care 14
scientist 13.7
exam 13.4
uniform 13.3
room 13
20s 12.8
assistant 12.6
sick person 12.5
research 12.4
color 12.3
senior 12.2
group 12.1
home 12
associates 11.8
40s 11.7
specialist 11.7
portrait 11.7
test 11.6
smile 11.4
together 11.4
biology 11.4
cheerful 11.4
face 11.4
couple 11.3
education 11.3
women 11.1
indoor 11
laptop 10.9
coworkers 10.8
chemistry 10.6
mid adult 10.6
looking 10.4
casual 10.2
treatment 10.1
two people 9.7
chemical 9.7
technology 9.7
corporate 9.5
lifestyle 9.4
two 9.3
bright 9.3
practitioner 9.1
hairdresser 9
suit 9
to 8.9
experiment 8.8
scientific 8.7
happiness 8.6
illness 8.6
shop 8.5
manager 8.4
horizontal 8.4
successful 8.2
confident 8.2
equipment 8.2
barbershop 8
chemist 7.9
doctors 7.9
day 7.9
forties 7.9
50s 7.9
cure 7.8
expertise 7.8
check 7.7
profession 7.7
serious 7.6
bed 7.6
college 7.6
plan 7.6
study 7.5
holding 7.4
school 7.2
attractive 7

Google
created on 2022-01-22

Hat 91.8
Black-and-white 85.6
Style 83.9
Cooking 76.5
Sun hat 76
Snapshot 74.3
Event 72.7
Eyewear 72.2
Chef 71.8
T-shirt 70.6
Monochrome photography 69.3
Vintage clothing 67.4
Service 66.7
Monochrome 66.1
Smile 65.6
Art 64.9
Stock photography 62.4
Room 61.5
Uniform 61.4
Cook 56.9

Microsoft
created on 2022-01-22

text 98.6
clothing 94.1
human face 93.5
smile 90.6
person 89.1
man 86.5
black and white 55.1

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 100%
Surprised 99%
Calm 0.9%
Confused 0%
Sad 0%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Happy 41.9%
Surprised 34.9%
Fear 10.9%
Confused 3.9%
Calm 2.3%
Disgusted 2.2%
Sad 2.1%
Angry 1.8%

AWS Rekognition

Age 52-60
Gender Female, 80.7%
Sad 62.2%
Calm 23%
Happy 10.8%
Confused 1.2%
Fear 1.1%
Surprised 0.9%
Disgusted 0.5%
Angry 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 98.9%
Tie 80.2%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 77%
a group of people standing in front of a mirror posing for the camera 76.4%
a group of people in front of a mirror posing for the camera 76.3%

Text analysis

Amazon

1147.
MJIR
MJIR YT3AS ARCA
ARCA
YT3AS

Google

MJI3 YTRA2 AD A
MJI3
YTRA2
AD
A