Human Generated Data

Title

Untitled (men in suits gathered at a reception)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11779
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men in suits gathered at a reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Clothing 99.4
Apparel 99.4
Person 98.8
Human 98.8
Shoe 98.6
Footwear 98.6
Person 98
Person 98
Person 98
Person 97.6
Person 97.4
Shoe 96.8
Sleeve 92.4
Person 91.7
Coat 87
Overcoat 87
Sunglasses 84.1
Accessories 84.1
Accessory 84.1
Sunglasses 84
Face 80.7
Long Sleeve 77.1
Shoe 75.1
Person 63.8
Portrait 61.2
Photography 61.2
Photo 61.2
Finger 60.1
Shirt 58.4
Tuxedo 56.2
Lab Coat 56.2
People 56.2
Sailor Suit 55.8
Crowd 55.1
Suit 53.2
Shoe 50.9

Imagga
created on 2022-01-15

nurse 68.1
man 49.1
male 45.4
doctor 43.2
professional 39.3
people 37.9
person 36.6
medical 36.2
team 34.9
hospital 34.5
group 32.2
business 32.2
adult 31.7
job 31
businessman 30.9
happy 30.7
medicine 29.1
health 25.7
smiling 25.3
stethoscope 25.1
occupation 24.7
care 24.7
portrait 24.6
men 24
confident 23.7
clinic 23.3
coat 22.8
work 22.8
patient 22.5
mature 22.3
teamwork 22.3
doctors 21.6
looking 21.6
worker 20.8
smile 20.7
standing 20
colleagues 19.4
uniform 19
practitioner 18.8
handsome 18.7
office 18.5
corporate 17.2
brass 17.1
businesswoman 16.4
30s 16.4
suit 16.1
working 15.9
women 15.8
success 15.3
specialist 15
attractive 14.7
clinical 14.7
surgeon 14.4
profession 14.4
staff 13.8
lab coat 13.8
wind instrument 13.5
meeting 13.2
lifestyle 13
20s 12.8
happiness 12.5
partnership 12.5
illness 12.4
company 12.1
groom 12
building 11.9
successful 11.9
casual 11.9
workers 11.6
diversity 11.5
businesspeople 11.4
cheerful 11.4
human 11.2
two 11
friendly 11
trombone 10.8
40s 10.7
student 10.6
mid adult 10.6
musical instrument 10.6
indoors 10.5
elderly 10.5
couple 10.5
case 10.3
camera 10.2
positive 10.1
healthy 10.1
life 10.1
diverse 9.8
physician 9.8
consultant 9.7
partners 9.7
expertise 9.7
laboratory 9.6
together 9.6
confidence 9.6
bright 9.3
modern 9.1
black 9
family 8.9
ill 8.8
chart 8.6
ethnic 8.6
talking 8.6
executive 8.5
cornet 8.4
holding 8.3
indoor 8.2
light 8
general practitioner 7.9
associates 7.9
coworkers 7.9
day 7.8
face 7.8
color 7.8
health care 7.8
practice 7.7
partner 7.7
sick 7.7
four 7.7
old 7.7
exam 7.7
tie 7.6
career 7.6
guy 7.5
room 7.4
treatment 7.3
lady 7.3

Google
created on 2022-01-15

Coat 89.7
Black 89.6
Gesture 85.3
Black-and-white 83.2
Adaptation 79.4
Monochrome photography 75.4
Uniform 72.3
Event 71.7
Military person 70.4
Vintage clothing 69.9
Monochrome 69.7
Non-commissioned officer 69.5
Crew 69.2
Hat 68
Formal wear 67.7
Team 63.7
Font 63.6
Stock photography 62.7
Photo caption 58.9
History 58.6

Microsoft
created on 2022-01-15

person 99.7
clothing 94
wedding 93
man 91.3
standing 91.2
text 89.9
group 71.2
wedding dress 60
ceremony 51.2
smile 50.5
posing 49.6
line 27.6
clothes 19.4

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 84.9%
Happy 90.7%
Calm 8%
Surprised 0.3%
Disgusted 0.3%
Sad 0.2%
Angry 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Female, 92.6%
Calm 42%
Happy 26.8%
Sad 18.7%
Surprised 5.2%
Disgusted 2.5%
Confused 2.1%
Angry 1.9%
Fear 0.9%

AWS Rekognition

Age 47-53
Gender Female, 96.1%
Calm 73.7%
Happy 19.9%
Confused 1.5%
Angry 1.2%
Surprised 1.1%
Sad 0.9%
Disgusted 0.9%
Fear 0.8%

AWS Rekognition

Age 53-61
Gender Female, 73.4%
Calm 48.9%
Sad 48.3%
Confused 1%
Surprised 0.7%
Angry 0.4%
Happy 0.3%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 48-56
Gender Male, 97%
Happy 59.8%
Calm 38.5%
Sad 0.5%
Confused 0.3%
Disgusted 0.3%
Angry 0.3%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Female, 72.7%
Calm 98.8%
Sad 1.1%
Surprised 0%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 98.3%
Calm 51.5%
Happy 28.1%
Sad 15.6%
Disgusted 1.3%
Angry 1.1%
Confused 0.9%
Fear 0.8%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Shoe 98.6%
Sunglasses 84.1%
Suit 53.2%

Captions

Microsoft

a group of people posing for the camera 97%
a group of people posing for a picture 96.9%
a group of people posing for a photo 95.4%

Text analysis

Amazon

MU3--YT--