Human Generated Data

Title

Untitled (man putting hand on the leg of Hasty Pudding performer)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7645
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man putting hand on the leg of Hasty Pudding performer)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 96.5
Suit 95.1
Coat 95.1
Overcoat 95.1
Clothing 95.1
Apparel 95.1
Clinic 75.4
Face 74.1
Portrait 62.9
Photography 62.9
Photo 62.9
Finger 60.9
People 60.4
Furniture 59.6
Chair 59.5
Wood 59.3
Airplane 58.9
Vehicle 58.9
Aircraft 58.9
Transportation 58.9
Sitting 57
Hospital 55.5

Imagga
created on 2022-01-08

nurse 71.4
patient 51.4
person 45.1
man 45.1
male 34.8
people 29
hospital 28.2
medical 27.4
professional 26.1
doctor 24.5
case 23.7
sick person 23.2
indoors 22
adult 21.7
surgeon 21.5
health 20.9
work 20.4
room 20.4
office 19.4
clinic 19.2
sitting 18.9
worker 18.8
job 18.6
men 18
senior 17.8
specialist 17.8
working 17.7
occupation 17.4
home 16.8
business 16.4
lab coat 16.1
businessman 15.9
medicine 15.9
table 15.6
smiling 15.2
happy 15
coat 14.7
illness 14.3
talking 14.3
computer 13.6
uniform 12.6
meeting 12.3
women 11.1
portrait 11
happiness 11
lifestyle 10.8
surgery 10.8
care 10.7
smile 10.7
sick 10.6
to 10.6
30s 10.6
together 10.5
two 10.2
holding 9.9
team 9.9
cheerful 9.8
40s 9.7
couple 9.6
exam 9.6
elderly 9.6
profession 9.6
clothing 9.3
businesswoman 9.1
color 8.9
looking 8.8
middle aged 8.8
two people 8.8
looking camera 8.7
pain 8.6
desk 8.5
mature 8.4
teamwork 8.3
success 8
interior 8
executive 7.8
retired 7.8
check 7.7
corporate 7.7
laboratory 7.7
retirement 7.7
industry 7.7
casual 7.6
bed 7.6
businesspeople 7.6
student 7.5
service 7.4
inside 7.4
treatment 7.4
chair 7.3
modern 7

Google
created on 2022-01-08

Hat 89.5
Black-and-white 82.4
Adaptation 79.3
Snapshot 74.3
Monochrome photography 73.8
Suit 72.7
Service 71.9
Monochrome 71.4
Event 70
Vintage clothing 68.7
Photo caption 68.3
Classic 66.1
Stock photography 64.9
Smile 64.5
Font 63
Sitting 63
Room 60.5
History 57.6
Photographic paper 56.6
Medical 54.3

Microsoft
created on 2022-01-08

person 99.7
text 96.8
man 94.6
clothing 94.3
black and white 67.9
furniture 65.5
human face 64
smile 50.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.5%
Happy 93.9%
Confused 2.9%
Sad 2.2%
Angry 0.2%
Surprised 0.2%
Calm 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 98.7%
Happy 50.9%
Sad 40.5%
Calm 4.1%
Angry 1.8%
Disgusted 1%
Confused 0.6%
Fear 0.5%
Surprised 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Suit 95.1%
Airplane 58.9%

Captions

Microsoft

a group of people posing for the camera 80.3%
a group of people posing for a photo 72.6%
a man sitting in a chair 72.5%

Text analysis

Amazon

32A8
32A8 YT33A2 830N3330
830N3330
YT33A2
.25
29HH
zr
29HH .25
TR