Human Generated Data

Title

Untitled (elderly women wearing hats)

Date

1948

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15637

Human Generated Data

Title

Untitled (elderly women wearing hats)

People

Artist: Jack Gould, American

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Person 98.9
Human 98.9
Person 98.8
Clothing 98.2
Apparel 98.2
Person 97.2
Person 87.8
Face 82.7
Costume 81.3
Military 80.7
People 78.9
Military Uniform 78.6
Hat 70.3
Officer 69.7
Sailor Suit 62.5
Cap 60.6
Head 57.9
Photography 57.3
Photo 57.3
Female 56.7
Soldier 55.2

Imagga
created on 2022-03-25

man 38.3
professional 33.6
medical 33.5
male 33.3
doctor 32.9
person 32.4
coat 31.3
people 28.4
work 27.5
medicine 26.4
uniform 24.2
hospital 23.9
adult 23.4
nurse 22.3
occupation 21.1
job 19.5
worker 19.4
clothing 19.1
portrait 18.8
necktie 18.3
health 18.1
men 17.2
clinic 17.2
care 16.5
patient 16.3
office 16.3
bow tie 16
business 15.8
smiling 15.2
garment 15
indoors 14.9
trench coat 14.9
stethoscope 14.8
surgeon 14.6
lab 14.6
expertise 14.5
profession 14.4
lab coat 14.2
happy 13.8
home 13.6
smile 13.5
illness 13.3
room 12.8
looking 12.8
laboratory 12.5
exam 12.4
working 12.4
businessman 12.4
mature 12.1
face 12.1
computer 12
raincoat 11.9
science 11.6
standing 11.3
senior 11.2
student 11.2
confident 10.9
scientist 10.8
attractive 10.5
desk 10.4
lifestyle 10.1
specialist 10
surgery 9.8
chemistry 9.7
serious 9.5
research 9.5
biology 9.5
military uniform 9.2
treatment 9.2
handsome 8.9
physician 8.8
middle aged 8.8
assistant 8.7
couple 8.7
table 8.7
glasses 8.3
equipment 8.3
hat 8.1
team 8.1
women 7.9
happiness 7.8
black 7.8
education 7.8
engineer 7.8
staff 7.8
test 7.7
collar 7.7
practitioner 7.7
casual 7.6
two 7.6
fashion 7.5
shirt 7.5
study 7.5
suit 7.4
phone 7.4
safety 7.4
friendly 7.3
cheerful 7.3
success 7.2
family 7.1
to 7.1

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

person 99.5
wall 95.3
clothing 95.2
smile 94.2
fashion accessory 94.1
human face 94
text 92.7
man 91
hat 87.6
woman 82.3
people 74.2
sketch 60.6
black and white 56.5
posing 50.6
old 45.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 58-66
Gender Female, 100%
Calm 93%
Confused 1.9%
Surprised 1.7%
Angry 1.2%
Disgusted 0.8%
Sad 0.6%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 56-64
Gender Male, 97.8%
Happy 98.1%
Calm 0.6%
Surprised 0.4%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 56-64
Gender Male, 96.5%
Calm 68%
Happy 27.5%
Angry 1.1%
Disgusted 1.1%
Confused 0.8%
Sad 0.6%
Surprised 0.6%
Fear 0.3%

Microsoft Cognitive Services

Age 56
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people posing for a photo 96.3%
a group of people posing for the camera 96.2%
a group of people posing for a picture 96.1%