Human Generated Data

Title

Untitled (elderly women wearing hats)
Date

1948
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15637.1

Human Generated Data

Title

Untitled (elderly women wearing hats)

People

Artist: Jack Gould, American

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 98.7
Person 98.7
Person 98.4
Apparel 98
Clothing 98
Accessory 97.4
Sunglasses 97.4
Accessories 97.4
Person 96.1
Person 95.2
People 65.3
Sunglasses 62.8
Face 61.9
Hat 60.9
Finger 60.2
Clinic 59.7
Creme 57
Food 57
Cake 57
Dessert 57
Cream 57
Icing 57
Bonnet 55.3

Imagga
created on 2022-02-05

nurse 49.5
surgeon 43.7
medical 39.7
man 39.6
doctor 37.6
people 33.4
professional 33.2
medicine 31.7
person 28.3
laboratory 27.9
male 26.9
worker 26.7
hospital 26.6
work 25.9
health 25
adult 24.1
specialist 23.2
lab 22.3
negative 21.8
scientist 20.6
clinic 20.5
chemistry 20.3
occupation 20.1
uniform 19.8
science 19.5
working 19.4
film 19.3
research 19
biology 19
coat 18.9
men 18.9
equipment 18.2
chemical 17.4
patient 17.3
test 17.3
care 16.4
student 16.3
profession 16.3
illness 16.2
education 15.6
scientific 15.5
team 14.3
human 14.2
portrait 14.2
instrument 14.1
looking 13.6
photographic paper 13.4
development 13.3
job 13.3
room 12.8
surgery 12.7
assistant 12.6
technology 12.6
serious 12.4
business 12.1
office 12
technician 11.7
optical 11.6
exam 11.5
study 11.2
women 11.1
microscope 10.8
chemist 10.8
expertise 10.7
happy 10.6
senior 10.3
mask 10.1
lab coat 9.8
businessman 9.7
indoors 9.7
stethoscope 9.6
shower cap 9.5
desk 9.4
smiling 9.4
smile 9.3
glasses 9.2
cap 9.2
photographic equipment 9
researcher 8.9
surgical 8.9
biotechnology 8.8
computer 8.8
home 8.8
tube 8.7
emergency 8.7
industry 8.5
face 8.5
clothing 8.3
to 8
analysis 7.8
sitting 7.7
teamwork 7.4
indoor 7.3
laptop 7.3
blackboard 7.3
hair 7.1

Google
created on 2022-02-05

Sleeve 86.7
Art 81.2
Hat 75.2
Vintage clothing 71.2
Event 64.8
Monochrome photography 63.1
Stock photography 63.1
Room 63
Monochrome 61.3
Visual arts 56.5
Service 56.3
Photographic paper 55.6
Eyewear 51.9
History 51.8
Font 50.2

Microsoft
created on 2022-02-05

text 98.2
drawing 95.4
person 90.6
clothing 87.8
sketch 85.9
human face 85.2
art 62.7

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 85.4%
Calm 99%
Surprised 0.2%
Sad 0.2%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.1%
Calm 80.9%
Happy 8.6%
Confused 5.5%
Disgusted 1.5%
Sad 1.5%
Surprised 1%
Angry 0.6%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Sunglasses 97.4%
Hat 60.9%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 77.6%
a group of people standing in front of a mirror 77.5%
a group of people in front of a mirror posing for the camera 77%