Human Generated Data

Title

Untitled (two women talking to police officer who takes notes)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14362

Human Generated Data

Title

Untitled (two women talking to police officer who takes notes)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.6
Person 99.6
Person 99
Person 98.1
Military 92.6
Military Uniform 92
Officer 92
Apparel 78.7
Clothing 78.7
Hat 78.7
Sailor Suit 78
Accessories 66.9
Sunglasses 66.9
Accessory 66.9
Captain 58.8

Imagga
created on 2022-01-29

man 47.7
person 38.8
nurse 35
male 32.7
people 31.8
professional 27.4
adult 23.9
work 23.5
worker 18.1
job 17.7
indoors 17.6
smiling 17.3
men 17.2
patient 16.8
medical 16.8
lifestyle 15.9
happy 15.7
occupation 15.6
couple 14.8
office 14.6
portrait 14.2
holding 14
smile 12.8
team 12.5
uniform 12.5
coat 12.3
doctor 12.2
business 12.1
sitting 12
life 11.9
health 11.8
happiness 11.7
lab 11.7
laboratory 11.6
education 11.2
clothing 10.8
medicine 10.6
attractive 10.5
looking 10.4
desk 10.4
technology 10.4
equipment 10.4
home 10.4
hospital 10.2
casual 10.2
two 10.2
suit 9.9
scientist 9.8
science 9.8
cheerful 9.7
working 9.7
chemistry 9.7
black 9.6
teacher 9.6
profession 9.6
women 9.5
love 9.5
necktie 9.1
bow tie 9
instrument 9
handsome 8.9
businessman 8.8
assistant 8.7
student 8.7
serious 8.6
research 8.6
communication 8.4
board 8.3
clinic 8.2
group 8.1
to 8
interior 8
lab coat 7.8
mid adult 7.7
modern 7.7
test 7.7
diversity 7.7
bride 7.7
case 7.6
guy 7.6
biology 7.6
groom 7.5
meeting 7.5
enjoyment 7.5
human 7.5
safety 7.4
wedding 7.4
indoor 7.3
computer 7.2
family 7.1

Google
created on 2022-01-29

Sleeve 87
Coat 86.6
Hat 84.3
Eyewear 81.7
Service 71.9
Medical 71.5
Monochrome photography 70.9
Monochrome 68.8
Event 68.5
Vintage clothing 67.7
T-shirt 65.9
Science 65.5
Font 65.5
Art 63.6
Health care 62.7
Room 62.5
Health care provider 62.4
History 61.7
Medical assistant 56.6
Cap 55.1

Microsoft
created on 2022-01-29

human face 95.8
person 94.5
clothing 94.2
text 93.8
man 91.6
drawing 90.4
black and white 84.1
sketch 81.3

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 83.1%
Calm 98.1%
Sad 0.8%
Surprised 0.4%
Angry 0.3%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99%
Calm 99.4%
Sad 0.3%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Happy 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 91.9%
Surprised 99.6%
Fear 0.1%
Happy 0.1%
Calm 0.1%
Sad 0%
Disgusted 0%
Confused 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 78.7%
Sunglasses 66.9%

Captions

Microsoft

a man standing in front of a window 71.9%
a man sitting in front of a window 62.5%
an old photo of a man 62.4%

Text analysis

Amazon

MJIR
MJIR YT3RAS
YT3RAS

Google

MJIR
MJIR YT3RA A
A
YT3RA