Human Generated Data

Title

Untitled (men gathered around table)
Date

1965
People

Artist: Samuel Cooper, American active 1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19556

Human Generated Data

Title

Untitled (men gathered around table)

People

Artist: Samuel Cooper, American active 1950s

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.6
Human 99.6
Apparel 98.9
Hat 98.9
Clothing 98.9
Person 98.8
Person 98.5
Person 98.1
Clinic 98
Sunglasses 97.9
Accessories 97.9
Accessory 97.9
Hat 96
Sunglasses 93.8
Hat 93.4
Person 92.6
Person 89.4
Hospital 87.1
Operating Theatre 86.7
Person 84.3
Doctor 74.7
Sunglasses 65.7
Indoors 60.6
Room 60.6

Imagga
created on 2022-03-05

person 42.2
nurse 41.6
man 40.4
male 37.6
professional 36.6
patient 33.9
people 31.8
medical 29.2
worker 28.9
surgeon 28.4
waiter 26.4
hospital 25.8
doctor 25.4
work 25.1
clinic 24.8
office 23.7
adult 23.6
working 22.1
businessman 22.1
lab coat 21.9
business 21.9
smiling 21.7
room 20.6
coat 20.4
sitting 19.8
happy 18.8
dining-room attendant 18.8
health 18.8
indoors 18.5
specialist 18.3
team 17.9
employee 17.4
occupation 17.4
teacher 17.2
job 16.8
medicine 16.7
men 16.3
desk 16.1
table 15.6
corporate 15.5
meeting 15.1
group 14.5
computer 14.4
exam 14.4
women 14.2
teamwork 13.9
laboratory 13.5
couple 13.1
education 13
businesswoman 12.7
holding 12.4
businesspeople 12.3
cheerful 12.2
student 12
executive 11.9
laptop 11.9
confident 11.8
lab 11.7
30s 11.6
sick person 11.2
clothing 11.2
educator 11.1
case 11
scientist 10.8
smile 10.7
color 10.6
illness 10.5
research 10.5
talking 10.5
uniform 10.5
adults 10.4
home 10.4
study 10.3
manager 10.3
happiness 10.2
communication 10.1
indoor 10.1
care 9.9
conference 9.8
colleagues 9.7
mid adult 9.7
looking 9.6
serious 9.5
biology 9.5
senior 9.4
two 9.3
successful 9.2
portrait 9.1
science 8.9
together 8.8
40s 8.8
chemistry 8.7
standing 8.7
workplace 8.6
casual 8.5
modern 8.4
inside 8.3
treatment 8.3
technology 8.2
suit 8.1
handsome 8
50s 7.8
surgery 7.8
middle aged 7.8
two people 7.8
assistant 7.8
check 7.7
test 7.7
collar 7.7
profession 7.7
college 7.6
instrument 7.6
human 7.5
clothes 7.5
mature 7.4
20s 7.3
success 7.2
board 7.2
lifestyle 7.2
face 7.1
to 7.1

Google
created on 2022-03-05

Shirt 95
Hat 94.3
Fedora 90
Sun hat 88.7
Cap 85.1
Black-and-white 84.9
Style 83.8
Headgear 81.8
Baseball cap 81.3
Motor vehicle 80.9
T-shirt 78.8
Service 73.2
Event 73
Monochrome photography 72.8
Monochrome 72.7
Cooking 71.4
Personal protective equipment 71.2
Suit 67.8
Eyewear 65.9
Job 64.9

Microsoft
created on 2022-03-05

person 99.8
hat 98.2
fashion accessory 98.1
black and white 96.5
clothing 96.2
text 88.5
fedora 79.4
monochrome 78.6
man 76.3
sun hat 72.6
cowboy hat 66.6

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 95.3%
Calm 96.4%
Sad 3.5%
Angry 0%
Surprised 0%
Confused 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 41-49
Gender Male, 86.2%
Calm 99.7%
Surprised 0.2%
Sad 0.1%
Angry 0%
Disgusted 0%
Confused 0%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 98.9%
Sunglasses 97.9%

Captions

Microsoft

a group of people in a room 87.8%
a group of people around each other 73.7%
a group of people standing in a room 73.6%

Text analysis

Amazon

2
T3
80
is % 2
%
AOOX
°?
is

Google

80
80