Human Generated Data

Title

Untitled (Miss Wool and Sam Glosserman, Mayor in clothing store)

Date

1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2612

Human Generated Data

Title

Untitled (Miss Wool and Sam Glosserman, Mayor in clothing store)

People

Artist: Harry Annas, American 1897 - 1980

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.2
Person 99.2
Person 98.7
Apparel 92.9
Clothing 92.9
Clinic 92.2
Furniture 81.6
Hospital 65.4
Chair 60.4
Operating Theatre 59.1
Doctor 58.8
Indoors 57

Imagga
created on 2022-01-15

shop 47.7
barbershop 43.3
man 41.7
clinic 38.8
people 36.8
male 36.2
person 33.9
mercantile establishment 32.5
professional 30.1
doctor 30.1
medical 28.2
patient 25.5
work 25.1
adult 24
indoors 23.7
lab coat 22.5
smiling 22.4
coat 22.4
hospital 22.2
happy 21.9
place of business 21.4
occupation 21.1
health 20.8
business 20.6
working 20.3
men 19.7
office 19.1
women 19
medicine 17.6
room 17.5
worker 16.3
sitting 16.3
team 16.1
job 15.9
businessman 15.9
counter 14.9
portrait 14.9
nurse 14.7
laboratory 14.5
technology 14.1
lab 13.6
looking 13.6
30s 13.5
desk 13.2
senior 13.1
smile 12.8
computer 12.8
casual 12.7
colleagues 12.6
teamwork 12
pharmacist 11.8
assistant 11.7
care 11.5
profession 11.5
illness 11.4
group 11.3
mature 11.2
day 11
scientist 10.8
science 10.7
color 10.6
stall 10.5
education 10.4
table 10.4
establishment 10.4
lifestyle 10.1
laptop 10
businesswoman 10
modern 9.8
50s 9.8
equipment 9.8
40s 9.7
middle aged 9.7
chemistry 9.7
research 9.5
talking 9.5
manager 9.3
face 9.2
inside 9.2
treatment 9.2
20s 9.2
student 9.1
surgeon 9
suit 9
together 8.8
two people 8.7
clothing 8.7
standing 8.7
mid adult 8.7
test 8.7
exam 8.6
corporate 8.6
serious 8.6
bright 8.6
uniform 8.6
businesspeople 8.5
biology 8.5
two 8.5
horizontal 8.4
life 8.3
holding 8.3
indoor 8.2
cheerful 8.1
home 8
specialist 7.9
surgery 7.8
hairdresser 7.8
chemical 7.7
pain 7.7
customer 7.6
retail 7.6
adults 7.6
store 7.6
instrument 7.5
light 7.3
restaurant 7.1
health professional 7.1
to 7.1
happiness 7
look 7

Google
created on 2022-01-15

Sleeve 87.2
Smile 86.4
Black-and-white 84.1
Style 83.8
Apron 83.1
Hat 78.9
Fashion design 77.3
Monochrome photography 74.1
Monochrome 74.1
Event 71.9
Vintage clothing 71.2
Uniform 70.6
Service 69.6
Cooking 66.4
Stock photography 62.8
Costume 62
History 59.7
Art 59.2
Room 58
T-shirt 57.5

Microsoft
created on 2022-01-15

person 98.8
text 98.5
man 96.4
clothing 94.9
smile 92.8
player 75.2
human face 73.5
dress 53.3

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Happy 98.2%
Sad 0.7%
Surprised 0.4%
Calm 0.3%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 83.1%
Happy 99.3%
Surprised 0.2%
Calm 0.2%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man standing next to a window 38.5%
a group of men standing next to a window 38.4%
a group of men posing for a picture 38.3%

Text analysis

Amazon

is
EN
Feipo
OUS
RODVK--2.VEEIA--E11W
control
525
Feepe

Google

KODVK--2.VEEIA-- E|T W
KODVK--2.VEEIA--
E|T
W