Human Generated Data

Title

Untitled (crowd of people, two seated men in hats in front)

Date

1947

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14337

Human Generated Data

Title

Untitled (crowd of people, two seated men in hats in front)

People

Artist: Jack Gould, American

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 100
Apparel 100
Hat 99.7
Human 99.5
Person 99.5
Person 99.4
Hat 99.3
Person 95.2
Sun Hat 90.2
Person 77.3
Cowboy Hat 75.3
Sunglasses 72
Accessories 72
Accessory 72
Coat 67.7
Overcoat 64.5
Person 48.8
Person 48.6

Imagga
created on 2022-01-29

cowboy hat 54.8
hat 53.4
man 39
nurse 38.6
medical 36.2
headdress 34.8
doctor 34.8
professional 33.7
people 31.2
person 31
worker 30.7
male 30.5
clothing 30.2
work 29.8
medicine 28.2
laboratory 28
scientist 25.5
lab 24.3
hospital 24.2
adult 23.7
research 22.8
health 22.2
science 22.2
working 22.1
chemistry 21.3
biology 20.9
coat 20.2
chemical 19.3
team 18.8
job 18.6
looking 18.4
student 18.3
patient 17.7
scientific 17.4
occupation 17.4
surgeon 16.6
test 16.4
men 16.3
uniform 16.1
experiment 14.6
portrait 14.2
lab coat 14.2
smiling 13.7
business 13.4
equipment 13.3
covering 13
analysis 12.7
assistant 12.6
consumer goods 12.5
profession 12.4
education 12.1
clinic 12
microscope 12
mask 11.9
women 11.9
chemist 11.8
holding 11.6
office 11.4
development 11.4
happy 11.3
technology 11.1
teamwork 11.1
care 10.7
waiter 10.7
expertise 10.7
serious 10.5
instrument 10.3
face 9.9
employee 9.9
researcher 9.9
microbiology 9.8
sterile 9.8
biotechnology 9.8
technician 9.8
surgery 9.8
cure 9.7
businessman 9.7
indoors 9.7
exam 9.6
illness 9.5
table 9.5
senior 9.4
study 9.3
two 9.3
smile 9.3
standing 8.7
tube 8.7
talking 8.6
industry 8.5
hand 8.4
human 8.2
businesswoman 8.2
success 8
surgical 7.9
glass 7.9
black 7.8
discovery 7.8
specialist 7.8
attractive 7.7
one 7.5
focus 7.4
glasses 7.4
engineer 7.4
safety 7.4
guy 7.4
20s 7.3
room 7.3
computer 7.2
to 7.1
day 7.1
dining-room attendant 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

hat 98.2
text 96.7
fashion accessory 95.2
drawing 94.7
clothing 87
sketch 86.4
black and white 83.8
person 77.7
fedora 75.4
sun hat 68.1
cowboy hat 61.8

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 65.3%
Calm 99.6%
Sad 0.3%
Angry 0%
Happy 0%
Fear 0%
Disgusted 0%
Confused 0%
Surprised 0%

AWS Rekognition

Age 38-46
Gender Male, 76.4%
Calm 91.9%
Sad 3.8%
Confused 1.4%
Angry 0.8%
Disgusted 0.8%
Happy 0.5%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 50-58
Gender Male, 87.3%
Calm 88.9%
Surprised 4.8%
Sad 1.7%
Disgusted 1.3%
Angry 1.2%
Fear 0.9%
Confused 0.6%
Happy 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.7%
Person 99.5%

Captions

Microsoft

a man wearing a hat 76.1%
an old photo of a man 74.9%
a man in a hat 74.8%

Text analysis

Amazon

a
TI
MJI7
MJI7 YESTAD
YESTAD

Google

MJ17
A7JA
MJ17 YT37A2 A7JA
YT37A2