Human Generated Data

Title

Untitled (two men standing and talking in post office)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14780

Human Generated Data

Title

Untitled (two men standing and talking in post office)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 98.7
Person 97.1
Person 96.8
Clothing 96.5
Apparel 96.5
Hat 95.4
Chef 74.5
Hat 69.1

Imagga
created on 2022-01-29

lab coat 69.6
coat 60.6
professional 44.4
medical 39.7
man 37.6
doctor 36.7
male 34.1
clinic 33.5
people 31.2
person 27.5
adult 27.2
nurse 26.8
hospital 26.7
work 26.7
occupation 26.6
pharmacist 26.2
medicine 25.5
garment 25.3
worker 25.1
job 23
health 22.9
clothing 19.9
men 19.8
working 19.4
laboratory 19.3
patient 18.5
lab 18.5
scientist 17.6
happy 17.5
health professional 17.1
uniform 17.1
business 17
portrait 16.8
office 16.4
profession 16.3
smiling 15.9
research 15.2
science 15.1
indoors 14.9
smile 14.3
care 14
assistant 13.6
student 13.6
expertise 13.6
chemistry 13.5
team 13.4
businessman 13.2
study 13.1
women 12.7
exam 12.5
illness 12.4
biology 12.3
looking 12
serious 11.4
attractive 11.2
refrigerator 11.1
confident 10.9
surgeon 10.8
technology 10.4
shop 10.2
20s 10.1
to 9.7
scientific 9.7
chemical 9.7
computer 9.6
standing 9.6
service 9.5
education 9.5
corporate 9.5
white goods 9.4
stethoscope 9.3
focus 9.3
treatment 9.2
instrument 8.9
physician 8.8
experiment 8.8
pharmacy 8.7
equipment 8.7
lifestyle 8.7
30s 8.7
bright 8.6
casual 8.5
two 8.5
manager 8.4
teamwork 8.3
building 8.3
holding 8.3
success 8
microscope 7.9
examining 7.8
black 7.8
consultant 7.8
sample 7.8
examination 7.8
engineer 7.8
check 7.7
test 7.7
talking 7.6
specialist 7.6
meeting 7.5
employee 7.4
successful 7.3
laptop 7.3
home appliance 7.3
group 7.3
color 7.2
school 7.2
face 7.1

Google
created on 2022-01-29

Shirt 93.8
Hat 87.9
Sleeve 87.2
Coat 86.3
Headgear 83.3
Cap 82.5
Vintage clothing 76.7
Baseball cap 75.6
Font 73.5
Monochrome photography 71.8
Collar 71.4
Eyewear 70.9
Monochrome 69
Advertising 63.9
Machine 63.7
Sun hat 63.5
Job 61
History 60.2
Workwear 59.8
Room 57.4

Microsoft
created on 2022-01-29

text 99.7
person 97.7
clothing 95
man 90
hat 87.8
fashion accessory 83.1
black and white 74.3

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 94.1%
Calm 59%
Sad 16.1%
Happy 11.9%
Confused 3.4%
Disgusted 3.4%
Surprised 3.1%
Angry 1.9%
Fear 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Hat 95.4%

Captions

Microsoft

a man standing in front of a store 91.2%
a man standing in front of a store window 85%
a man that is standing in front of a store 84.9%

Text analysis

Amazon

FORCE
KEEPS
WARNING!
U.S.AIR
20
Here
Will Be Here
Will
SERGEANT
Be
Recruiting
RECRUITING SERGEANT
ONE
Service
RECRUITING
KEEPS THEM
1951
TIVE
Man
ENLIST
5
U.S. ARMY
ENLIST NOW!
THEM
12
NOW!
4
&
6
TO
ICE
Y
13
JANUARY
THE
ICE TO R
REGIS
U.S. ARMY & U.S.AIR FORCE
TIVE SERVIC
E
R
SERVIC
TUTTE Recruiting Service
Cared
SAT
10
L
PS
Men
Men and L Asport
wooged
Asport
TUTTE
MIZINOIS
and

Google

RINTO
U12
ENLIST
AIR
Me
U.
HI
decruiting
20
ONITE
G0000
RE
&
REGIS
J
TUe
ONE
13
4
TIVE
TO
NOW!
ARMY
Man
KEEPS
U.S.
456
HO
ONITE RINTO G0000 JANUARY 1951 10 U12 13 20 4 26 27 TIVE SERVIC ICE TO RE ENLIST NOW! U.S. ARMY & U.S. AIR FORCE RECRUITING SERGEANT Will Be Here Me Carcer Man REGIS WARNING! KEEPS THEM U.S. ARMY U. J HI TUe decruiting Service 1951 FRI JAT 456 12 13 HO 20 FE ONE
1951
26
27
SERVIC
FORCE
RECRUITING
Will
WARNING!
THEM
JAT
12
JANUARY
10
ICE
SERGEANT
Be
Here
Carcer
Service
FRI
FE