Human Generated Data

Title

J. Robert Oppenheimer
Date

c. 1955
People

Artist: A. Aubrey Bodine, American 1906 - 1970
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.406

Human Generated Data

Title

J. Robert Oppenheimer

People

Artist: A. Aubrey Bodine, American 1906 - 1970

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 97.3
Human 97.3
Suit 96.3
Clothing 96.3
Coat 96.3
Overcoat 96.3
Apparel 96.3
Teacher 94.4
Indoors 76.2
Room 75.8
Classroom 75.2
School 75.2
Photography 56
Photo 56

Imagga
created on 2022-01-09

scholar 68.8
person 60.7
intellectual 57.9
newspaper 49.8
man 47.1
male 44
businessman 40.6
product 38.4
laptop 38.3
business 37.7
office 37.1
computer 35.9
adult 32.6
work 31.4
people 30.7
creation 29.8
suit 29.4
sitting 27.5
working 25.6
executive 25.1
looking 24.8
senior 24.4
worker 24.1
corporate 23.2
glasses 22.2
handsome 21.4
portrait 21.4
professional 21.2
elderly 21.1
happy 20.7
old 20.2
technology 20.1
desk 19.8
job 19.5
serious 18.1
mature 17.7
home 17.6
smiling 17.4
table 16.5
indoors 15.8
businesspeople 15.2
smile 15
one 14.9
face 14.9
holding 14
men 13.7
student 13.7
confident 13.7
businesswoman 13.6
notebook 13.4
workplace 13.3
tie 13.3
manager 13
education 13
success 12.9
modern 12.6
retired 12.6
communication 12.6
retirement 12.5
career 12.3
look 12.3
expression 12
casual 11.9
concentration 11.6
black 11.4
chair 11.4
book 11.3
guy 11
employee 10.6
reading 10.5
thinking 10.5
keyboard 10.3
paper 10.2
gray 9.9
seated 9.8
older 9.7
using 9.6
lifestyle 9.4
successful 9.2
happiness 8.6
stress 8.6
contemporary 8.5
attractive 8.4
inside 8.3
human 8.3
occupation 8.3
indoor 8.2
grandfather 8
teacher 8
browsing 7.9
employment 7.7
busy 7.7
read 7.7
hand 7.6
sit 7.6
horizontal 7.5
meeting 7.5
screen 7.5
coffee 7.4
copy space 7.2
hair 7.1
pensioner 7.1
day 7.1

Google
created on 2022-01-09

Font 80.7
Tie 80.1
Blazer 78.2
Eyewear 78.1
Collar 77.7
Suit 76.8
Writing 71.2
White-collar worker 69.7
Formal wear 68.5
Sitting 68.1
Blackboard 66.8
Chalk 66.2
Monochrome photography 65.1
Signature 64.7
Vintage clothing 64.1
Stock photography 64.1
Office instrument 64
Monochrome 63.7
Room 63.4
Reading 61.9

Microsoft
created on 2022-01-09

person 99.9
text 99.8
man 98.3
book 86.7
handwriting 83.4
clothing 79.7
glasses 59.2
old 47

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Male, 99.8%
Confused 55.7%
Calm 23.7%
Surprised 8.6%
Sad 7.2%
Angry 2%
Disgusted 1.7%
Fear 0.7%
Happy 0.4%

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Suit 96.3%

Captions

Microsoft

J. Robert Oppenheimer wearing a suit and tie sitting in a chair 94.6%
J. Robert Oppenheimer wearing a suit and tie sitting down 94.5%
J. Robert Oppenheimer sitting on a table 81.1%

Text analysis

Amazon

e
UNIVERSIT
CALIFORN
Radiation
TAIS
X
e X - )
Labore
Indial
Aubrey
d. Aubrey Indial
d.
ONCY
ON
8
- )

Google

4. Aulre, Todal CAL Radion
4.
Aulre,
Todal
CAL
Radion