Human Generated Data

Title

J. Robert Oppenheimer

Date

c. 1955

People

Artist: A. Aubrey Bodine, American 1906 - 1970

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.406

Human Generated Data

Title

J. Robert Oppenheimer

People

Artist: A. Aubrey Bodine, American 1906 - 1970

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 97.3
Person 97.3
Clothing 96.3
Coat 96.3
Apparel 96.3
Overcoat 96.3
Suit 96.3
Teacher 94.4
Indoors 76.2
Room 75.8
Classroom 75.2
School 75.2
Photo 56
Photography 56

Imagga
created on 2022-01-09

scholar 68.8
person 60.7
intellectual 57.9
newspaper 49.8
man 47.1
male 44
businessman 40.6
product 38.4
laptop 38.3
business 37.7
office 37.1
computer 35.9
adult 32.6
work 31.4
people 30.7
creation 29.8
suit 29.4
sitting 27.5
working 25.6
executive 25.1
looking 24.8
senior 24.4
worker 24.1
corporate 23.2
glasses 22.2
handsome 21.4
portrait 21.4
professional 21.2
elderly 21.1
happy 20.7
old 20.2
technology 20.1
desk 19.8
job 19.5
serious 18.1
mature 17.7
home 17.6
smiling 17.4
table 16.5
indoors 15.8
businesspeople 15.2
smile 15
one 14.9
face 14.9
holding 14
men 13.7
student 13.7
confident 13.7
businesswoman 13.6
notebook 13.4
workplace 13.3
tie 13.3
manager 13
education 13
success 12.9
modern 12.6
retired 12.6
communication 12.6
retirement 12.5
career 12.3
look 12.3
expression 12
casual 11.9
concentration 11.6
black 11.4
chair 11.4
book 11.3
guy 11
employee 10.6
reading 10.5
thinking 10.5
keyboard 10.3
paper 10.2
gray 9.9
seated 9.8
older 9.7
using 9.6
lifestyle 9.4
successful 9.2
happiness 8.6
stress 8.6
contemporary 8.5
attractive 8.4
inside 8.3
human 8.3
occupation 8.3
indoor 8.2
grandfather 8
teacher 8
browsing 7.9
employment 7.7
busy 7.7
read 7.7
hand 7.6
sit 7.6
horizontal 7.5
meeting 7.5
screen 7.5
coffee 7.4
copy space 7.2
hair 7.1
pensioner 7.1
day 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.9
text 99.8
man 98.3
book 86.7
handwriting 83.4
clothing 79.7
glasses 59.2
old 47

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Male, 99.8%
Confused 55.7%
Calm 23.7%
Surprised 8.6%
Sad 7.2%
Angry 2%
Disgusted 1.7%
Fear 0.7%
Happy 0.4%

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Suit 96.3%

Captions

Microsoft

J. Robert Oppenheimer wearing a suit and tie sitting in a chair 94.6%
J. Robert Oppenheimer wearing a suit and tie sitting down 94.5%
J. Robert Oppenheimer sitting on a table 81.1%

Text analysis

Amazon

e
UNIVERSIT
CALIFORN
Radiation
TAIS
X
e X - )
Labore
Indial
Aubrey
d. Aubrey Indial
d.
ONCY
ON
8
- )

Google

4.
Todal
CAL
Radion
Aulre,
4. Aulre, Todal CAL Radion