Human Generated Data

Title

Untitled (Dr. Herman M. Juergens talking with patient in exam room)

Date

1965-1968

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.486.5

Human Generated Data

Title

Untitled (Dr. Herman M. Juergens talking with patient in exam room)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1965-1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-08-09

Human 99.3
Person 99.3
Person 99.3
Head 87.9
Finger 69.7
Leisure Activities 66
Jaw 59.1
Musician 58
Musical Instrument 58
Accessory 57.7
Glasses 57.7
Accessories 57.7
Outdoors 57.7
Face 56.5

Clarifai
created on 2019-08-09

people 99.8
portrait 99.3
man 98.9
adult 98.8
monochrome 97.1
one 96.6
leader 96.4
profile 94.2
facial expression 93.4
two 89.4
side view 86.4
black and white 86
wear 85.6
face 84.9
lid 82.5
administration 82.2
actor 79.3
bald 78.9
old 76.5
person 75.1

Imagga
created on 2019-08-09

man 45
senior 37.5
person 34.1
male 34.1
people 30.7
portrait 29.1
surgeon 25.6
old 24.4
elderly 22
face 21.3
groom 20.7
adult 20.1
happy 20.1
mature 18.6
retired 18.4
lifestyle 16.6
grandfather 16.1
looking 16
smiling 15.9
retirement 15.4
love 15
smile 15
negative 14.7
men 14.6
hand 14.4
hat 14.4
black 13.8
handsome 13.4
couple 13.1
work 12.6
married 12.5
expression 11.9
head 11.8
worker 11.7
film 11.6
serious 11.4
look 11.4
wife 11.4
glasses 11.1
hair 11.1
aged 10.9
eye 10.7
husband 10.5
professional 10.3
beard 10.2
pensioner 10.2
guy 10.1
gray 9.9
human 9.8
businessman 9.7
marriage 9.5
casual 9.3
one 9
outdoors 9
photographic paper 8.9
medical 8.8
nurse 8.8
mustache 8.7
ruler 8.7
blond 8.4
pretty 8.4
suit 8.3
holding 8.3
bow tie 8.2
closeup 8.1
patient 8
romance 8
business 7.9
together 7.9
maturity 7.9
clothing 7.9
happiness 7.8
thoughtful 7.8
lab 7.8
eyes 7.8
affection 7.7
laboratory 7.7
humor 7.7
bride 7.7
age 7.6
confident 7.3

Google
created on 2019-08-09

Microsoft
created on 2019-08-09

human face 98.1
person 95
text 92
black and white 88.6
clothing 77.9
man 75.9
glasses 70.4
portrait 52.5

Face analysis

Amazon

AWS Rekognition

Age 46-64
Gender Male, 88.5%
Angry 3.3%
Calm 20.6%
Sad 17.7%
Confused 3.4%
Disgusted 1.8%
Happy 20%
Fear 30.4%
Surprised 2.9%

AWS Rekognition

Age 9-19
Gender Female, 69.2%
Confused 0.1%
Calm 92%
Fear 0%
Disgusted 0%
Angry 0.1%
Surprised 0.1%
Sad 7.2%
Happy 0.4%

Feature analysis

Amazon

Person 99.3%
Glasses 57.7%

Captions

Microsoft

an old photo of a man 76.8%
a black and white photo of a man 69.5%