Human Generated Data

Title

Bernard Berenson (1865-1959)

Date

c. 1903

People

Artist: Sarah Choate Sears, American 1858 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Montgomery S. Bradley and Cameron Bradley, P1984.58

Human Generated Data

Title

Bernard Berenson (1865-1959)

People

Artist: Sarah Choate Sears, American 1858 - 1935

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-10-07

Interior Design 99
Indoors 99
Person 97.8
Human 97.8
Suit 91.7
Clothing 91.7
Coat 91.7
Overcoat 91.7
Apparel 91.7
Leisure Activities 82.3
Face 77.1
Musician 70.7
Musical Instrument 70.7
Crowd 68.1
Finger 63.8
Art 61
Painting 61
Performer 59.9
Man 57.1
Pianist 55.3
Piano 55.3

Imagga
created on 2021-10-07

man 46.5
male 39.8
person 37.7
people 27.9
portrait 27.2
adult 25.4
black 24.7
face 24.2
suit 22.2
dark 20.9
expression 19.6
businessman 18.5
human 17.3
hand 16.7
business 15.8
one 14.9
men 14.6
scholar 14.3
couple 13.9
studio 13.7
handsome 13.4
eyes 12.9
device 12.7
eye 12.5
silhouette 12.4
intellectual 12.4
world 12.2
senior 12.2
hands 12.2
hair 11.9
old 11.8
tie 11.4
office 11.2
love 11.1
lifestyle 10.8
attractive 10.5
serious 10.5
looking 10.4
manager 10.2
head 10.1
look 9.6
musical instrument 9.6
close 9.1
executive 8.9
success 8.9
boy 8.7
corporate 8.6
bow tie 8.4
shirt 8.4
pretty 8.4
alone 8.2
confident 8.2
romance 8
mustache 8
body 8
necktie 7.9
work 7.9
model 7.8
elegant 7.7
spectator 7.6
nose 7.6
fashion 7.5
passion 7.5
happy 7.5
glasses 7.4
makeup 7.3
professional 7.3
grandfather 7.3
shadow 7.2
call 7.2
smile 7.1
posing 7.1
night 7.1
working 7.1
mask 7.1

Google
created on 2021-10-07

Microsoft
created on 2021-10-07

person 99.5
human face 98.7
man 97.3
clothing 89.9
indoor 88.1
portrait 87.7
painting 76.2
black and white 55.3

Face analysis

Amazon

Google

AWS Rekognition

Age 32-48
Gender Male, 95.3%
Angry 78.4%
Calm 19.2%
Sad 0.9%
Happy 0.5%
Confused 0.5%
Disgusted 0.2%
Fear 0.2%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Painting 61%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 66.4%
a man standing in front of a mirror 66.3%
a man wearing a suit and tie 66.2%