Human Generated Data

Title

Untitled (man with a mustache and hand-colored cheeks, seated, three-quarter view)

Date

c. 1860

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs; Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs; Discretionary Fund for the Photograph Department; Robert M. Sedgwick II Fund, P1997.37.27

Human Generated Data

Title

Untitled (man with a mustache and hand-colored cheeks, seated, three-quarter view)

People

Artist: Unidentified Artist,

Date

c. 1860

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Face 99.3
Human 99.3
Person 97.3
Beard 86.6
Painting 81.7
Art 81.7
Wood 68.1
Floor 65.4
Apparel 64.9
Clothing 64.9
Man 64.3
Photography 58.8
Photo 58.8
Portrait 58.8
Sitting 57.9
Flooring 55.6

Imagga
created on 2022-01-29

book jacket 42.4
jacket 36.8
person 32.1
portrait 27.2
black 26.8
covering 25.3
wrapping 25
man 23.5
adolescent 21.2
male 20.7
adult 20
face 19.9
bow tie 18.8
juvenile 17.1
human 16.5
people 16.2
necktie 15.9
sexy 14.5
model 14
hair 13.5
style 13.4
comedian 12.9
one 12.7
guy 12.7
attractive 12.6
performer 12.2
fashion 12.1
body 12
art 11.8
religion 11.6
posing 11.6
dress 10.8
vintage 10.8
serious 10.5
eye 9.8
old 9.8
decoration 9.7
clothing 9.5
love 9.5
sitting 9.4
lifestyle 9.4
expression 9.4
world 9.2
alone 9.1
hand 9.1
mask 9.1
garment 9.1
sensuality 9.1
pose 9.1
lady 8.9
statue 8.8
mother 8.7
god 8.6
skin 8.5
tattoo 8.4
head 8.4
pretty 8.4
studio 8.4
dark 8.3
hat 7.9
entertainer 7.8
antique 7.8
culture 7.7
suit 7.6
elegance 7.6
emotion 7.4
makeup 7.3
disguise 7.3
cool 7.1
modern 7
look 7

Google
created on 2022-01-29

Sleeve 87.2
Collar 84.1
Facial hair 84
Beard 83.5
Blazer 78.1
Dress shirt 76.9
Tints and shades 76
Vintage clothing 75.3
Moustache 72.4
Formal wear 68.5
Stock photography 64.4
History 63.6
Wrist 63.4
Classic 61.1
Rectangle 60.5
Room 59.7
Tie 58.3
Cuff 58.3
Sitting 57.8
Portrait 55.9

Microsoft
created on 2022-01-29

person 99.9
man 99
human face 98.8
clothing 98.5
outdoor 88.3
old 84.5
text 82.4
posing 78.4
portrait 69.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Male, 99.4%
Calm 80.6%
Confused 8.7%
Sad 3.8%
Disgusted 2.3%
Angry 1.8%
Surprised 1.3%
Fear 0.8%
Happy 0.7%

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Painting 81.7%

Captions

Microsoft

a man posing for a photo 95.1%
a man posing for a photo in front of a building 91.6%
a person posing for the camera 91.5%