Human Generated Data

Title

Untitled (portrait of a man)
Date

1890s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2903

Human Generated Data

Title

Untitled (portrait of a man)

People

Artist: Unidentified Artist,

Date

1890s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 97.6
Person 97.6
Art 79.2
Painting 76.2
Advertisement 67.1
Poster 64.7
Apparel 62.8
Clothing 62.8
Face 59.5
Text 58.3

Imagga
created on 2022-01-08

black 55.8
person 37
portrait 35
adult 31.7
face 26.3
man 26.2
model 25.7
people 25.7
dark 25.1
fashion 24.1
attractive 23.1
male 22.3
sexy 20.9
expression 19.6
human 18.8
hair 18.2
style 17.1
eyes 16.4
pretty 15.4
posing 15.1
clothing 15.1
performer 14.8
lady 14.6
make 14.5
one 14.2
looking 13.6
body 13.6
garment 13.4
comedian 13.4
covering 12.7
lifestyle 12.3
wall 12
sensuality 11.8
dress 11.8
coat 11.5
world 11.5
hand 11.4
brunette 11.3
youth 11.1
darkness 10.8
evil 10.7
studio 10.6
look 10.5
serious 10.5
lips 10.2
alone 10
pose 10
handsome 9.8
horror 9.7
suit 9.6
fur coat 9.6
cute 9.3
mask 9.3
makeup 9.3
emotion 9.2
modern 9.1
cool 8.9
guy 8.8
desire 8.7
mystery 8.6
elegant 8.6
clothes 8.4
elegance 8.4
smoke 8.4
entertainer 8.3
jacket 8.2
sensual 8.2
shadow 8.1
eye 8
night 8
smile 7.8
fear 7.7
seductive 7.7
scarf 7.6
hot 7.5
passion 7.5
stylish 7.2
fitness 7.2
art 7.2
costume 7.1

Google
created on 2022-01-08

Hairstyle 95.1
Sleeve 87.2
Coat 86.8
Collar 83.9
Rectangle 79.7
Blazer 78
Tints and shades 76.8
Art 74.6
Vintage clothing 73.6
Facial hair 73.2
Suit 70.3
Formal wear 69.4
Moustache 64.9
Stock photography 63.8
Beard 63
History 62.2
Visual arts 59.3
Room 58.9
Portrait 58.6
Self-portrait 56.7

Microsoft
created on 2022-01-08

human face 98.5
text 97.7
painting 96.1
drawing 95.5
man 91.7
monitor 90.7
clothing 86.8
person 86
sketch 85.9
portrait 78.3
black 73
old 67.6
white 63.3
computer 35
display 27.2
picture frame 14.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 75.9%
Sad 11.3%
Surprised 5.9%
Confused 2.5%
Fear 2%
Angry 1.3%
Disgusted 0.6%
Happy 0.5%

Microsoft Cognitive Services

Age 43
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Painting 76.2%

Captions

Microsoft

a person standing in front of a laptop 58.7%
an old photo of a person 58.6%
a person sitting in front of a laptop 46.6%