Human Generated Data

Title

Young Boy in Elegant Dress

Date

18th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Melvin R. Seiden, Paul J. Sachs Memorial and Louise Haskell Daly Funds, 1985.84

Human Generated Data

Title

Young Boy in Elegant Dress

People

Artist: Unidentified Artist,

Date

18th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 99.4
Person 99.4
Painting 98.1
Art 98.1

Clarifai
created on 2020-04-24

portrait 99.9
people 99.8
one 99.7
adult 99.4
art 98.6
painting 98.2
engraving 96.7
man 96.3
print 96.2
illustration 95
leader 93.5
sit 89.8
woman 89.5
administration 87.7
facial hair 87.5
scientist 86.2
science 85.3
two 84.8
side view 84.3
profile 82.7

Imagga
created on 2020-04-24

phonograph record 84.1
man 24.2
portrait 23.9
black 23.5
adult 23.3
person 23.2
male 20.6
dark 20
model 17.9
expression 16.2
attractive 16.1
face 15.6
one 14.2
people 13.9
sexy 12.8
posing 12.4
jacket 12.3
eyes 12
head 11.7
lady 11.4
fashion 11.3
human 11.2
hair 11.1
book jacket 10.9
currency 10.8
grunge 10.2
money 10.2
pose 10
pretty 9.8
business 9.7
art 9.6
body 9.6
serious 9.5
sensuality 9.1
fitness 9
sad 8.7
suit 8.1
handsome 8
light 8
night 8
look 7.9
darkness 7.8
wall 7.7
skin 7.6
bill 7.6
hand 7.6
dollar 7.4
close 7.4
style 7.4
emotion 7.4
cash 7.3
makeup 7.3
exercise 7.3
office 7.2
dress 7.2
religion 7.2

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 99.9
sketch 98.2
drawing 98
monitor 97.5
painting 93.8
human face 93.8
old 93.2
person 92.2
clothing 86.5
black 84.3
portrait 82.8
window 81.1
photograph 70.4
screen 69.2
vintage 64.5
posing 63.5
white 61.6
victorian 61.6
image 37.2
picture frame 16.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 90.6%
Fear 0.5%
Happy 1%
Angry 0.9%
Confused 1%
Surprised 0.5%
Calm 87.1%
Disgusted 2.8%
Sad 6.4%

Microsoft Cognitive Services

Age 11
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 98.1%

Captions

Microsoft

a vintage photo of a person 88.8%
a vintage photo of a person 84.7%
a black and white photo of a person 82.1%