Human Generated Data

Title

Portrait of Two Men

Date

c. 1804

People

Artist: Claude-Jean-Baptiste Hoin, French 1750 - 1817

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Robert M. Light as a token of appreciation for the outstanding contributions to Harvard and the Fogg Art Museum of Agnes Mongan, 1972.324

Human Generated Data

Title

Portrait of Two Men

People

Artist: Claude-Jean-Baptiste Hoin, French 1750 - 1817

Date

c. 1804

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-04-25

Art 94.6
Human 94.4
Drawing 94.4
Painting 91.1
Person 89.5
Outdoors 89.5
Sketch 86.4
Nature 85.5
Person 83.4
Face 80.2
Ice 71.3
Photography 67.7
Photo 67.7
Snow 67.4
Head 67
Portrait 66.2
Home Decor 58.6

Clarifai
created on 2020-04-25

art 99.7
portrait 99.4
people 98.8
man 98.7
painting 96.8
adult 96.5
leader 96.2
sculpture 96.1
illustration 95.8
ancient 95.5
old 95.3
one 95.2
paper 94.9
woman 93.2
veil 93.1
antique 92
Renaissance 91.5
vintage 91.4
visuals 89.8
facial hair 89.7

Imagga
created on 2020-04-25

sketch 75.1
drawing 54.2
negative 50.2
representation 49.4
film 39.6
portrait 31.7
photographic paper 30.6
old 23.7
face 23.5
senior 20.6
photographic equipment 20.4
man 20.2
statue 19.6
money 19.6
close 19.4
currency 18.9
hair 18.2
male 17.7
person 17.5
cash 17.4
adult 16.8
elderly 16.3
dollar 15.8
one 15.7
grandma 15.5
head 15.1
mature 14.9
eyes 14.6
retirement 14.4
crazy 14.1
gray 13.5
finance 13.5
people 13.4
makeup 12.8
retired 12.6
bill 12.4
banking 12
blond 11.9
bank 11.7
hundred 11.6
us 11.6
paper 11
grandmother 10.8
art 10.8
wealth 10.8
business 10.3
closeup 10.1
happy 10
sculpture 9.7
aging 9.6
ancient 9.5
skin 9.4
pretty 9.1
stylish 9
black 9
human 9
lady 8.9
beard 8.8
looking 8.8
dollars 8.7
pay 8.6
culture 8.6
winter 8.5
attractive 8.4
fashion 8.3
aged 8.2
financial 8
love 7.9
look 7.9
franklin 7.9
banknotes 7.8
queen 7.8
banknote 7.8
loan 7.7
studio 7.6
success 7.2
cute 7.2
romantic 7.1

Google
created on 2020-04-25

Face 96.6
Head 91.4
Portrait 88.4
Drawing 85.5
Art 83.3
Sketch 82.5
Cheek 79.9
Self-portrait 79.2
Painting 77.8
Illustration 68.1
Visual arts 62.5
Paper 59.2
Artwork 58.6
Jaw 57.4
Black-and-white 56.4
Facial hair 55.5
Style 51

Microsoft
created on 2020-04-25

drawing 99.8
sketch 99.7
painting 98.4
art 97.3
text 96.4
human face 94.4
child art 91.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 92.5%
Happy 0.2%
Disgusted 0%
Angry 0.1%
Calm 98.5%
Sad 0.9%
Fear 0%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 45-63
Gender Male, 85%
Fear 0.4%
Disgusted 0.3%
Confused 1.2%
Angry 1.2%
Happy 3.7%
Calm 82.9%
Surprised 6.2%
Sad 4.1%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 91.1%
Person 89.5%

Captions

Microsoft

a close up of a book 35.3%
a close up of a person 35.2%
close up of a book 29.4%