Human Generated Data

Title

Grand Duchess Marie
Date

17th century
People

Artist: Jacques Callot, French 1592 - 1635

Artist after: Matteo Rosselli, Italian 1578 - 1650
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, by exchange, S3.90.2

Human Generated Data

Title

Grand Duchess Marie

People

Artist: Jacques Callot, French 1592 - 1635

Artist after: Matteo Rosselli, Italian 1578 - 1650

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, by exchange, S3.90.2

Machine Generated Data

Tags

Amazon
created on 2019-04-02

Human 98.3
Person 98.3
Person 98.2
Person 98.2
Person 97.6
Person 96.3
Person 93.2
Art 91.8
Painting 87.9
Person 84.8
Person 81.4
Person 77.5
Person 77.2
Drawing 70.7
Person 66.3
Sketch 59.1

Clarifai
created on 2018-04-18

people 100
group 99.9
print 99.9
engraving 99.8
art 99.6
many 99.6
adult 99
man 98.9
illustration 98.8
leader 98.5
administration 97.4
several 94.2
royalty 92.1
gown (clothing) 90.6
woman 90.6
monarch 89.3
veil 88.6
lithograph 88.3
etching 87
wear 86.6

Imagga
created on 2018-04-18

sketch 100
drawing 81.4
representation 69.8
map 32.4
paper 28.2
old 24.4
money 23
texture 22.9
currency 22.5
finance 21.1
antique 20.9
design 20.8
vintage 20.7
pattern 20.5
grunge 18.7
dollar 18.6
bank 17
art 16.7
retro 16.4
wealth 16.2
atlas 16.1
business 15.8
cash 15.6
dollars 15.5
wallpaper 14.6
us 14.5
close 13.7
financial 13.4
backdrop 13.2
ancient 13
stucco 12.4
capital 12.3
number 12.1
banking 12
geography 11.6
bill 11.4
plan 11.4
frame 10.8
world 10.6
travel 10.6
backgrounds 10.6
grungy 10.4
decoration 10.2
dirty 10
road 9.9
history 9.8
sign 9.8
hundred 9.7
lace 9.7
navigation 9.6
black 9.6
loan 9.6
graphic 9.5
page 9.3
economy 9.3
house 9.2
decorative 9.2
style 8.9
wages 8.8
textured 8.8
sepia 8.7
banknote 8.7
pay 8.6
snow 8.6
savings 8.4
globe 8.3
investment 8.3
border 8.1
structure 7.9
architecture 7.8
discovery 7.8
continent 7.8
states 7.7
construction 7.7
wall 7.7
direction 7.6
planet 7.5
journey 7.5
city 7.5
element 7.4
brown 7.4
note 7.4
earth 7.3
success 7.2
detail 7.2
aged 7.2
color 7.2
painting 7.2
building 7.1

Google
created on 2018-04-18

history 79.1
black and white 78.1
sketch 71.8
drawing 70.8
art 70.7
artwork 68.1
figure drawing 63.2
middle ages 57.8
visual arts 55.1
monochrome 53.9

Microsoft
created on 2018-04-18

text 98.3
book 90.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 53.9%
Disgusted 45.4%
Happy 45.8%
Confused 45.5%
Angry 46.2%
Calm 46.2%
Surprised 45.8%
Sad 50%

AWS Rekognition

Age 12-22
Gender Female, 53.4%
Surprised 45.3%
Angry 45.3%
Sad 51.8%
Confused 45.4%
Happy 45.1%
Calm 46.9%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 45.4%
Angry 46.2%
Confused 46.2%
Sad 47.5%
Disgusted 46.5%
Surprised 45.5%
Calm 47.6%

AWS Rekognition

Age 20-38
Gender Female, 54.6%
Confused 45.2%
Surprised 45.1%
Calm 45.7%
Sad 53.3%
Angry 45.5%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Male, 50.9%
Disgusted 45.4%
Calm 51.8%
Happy 45.1%
Sad 46%
Angry 45.7%
Confused 45.5%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Male, 51.2%
Sad 46.3%
Disgusted 45.3%
Surprised 47%
Confused 45.8%
Calm 49%
Angry 46.5%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Happy 45.5%
Sad 49.7%
Disgusted 45.3%
Calm 47.9%
Angry 45.5%
Confused 45.5%
Surprised 45.6%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Disgusted 45.3%
Happy 45.2%
Angry 45.7%
Calm 46.8%
Surprised 48.9%
Sad 47.4%
Confused 45.7%

AWS Rekognition

Age 20-38
Gender Male, 53.4%
Sad 46.4%
Confused 45.5%
Disgusted 45.2%
Happy 45.1%
Angry 45.7%
Surprised 45.2%
Calm 51.9%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Disgusted 46.3%
Sad 45.3%
Calm 49.4%
Happy 46.9%
Angry 45.7%
Surprised 45.8%
Confused 45.5%

AWS Rekognition

Age 35-52
Gender Male, 78.2%
Confused 5.2%
Disgusted 3.8%
Happy 3.3%
Sad 70.1%
Angry 6.8%
Calm 6.7%
Surprised 4.2%

AWS Rekognition

Age 27-44
Gender Female, 53.2%
Surprised 45.2%
Angry 45.4%
Disgusted 45.1%
Confused 45.6%
Happy 45.2%
Calm 45.8%
Sad 52.6%

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Disgusted 45.7%
Surprised 45.7%
Sad 48.7%
Happy 45.2%
Calm 47.9%
Confused 45.9%
Angry 45.9%

AWS Rekognition

Age 35-52
Gender Female, 61.1%
Disgusted 1%
Calm 55%
Sad 29.4%
Angry 4.7%
Surprised 3.4%
Confused 4.3%
Happy 2.2%

AWS Rekognition

Age 10-15
Gender Male, 53.2%
Angry 45.8%
Disgusted 47.1%
Sad 48.4%
Confused 45.7%
Calm 47.1%
Happy 45.4%
Surprised 45.6%

AWS Rekognition

Age 30-47
Gender Male, 54.5%
Surprised 46%
Disgusted 45.3%
Sad 46.5%
Confused 46.4%
Angry 46.3%
Happy 45.7%
Calm 48.8%

AWS Rekognition

Age 29-45
Gender Female, 54.3%
Calm 53.2%
Angry 45.3%
Disgusted 45.2%
Surprised 45.6%
Confused 45.3%
Sad 45.4%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Female, 52.8%
Angry 45.8%
Surprised 45.9%
Disgusted 45.2%
Happy 47.4%
Calm 47.4%
Sad 47.8%
Confused 45.5%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 81
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Painting 87.9%

Categories

Imagga

paintings art 88.6%
text visuals 8.8%
nature landscape 2.4%
streetview architecture 0.1%
food drinks 0.1%

Captions

Microsoft
created on 2018-04-18

a close up of a book 29%
close up of a book 24.1%
a hand holding a book 24%

Text analysis

Amazon

Fha