Human Generated Data

Title

Man Playing a Flute to Five Children

Date

18th century

People

Artist: P. de Saint-Maurice, French 17th-18th centuries

Artist after: Le Nain Family, French active 17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R4348

Human Generated Data

Title

Man Playing a Flute to Five Children

People

Artist: P. de Saint-Maurice, French 17th-18th centuries

Artist after: Le Nain Family, French active 17th century

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R4348

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Human 99.6
Person 99.6
Person 99.1
Person 99.1
Person 99
Person 98.9
Art 96.7
Painting 96.1
Person 73.3

Clarifai
created on 2019-11-09

people 100
group 99.9
art 99.1
child 98.8
adult 98.3
son 98.2
wear 97.9
woman 97.3
print 97.1
man 95.9
offspring 95.5
three 95.5
four 95.3
several 94.1
furniture 93.3
portrait 93.2
painting 92.9
five 92.7
affection 92.6
family 92.3

Imagga
created on 2019-11-09

daily 51.4
sculpture 35.9
statue 35.5
newspaper 23.9
money 23.8
ancient 22.5
dollar 22.3
art 22.2
old 21.6
religion 21.5
history 21.5
currency 20.6
cash 20.1
antique 19
product 18.7
religious 17.8
creation 17.2
architecture 17.2
bank 17
stone 17
monument 16.8
dollars 16.4
bill 15.2
finance 15.2
savings 14.9
vintage 14.9
historic 14.7
culture 14.5
one 14.2
banking 13.8
us 13.5
wealth 13.5
business 13.4
financial 13.4
historical 13.2
close 12.6
paper 12.5
god 12.4
marble 11.8
catholic 11.7
hundred 11.6
holy 11.6
loan 11.5
symbol 11.4
travel 11.3
famous 11.2
kin 11.1
franklin 10.8
city 10.8
temple 10.8
figure 10.7
carving 10.7
saint 10.6
spirituality 10.6
building 10.3
rich 10.2
tourism 9.9
memorial 9.9
detail 9.7
exchange 9.5
closeup 9.4
man 9.4
church 9.3
face 9.2
decoration 9
museum 8.8
angel 8.8
drawing 8.7
spiritual 8.6
faith 8.6
capital 8.5
sketch 8.4
person 8.4
people 8.4
investment 8.2
roman 8
male 7.8
representation 7.8
bills 7.8
portrait 7.8
pray 7.8
book jacket 7.7
pay 7.7
sign 7.5
economy 7.4
aged 7.2

Google
created on 2019-11-09

Microsoft
created on 2019-11-09

text 99.9
drawing 97.3
wall 96.6
sketch 96.4
clothing 93.6
old 93
painting 90.7
posing 87.1
person 85.7
black 74.6
white 71.1
group 57.8
man 57.3
vintage 38.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 54.9%
Calm 54.5%
Sad 45.1%
Surprised 45.1%
Disgusted 45%
Happy 45.1%
Angry 45%
Confused 45%
Fear 45%

AWS Rekognition

Age 32-48
Gender Male, 74.8%
Surprised 14.8%
Happy 1.4%
Fear 2.9%
Confused 13.1%
Sad 6.5%
Calm 32.2%
Disgusted 20.4%
Angry 8.9%

AWS Rekognition

Age 30-46
Gender Male, 99.4%
Surprised 0.1%
Calm 21.6%
Angry 2.5%
Disgusted 0.1%
Happy 0.1%
Sad 74.9%
Fear 0.1%
Confused 0.6%

AWS Rekognition

Age 31-47
Gender Female, 96.3%
Surprised 2.4%
Angry 3.4%
Calm 82.3%
Sad 8.6%
Confused 0.8%
Disgusted 1.3%
Happy 0.4%
Fear 0.8%

AWS Rekognition

Age 14-26
Gender Female, 99.4%
Fear 0.1%
Disgusted 0.3%
Confused 0.2%
Angry 0.3%
Sad 1%
Calm 96.1%
Happy 1.6%
Surprised 0.3%

AWS Rekognition

Age 19-31
Gender Female, 51.9%
Confused 0.1%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.5%
Surprised 0.3%
Calm 97.3%
Sad 1.4%

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 96.1%

Categories

Text analysis

Amazon

Etixeis
ot
avtapres
Etixeis ot avtapres ed witt wlver ingentln
ingentln
witt
culvebat
SMaurite culvebat
SMaurite
wlver
ed

Google

SMaurtce sculpebat te lain pineit Εντυχίς ά αυταρκεις
SMaurtce
sculpebat
te
lain
pineit
Εντυχίς
ά
αυταρκεις