Human Generated Data

Title

The Gamesters, after Matthew William Peters
Date

c. 1840
People

Artist: Benjamin Franklin Eddy, American 1804 -after 1880

Artist after: Matthew William Peters, British 1742 - 1814
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Harvard University Portrait Collection, Gift of Franklin H. Hooper, Class of 1883, 1935, 1976.5

Human Generated Data

Title

The Gamesters, after Matthew William Peters

People

Artist: Benjamin Franklin Eddy, American 1804 -after 1880

Artist after: Matthew William Peters, British 1742 - 1814

Date

c. 1840

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.1
Person 99.1
Person 98.3
Apparel 97.2
Hat 97.2
Clothing 97.2
Game 80.5
Painting 76.8
Art 76.8
Gambling 74.3

Clarifai
created on 2018-03-16

people 99.3
child 98.1
adult 97.4
group 96.7
three 96.3
four 95.5
two 94.9
portrait 94.9
man 94.6
boy 94.5
recreation 93.6
lid 92.9
woman 92.7
game 91.7
son 90.5
book series 90.3
education 89.6
wear 89.5
offspring 89
five 88.8

Imagga
created on 2018-03-16

male 38.4
man 37.6
people 35.1
couple 32.2
chip 30.4
happy 29.5
adult 29.3
family 28.5
sitting 28.3
smiling 27.5
person 27.1
laptop 24.6
together 24.5
men 24
computer 23.3
table 22.1
home 21.5
fun 21
indoors 20.2
looking 19.2
counter 19
disk jockey 18.4
happiness 18
game 17.8
leisure 17.4
playing 17.3
grandfather 16.7
women 16.6
casual 16.1
senior 15.9
lifestyle 15.9
love 15.8
couch 15.5
father 15.4
child 15.4
two 15.2
game equipment 15.2
friends 15
black 15
broadcaster 14.7
cheerful 14.6
casino 13.7
face 13.5
30s 13.5
mother 13.4
husband 13.4
player 13.3
wife 13.3
communicator 13
chips 12.7
gamble 12.7
attractive 12.6
business 12.1
evening 12.1
group 12.1
play 12.1
room 12
entertainment 12
betting 11.8
working 11.5
smile 11.4
old 11.1
bet 10.8
gambling 10.7
office 10.6
married 10.5
boy 10.4
technology 10.4
equipment 10.1
indoor 10
poker 9.8
handsome 9.8
couples 9.8
portrait 9.7
success 9.7
winner 9.6
laugh 9.6
risk 9.6
elderly 9.6
sofa 9.6
daughter 9.5
togetherness 9.4
parent 9.3
horizontal 9.2
hand 9.1
gambler 8.9
kid 8.9
retired 8.7
retirement 8.6
living 8.5
professional 8.5
desk 8.5
mature 8.4
dark 8.3
suit 8.2
businesswoman 8.2
interior 8
son 7.9
teacher 7.8
lucky 7.8
color 7.8
winning 7.8
excitement 7.8
victory 7.7
pretty 7.7
four 7.7
adults 7.6
20s 7.3
lady 7.3
children 7.3
world 7.2
planner 7.2
cute 7.2
activity 7.2
childhood 7.2
to 7.1
businessman 7.1

Google
created on 2018-03-16

human behavior 78.6
fun 61.7
family 61.2
girl 52.3

Microsoft
created on 2018-03-16

person 99.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-18
Gender Female, 91.1%
Sad 17.1%
Confused 3.1%
Happy 2.4%
Disgusted 1.2%
Angry 3.4%
Surprised 0.8%
Calm 71.9%

AWS Rekognition

Age 35-52
Gender Male, 99.8%
Surprised 0.4%
Happy 0.1%
Angry 0.9%
Sad 2.1%
Calm 94.7%
Confused 1.6%
Disgusted 0.2%

AWS Rekognition

Age 20-38
Gender Female, 57%
Happy 0.3%
Confused 0.2%
Angry 0.4%
Disgusted 0.4%
Sad 0.5%
Calm 97.6%
Surprised 0.6%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 97.2%
Painting 76.8%

Captions

Microsoft

a group of people sitting around each other 88.6%
a group of people sitting at a table 83.2%
a group of people sitting in chairs 83.1%