Human Generated Data

Title

The Robinson Children of Newport, Rhode Island

Date

c. 1835

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Burton and Jacqueline Cumming in memory of Professor Paul J. Sachs, 1968.81

Human Generated Data

Title

The Robinson Children of Newport, Rhode Island

People

Artist: Unidentified Artist,

Date

c. 1835

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Burton and Jacqueline Cumming in memory of Professor Paul J. Sachs, 1968.81

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 98.6
Painting 96.9
Human 94.7
Person 94.7
Person 91.4
Person 90.3
Musical Instrument 61.2
Guitar 61.2
Leisure Activities 61.2

Clarifai
created on 2018-03-16

people 99.8
child 99.5
painting 98.8
baby 98.6
son 96.6
art 96
two 95.7
one 95.6
group 94.9
adult 94.9
religion 93.8
portrait 93.5
woman 92.7
wear 92.6
veil 88.9
three 86.1
family 83.5
offspring 83.5
Christmas 83.2
lid 80.6

Imagga
created on 2018-03-16

child 29.8
man 29.5
male 27.7
people 27.3
family 26.7
maraca 25.8
percussion instrument 24.9
happy 24.4
musical instrument 24.2
person 22
mother 21.7
adult 19.9
couple 19.1
smiling 18.8
together 18.4
home 18.3
portrait 17.5
love 17.3
lifestyle 17.3
fun 17.2
parent 16.7
face 16.3
boy 15.6
children 15.5
two 14.4
father 13.8
smile 13.5
happiness 13.3
kid 13.3
old 13.2
senior 13.1
sitting 12.9
playing 12.8
cute 12.2
cheerful 12.2
attractive 11.9
childhood 11.6
handsome 11.6
chair 11.4
loving 11.4
brother 11.2
leisure 10.8
daughter 10.6
indoors 10.5
throne 10.5
looking 10.4
son 10.3
casual 10.2
holding 9.9
grandmother 9.8
little 9.7
elderly 9.6
husband 9.5
costume 9.5
women 9.5
play 9.5
men 9.4
kids 9.4
care 9
interior 8.8
blond 8.7
grandma 8.7
holiday 8.6
expression 8.5
youth 8.5
friends 8.4
black 8.4
chair of state 8.4
pretty 8.4
fashion 8.3
entertainment 8.3
lady 8.1
group 8.1
to 8
colorful 7.9
seat 7.9
clothing 7.8
excited 7.8
party 7.7
toddler 7.6
hand 7.6
wife 7.6
enjoying 7.6
sit 7.6
joy 7.5
human 7.5
life 7.5
mature 7.4
park 7.4
indoor 7.3
active 7.2
celebration 7.2
religion 7.2
activity 7.2

Google
created on 2018-03-16

painting 91.1
art 83.9
portrait 71.3
modern art 66.7
artwork 64.2

Microsoft
created on 2018-03-16

person 95.7
indoor 91.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-5
Gender Male, 84.9%
Sad 2.4%
Confused 2.7%
Happy 0.8%
Disgusted 1.5%
Angry 82%
Surprised 0.8%
Calm 9.6%

AWS Rekognition

Age 4-7
Gender Female, 89.8%
Surprised 2.6%
Angry 46.2%
Sad 6.6%
Calm 32.8%
Disgusted 4.1%
Confused 4.4%
Happy 3.3%

AWS Rekognition

Age 4-9
Gender Female, 69.8%
Confused 4.7%
Sad 5.7%
Calm 46.3%
Happy 0.3%
Surprised 1.3%
Angry 40.8%
Disgusted 0.9%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 96.9%
Person 94.7%
Guitar 61.2%

Categories