Human Generated Data

Title

Two Men

Date

c. 1845-1855

People

Artist: Moses B. Russell, American 1810 - 1884

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Ernest G. Stillman, Class of 1907, by exchange, 2007.101

Human Generated Data

Title

Two Men

People

Artist: Moses B. Russell, American 1810 - 1884

Date

c. 1845-1855

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Ernest G. Stillman, Class of 1907, by exchange, 2007.101

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Person 99.1
Human 99.1
Person 98.9
Art 82.6
Apparel 81.1
Clothing 81.1
Sitting 76
Painting 63.9
Wood 60.8
Overcoat 57.1
Coat 57.1
Accessory 55.3
Tie 55.3
Accessories 55.3

Clarifai
created on 2018-03-23

people 99.2
adult 98.3
man 97.2
portrait 97.2
two 97.1
group 95.7
wear 93.1
woman 92.9
three 89.5
room 86.7
retro 86.4
one 86.2
sit 85.5
indoors 85.3
outfit 81.1
musician 78.8
furniture 77.3
outerwear 76
business 75.1
four 73

Imagga
created on 2018-03-23

bow tie 54.8
man 45.7
necktie 45
male 42.4
happy 35.1
people 34.6
father 34
family 32
couple 29.6
adult 27.8
smiling 27.5
child 27.4
boy 26.9
dad 26.9
love 26
happiness 25.8
son 24.5
garment 24.4
sitting 24
portrait 23.9
together 22.8
person 22.4
mother 21.8
smile 21.4
suit 21.1
men 19.7
brother 19.6
lifestyle 19.5
home 19.1
fun 18.7
businessman 18.5
clothing 18
cheerful 17.9
handsome 17.8
holding 16.5
sibling 16.5
casual 16.1
two 16.1
attractive 16.1
kid 15.9
couch 15.5
parent 15.3
business 14.6
group 14.5
children 12.8
women 12.6
joy 12.5
wife 12.3
looking 12
professional 11.9
playing 11.9
married 11.5
indoors 11.4
face 11.4
kids 11.3
pretty 11.2
indoor 10.9
grandfather 10.8
husband 10.8
mom 10.7
sofa 10.5
outdoors 10.4
expression 10.2
cute 10
childhood 9.8
parents 9.8
30s 9.6
life 9.6
sit 9.5
togetherness 9.4
guy 9.4
senior 9.4
relationship 9.4
executive 9.3
companion 9
daughter 8.6
corporate 8.6
youth 8.5
room 8.4
old 8.4
house 8.4
dress 8.1
lady 8.1
office 8
holiday 7.9
standing 7.8
kin 7.7
partner 7.7
four 7.7
loving 7.6
enjoying 7.6
fashion 7.5
human 7.5
leisure 7.5
three 7.4
20s 7.3
game 7.1
interior 7.1
little 7.1

Google
created on 2018-03-23

photograph 95
gentleman 66.6
family 65.9
portrait 64.3
vintage clothing 59.2
painting 51.7
art 50.1

Microsoft
created on 2018-03-23

person 89.1
old 52.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 97.7%
Sad 3%
Calm 84%
Happy 0.7%
Confused 5.8%
Disgusted 1%
Angry 2.8%
Surprised 2.7%

AWS Rekognition

Age 35-52
Gender Male, 99.9%
Disgusted 0.9%
Happy 0.5%
Angry 7.3%
Sad 5.3%
Surprised 3.6%
Confused 19.2%
Calm 63.1%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%