Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

Date

2011

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2011.498

Copyright

© Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2011

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2011.498

Copyright

© Nicholas Nixon

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.7
Human 99.7
Person 99.6
Face 99.4
Person 99.3
Head 87.4
People 83.1
Man 80
Apparel 79.5
Clothing 79.5
Portrait 78.8
Photography 78.8
Photo 78.8
Skin 70.6
Female 69.9
Hair 68
Sitting 63.1
Woman 55.8

Clarifai
created on 2018-03-23

people 99.6
group 98.2
adult 97.5
man 97.4
portrait 96.8
woman 94.1
group together 92.5
facial expression 92.5
three 92.3
two 90.9
four 88.2
elderly 85.8
actress 84.3
leader 83.3
music 82.4
administration 80.9
musician 75.5
actor 74.5
monochrome 72.5
wear 71.5

Imagga
created on 2018-03-23

couple 53.1
man 48.4
grandma 46.8
happy 42.6
male 40.6
senior 38.4
love 37.9
people 36.3
mother 33.7
smiling 33.3
together 32.4
family 30.2
husband 28
mature 27.9
elderly 26.8
adult 25.9
smile 25.7
portrait 25.2
person 24.8
men 23.2
wife 22.8
grandfather 22.7
retired 22.3
married 22.1
women 19.8
grandmother 19.6
attractive 18.9
old 18.8
romance 18.8
handsome 18.7
affection 18.4
parent 18.3
happiness 18
daughter 18
retirement 17.3
sibling 16.8
two 16.1
marriage 15.2
relationship 15
lifestyle 14.5
kin 14.1
pretty 14
father 13.6
hair 13.5
romantic 13.4
group 12.9
fun 12.7
affectionate 12.6
friends 12.2
lady 12.2
looking 12
home 12
darling 11.4
cheerful 11.4
togetherness 11.3
60s 10.7
business 10.3
park 9.9
businessman 9.7
outdoors 9.7
indoors 9.7
office 9.6
child 9.6
30s 9.6
loving 9.5
blond 9.3
camera 9.2
face 9.2
grandparents 8.9
seniors 8.8
world 8.8
couples 8.8
partners 8.7
aging 8.6
eyes 8.6
professional 8.6
adults 8.5
laughing 8.5
casual 8.5
friendship 8.4
teen 8.3
suit 8.2
teenager 8.2
gray 8.1
success 8
maturity 7.9
70s 7.9
hug 7.7
corporate 7.7
sitting 7.7
executive 7.7
outside 7.7
expression 7.7
age 7.6
joy 7.5
cute 7.2

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

posing 95.5
person 94.7
standing 86.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Female, 84.1%
Sad 8.6%
Calm 22.4%
Surprised 6.9%
Angry 7%
Disgusted 10.5%
Happy 31%
Confused 13.5%

AWS Rekognition

Age 35-52
Gender Female, 60%
Angry 36.5%
Confused 2.7%
Disgusted 3.5%
Surprised 0.4%
Sad 3%
Calm 53.4%
Happy 0.5%

AWS Rekognition

Age 38-57
Gender Male, 59.6%
Calm 39.6%
Disgusted 11.4%
Sad 30.5%
Angry 4.3%
Confused 6.2%
Surprised 2.6%
Happy 5.3%

AWS Rekognition

Age 38-59
Gender Male, 90.1%
Disgusted 2.8%
Surprised 1.8%
Happy 23.8%
Confused 4.9%
Calm 26.8%
Sad 36.1%
Angry 3.8%

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 66
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

people portraits 99.7%
paintings art 0.2%