Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

Date

2009

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2009.134

Copyright

© Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2009

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-04

Human 99.7
Person 99.7
Person 99.4
Person 98.9
Apparel 89.8
Clothing 89.8
People 83.7
Face 72
Finger 68.9
Man 64.4
Suit 61.2
Coat 61.2
Overcoat 61.2
Skin 59.6
Shirt 57.9
Dating 55.8
Female 55.5

Clarifai
created on 2018-03-23

people 99.5
man 99.3
group 99.2
group together 98.6
four 98
three 97.6
portrait 97.4
monochrome 97.1
adult 96.4
woman 92.9
two 92
facial expression 90.2
five 89.7
actor 82.8
several 82.4
interaction 81.1
love 78.3
actress 77.7
music 77.6
leader 77

Imagga
created on 2018-03-23

man 51.1
couple 49.7
senior 46.9
male 46.2
grandfather 41.2
happy 40.8
people 38.5
elderly 38.3
grandma 38.1
love 34.8
mature 32.6
person 30.6
family 29.4
husband 29
smiling 29
portrait 27.2
together 27.2
smile 27.1
old 25.8
adult 24.7
retired 24.3
wife 22.8
men 21.5
married 21.1
marriage 20.9
grandmother 18.6
retirement 18.3
lifestyle 18.1
romantic 17.8
women 17.4
affection 17.4
handsome 17
father 16.9
home 16.8
romance 15.2
relationship 15
group 14.5
businessman 14.1
happiness 14.1
mother 14.1
lady 13.8
older 13.6
aged 13.6
executive 13.5
team 13.5
cheerful 13
affectionate 12.6
entrepreneur 12.2
pretty 11.9
attractive 11.9
joy 11.7
daughter 11.7
business 11.6
secretary 11.3
office 11.3
fun 11.2
professional 11.2
corporate 11.2
teamwork 11.1
hair 11.1
two 11
grandparents 10.9
gray 10.8
success 10.5
togetherness 10.4
baron 10.4
sitting 10.3
suit 10.3
face 10
parent 9.8
partners 9.7
partnership 9.6
looking 9.6
loving 9.6
pair 9.5
businesswoman 9.1
health 9
seniors 8.8
pensioner 8.8
60s 8.8
indoors 8.8
diversity 8.7
age 8.6
director 8.6
dad 8.6
kin 8.4
horizontal 8.4
outdoors 8.2
life 8.1
maturity 7.9
70s 7.9
businessmen 7.8
expression 7.7
aging 7.7
casual 7.6
adults 7.6
spectator 7.3
child 7.2
activity 7.2

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.9
man 97.2
standing 82.1
posing 79.8
crowd 0.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 60.1%
Sad 42.7%
Happy 4.2%
Calm 38.7%
Surprised 1.9%
Disgusted 7.7%
Confused 2.3%
Angry 2.5%

AWS Rekognition

Age 48-68
Gender Male, 57.9%
Calm 67.1%
Angry 3.5%
Confused 7.5%
Sad 10.7%
Disgusted 3.9%
Surprised 1.8%
Happy 5.5%

AWS Rekognition

Age 45-63
Gender Male, 91.4%
Calm 3.9%
Angry 1.8%
Disgusted 3%
Happy 75.3%
Sad 7.4%
Surprised 1.5%
Confused 7.1%

AWS Rekognition

Age 38-57
Gender Male, 58.8%
Angry 3.1%
Disgusted 5.7%
Happy 3.8%
Confused 33.7%
Sad 10.1%
Calm 41.5%
Surprised 2.1%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Suit 61.2%

Captions

Microsoft

a group of people posing for a photo 96.2%
a group of people posing for the camera 96.1%
a couple of people posing for a photo 93.9%