Human Generated Data

Title

The Brown Sisters, Wellfleet, Massachusetts

Date

2015

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2015.119

Copyright

© Nicholas Nixon, courtesy of the Fraenkel Gallery, San Francisco

Human Generated Data

Title

The Brown Sisters, Wellfleet, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2015

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 99.6
Human 99.6
Person 99.6
Person 99.4
Face 96.9
Head 81.7
People 78
Person 73
Photography 70.4
Portrait 70.4
Photo 70.4
Man 66.6
Hair 65.8
Female 63.7
Clothing 62
Apparel 62
Finger 60.1
Necklace 56.8
Accessories 56.8
Jewelry 56.8
Accessory 56.8
Woman 55.2

Clarifai
created on 2018-02-16

group 99.4
people 99.2
man 98.4
group together 97.8
four 97.3
portrait 97.3
adult 96.3
three 96
woman 92.2
facial expression 89.9
child 88.6
five 84.8
two 83.1
family 82.3
monochrome 81.8
affection 79.5
offspring 79
music 78.9
several 77.8
interaction 77

Imagga
created on 2018-02-16

couple 58.4
senior 50.6
man 46.4
happy 45.8
love 43.4
male 40.1
together 39.4
sibling 38.6
elderly 35.4
people 34.6
mature 34.4
smiling 34
husband 31.8
family 30.3
grandma 29.4
retired 29.1
married 28.8
grandfather 28.4
wife 27.5
portrait 27.2
smile 27.1
old 25.1
person 24.7
adult 24
grandmother 22.5
retirement 22.1
mother 21.9
romance 21.4
kin 21
relationship 20.6
affection 20.3
lifestyle 20.2
marriage 19.9
romantic 19.6
happiness 18.8
women 18.2
men 18
two 17.8
attractive 16.8
father 16.7
parent 16.5
handsome 16.1
home 16
hair 15.9
older 15.5
affectionate 15.5
loving 15.3
60s 14.7
daughter 14.5
gray 14.4
looking 14.4
cheerful 13
face 12.8
aged 12.7
pretty 12.6
friends 12.2
fun 12
casual 11.9
lady 11.4
togetherness 11.3
dad 11.2
eyes 11.2
grandparents 10.9
sixties 10.8
pensioner 10.8
couples 10.8
hug 10.7
child 10.6
age 10.5
enjoying 10.4
laughing 10.4
friendship 10.3
glasses 10.2
healthy 10.1
joy 10
seniors 9.8
indoors 9.7
aging 9.6
pair 9.4
camera 9.2
leisure 9.1
group 8.9
70s 8.9
faces 8.8
dating 8.7
horizontal 8.4
granddaughter 7.9
look 7.9
day 7.8
bonding 7.8
flirting 7.8
middle aged 7.8
generation 7.7
laugh 7.7
health 7.6
adults 7.6
outdoors 7.5
holding 7.4
park 7.4
relaxing 7.3

Google
created on 2018-02-16

Microsoft
created on 2018-02-16

person 98.3
outdoor 95.5
posing 89.9
standing 77.8
people 69.9
group 68.8
crowd 1.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Female, 82.5%
Happy 46.5%
Disgusted 5.2%
Confused 7.8%
Calm 20.5%
Angry 4.1%
Sad 13.5%
Surprised 2.5%

AWS Rekognition

Age 57-77
Gender Male, 57.2%
Confused 13.5%
Sad 23.3%
Disgusted 9.7%
Happy 9%
Surprised 5.5%
Angry 7.6%
Calm 31.4%

AWS Rekognition

Age 45-66
Gender Male, 96.9%
Sad 20.9%
Calm 41.2%
Disgusted 4%
Surprised 2.9%
Angry 5.9%
Happy 10.6%
Confused 14.6%

AWS Rekognition

Age 45-66
Gender Female, 54.3%
Disgusted 6.5%
Confused 9.7%
Surprised 2.5%
Calm 39.9%
Angry 7.7%
Happy 6.2%
Sad 27.5%

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 56
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Necklace 56.8%

Captions

Microsoft

a group of people posing for a photo 99.2%
a group of people posing for the camera 99.1%
a group of people posing for a picture 99%