Human Generated Data

Title

The Brown Sisters, Wellfleet, Massachusetts

Date

2014

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2014.512

Copyright

© Nicholas Nixon, courtesy of the Fraenkel Gallery, San Francisco

Human Generated Data

Title

The Brown Sisters, Wellfleet, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2014

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.7
Human 99.7
Person 99.7
Person 99.6
Skin 99
Face 98.4
Person 92.9
Finger 83
People 82
Apparel 78.7
Clothing 78.7
Sleeve 78.7
Female 77.4
Portrait 65.4
Photography 65.4
Photo 65.4
Woman 60.3
Hair 55.8
Smile 55.4

Clarifai
created on 2018-02-09

people 99.7
group 99.4
group together 99.2
four 98.7
portrait 98.7
monochrome 98.2
man 97.9
three 97.2
woman 95.7
adult 95.5
five 95.1
actress 94.8
facial expression 93.6
several 88.6
music 87.6
actor 86.6
black and white 83.8
child 82.9
musician 80.5
singer 78.8

Imagga
created on 2018-02-09

kin 100
mother 50.3
family 49.8
happy 47.6
together 46.5
daughter 41.8
man 41
male 38.6
smiling 38.4
couple 37.5
love 37.1
father 36.2
people 35.7
sibling 31.1
portrait 29.1
child 28.8
senior 27.2
happiness 26.6
smile 26.4
parent 26
adult 25.9
boy 22.6
lifestyle 22.4
home 22.3
husband 21.2
grandmother 20.6
group 20.2
women 19.8
sitting 19.8
friends 19.7
relationship 19.7
park 18.9
fun 18.7
mature 18.6
grandfather 18.6
wife 18
two 17.8
brother 17.4
affection 17.4
girls 17.3
dad 17
son 17
children 16.4
married 16.3
attractive 16.1
togetherness 16.1
outdoors 14.9
men 14.6
teenager 14.6
affectionate 14.5
elderly 14.4
person 14.1
loving 13.4
pretty 13.3
laughing 13.2
friendship 13.1
cheerful 13
teen 12.9
parents 12.7
joy 12.5
30s 12.5
indoors 12.3
camera 12
grandma 11.9
thirties 11.7
generation 11.5
marriage 11.4
blond 10.9
granddaughter 10.9
mom 10.7
hug 10.7
laugh 10.5
old 10.5
enjoying 10.4
horizontal 10.1
romance 9.8
sister 9.8
kid 9.8
40s 9.7
middle aged 9.7
retired 9.7
boyfriend 9.6
casual 9.3
leisure 9.1
playing 9.1
grandchild 8.9
generations 8.9
mum 8.8
four 8.6
cute 8.6
adults 8.5
youth 8.5
handsome 8
looking 8
hair 7.9
grandparents 7.9
grandparent 7.9
families 7.9
forties 7.8
brunette 7.8
their 7.8
60s 7.8
black 7.8
having 7.8
eyes 7.7
outside 7.7
girlfriend 7.7
looking camera 7.7
retirement 7.7
expression 7.7
garden 7.5
three 7.4
holding 7.4
relaxing 7.3
childhood 7.2

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 99.7
posing 91.7
outdoor 89.4
standing 88.6
people 63.9
group 55.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 90.7%
Calm 50.1%
Sad 8.6%
Surprised 3.1%
Disgusted 3.7%
Happy 17.9%
Angry 4.9%
Confused 11.8%

AWS Rekognition

Age 57-77
Gender Female, 99.3%
Sad 4.3%
Surprised 1.6%
Disgusted 0.8%
Confused 5.5%
Calm 65.1%
Happy 19.1%
Angry 3.6%

AWS Rekognition

Age 45-65
Gender Female, 99%
Angry 6.8%
Confused 5.1%
Surprised 0.9%
Calm 34.8%
Disgusted 2.7%
Sad 47.8%
Happy 1.9%

AWS Rekognition

Age 48-68
Gender Female, 74.4%
Sad 17.5%
Calm 35%
Confused 14.2%
Disgusted 16.5%
Surprised 3.4%
Happy 6.2%
Angry 7.1%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 65
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 98.2%
a group of people posing for the camera 98.1%
a group of people posing for a picture 98%