Human Generated Data

Title

The Brown Sisters, Boston
Date

2012
People

Artist: Nicholas Nixon, American born 1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2013.4
Copyright

© Nicholas Nixon, courtesy of Fraenkel Gallery, San Francisco, and Pace/McGill Gallery, New York

Human Generated Data

Title

The Brown Sisters, Boston

People

Artist: Nicholas Nixon, American born 1947

Date

2012

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2013.4

Copyright

© Nicholas Nixon, courtesy of Fraenkel Gallery, San Francisco, and Pace/McGill Gallery, New York

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.6
Person 99.6
Hug 99.3
Person 98.4
Person 97.4
Face 94.7
People 84.5
Finger 79.1
Person 78.6
Female 70.9
Photography 69.1
Photo 69.1
Portrait 64.9
Apparel 61.4
Clothing 61.4
Man 59.6
Woman 58.9

Clarifai
created on 2018-02-10

group 99.3
people 99
group together 98.5
man 98.2
four 96.6
adult 96.3
portrait 95.2
three 91.1
facial expression 91
five 89.8
several 89.7
music 89.4
leader 87.5
interaction 84.3
administration 83.7
musician 82.5
woman 81.8
actress 77.6
singer 75.9
actor 73.3

Imagga
created on 2018-02-10

together 50.8
man 50.4
happy 49.5
couple 48.8
love 45.8
family 44.5
smiling 44.1
male 43.6
senior 40.3
people 39.6
mother 38.8
grandfather 36.6
adult 32.5
portrait 32.4
daughter 31.8
father 31.4
lifestyle 30.4
kin 30
sitting 27.5
husband 26.5
outdoors 26.1
child 25.2
smile 24.9
happiness 24.3
wife 22.8
affection 22.2
laughing 21.7
affectionate 21.3
person 21.3
loving 21
park 20.6
grandmother 20.6
mature 20.5
camera 20.3
group 20.2
togetherness 19.8
parent 19.6
60s 19.5
cheerful 19.5
sibling 19
retired 18.4
hug 18.4
home 18.3
son 17.9
relationship 17.8
grandparents 17.8
children 17.3
elderly 17.2
dad 16.9
sixties 16.7
casual 16.1
hugging 15.6
relaxing 15.5
two 15.2
romantic 15.1
fun 15
boy 14.8
countryside 14.6
married 14.4
horizontal 14.2
brother 14.1
mom 13.6
generation 13.4
joy 13.4
pretty 13.3
enjoying 13.3
old 13.2
40s 12.7
romance 12.5
retirement 12.5
friends 12.2
attractive 11.9
mum 11.8
parents 11.7
middle aged 11.7
handsome 11.6
looking 11.2
women 11.1
grass 11.1
20s 11
cute 10.8
embrace 10.7
two people 10.7
summer 10.3
outside 10.3
grandma 10
granddaughter 9.9
forties 9.8
guy 9.8
embracing 9.8
flirting 9.7
thirties 9.7
looking camera 9.6
30s 9.6
men 9.4
relaxed 9.4
friendship 9.4
world 9.3
face 9.2
buddy 9.2
garden 9.2
teenager 9.1
half length 8.8
darling 8.5
three 8.4
leisure 8.3
teen 8.3
lady 8.1
5 year old 7.9
indoors 7.9
having fun 7.9
50s 7.8
couples 7.8
their 7.8
sister 7.8
boyfriend 7.7
sofa 7.7
outdoor 7.6
age 7.6
marriage 7.6
holding 7.4

Google
created on 2018-02-10

people 97
photograph 95.7
black 95
person 94.1
facial expression 94
social group 91.6
black and white 88.3
smile 86.1
emotion 85.6
photography 84.6
senior citizen 83.3
friendship 79.7
monochrome photography 78.3
standing 77.8
family 77.7
fun 73.6
girl 68.9
human 68.7
monochrome 66.5
human behavior 62.7

Microsoft
created on 2018-02-10

person 99.5
outdoor 97.3
people 75
posing 67.4
group 64.6
crowd 0.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Female, 70%
Surprised 0.8%
Angry 1.9%
Happy 1.6%
Sad 6.5%
Disgusted 1.4%
Confused 1.4%
Calm 86.5%

AWS Rekognition

Age 57-77
Gender Female, 86.6%
Happy 10.3%
Calm 14.2%
Confused 24%
Sad 4.9%
Surprised 9.9%
Angry 10.1%
Disgusted 26.6%

AWS Rekognition

Age 35-52
Gender Male, 88.9%
Sad 9%
Surprised 2.2%
Disgusted 4.6%
Angry 1.9%
Calm 11.3%
Happy 64.5%
Confused 6.5%

AWS Rekognition

Age 35-52
Gender Female, 67.3%
Calm 76.7%
Surprised 2.5%
Sad 7.9%
Angry 2%
Disgusted 1.3%
Confused 5.2%
Happy 4.4%

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

people portraits 99.9%
events parties 0.1%