Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

Date

2016

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2016.214

Copyright

© Nicholas Nixon, courtesy of the Fraenkel Gallery, San Francisco

Human Generated Data

Title

The Brown Sisters, Truro, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2016

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 99.6
Human 99.6
Person 99.6
Person 99.6
Person 99.2
Face 97.6
Head 94.4
Finger 91.7
Photography 73.3
Photo 73.3
Portrait 73.3
Skin 59.9
Hair 58.2

Clarifai
created on 2018-02-19

people 99.8
portrait 99.1
group 98.9
man 98.5
three 97.8
adult 97.4
group together 96.7
four 95.9
facial expression 95.3
two 93.1
woman 88.9
monochrome 88.1
five 86.6
music 86.2
musician 82.4
actress 77.4
several 77.2
administration 76.2
actor 75.4
movie 75

Imagga
created on 2018-02-19

couple 54.9
man 49.7
male 43.4
together 42.1
happy 40.1
love 39.5
senior 37.5
people 34.6
smiling 33.3
family 32
husband 28.9
grandfather 28.7
portrait 28.5
wife 27.5
mother 27
adult 24
married 24
smile 23.5
elderly 22
mature 21.4
happiness 21.2
sibling 20.1
kin 19.9
romance 19.6
grandmother 19.6
buddy 18.7
retirement 18.2
lifestyle 17.3
person 17.1
double 17
two 16.9
handsome 16.9
father 16.9
affection 16.4
loving 16.2
attractive 16.1
affectionate 15.5
men 15.5
old 15.3
marriage 15.2
romantic 15.1
brother 15
parent 15
retired 14.5
home 14.4
women 14.2
daughter 14.1
pretty 14
lady 13.8
grandma 13.7
hair 13.5
group 12.9
60s 12.7
cheerful 12.2
looking 12
fun 12
child 12
hug 11.6
togetherness 11.3
relationship 11.2
casual 11
grandparents 10.9
sixties 10.8
face 10.7
boy 10.4
expression 10.2
dad 10.2
indoors 9.7
enjoying 9.5
sitting 9.5
camera 9.2
teenager 9.1
holding 9.1
gray 9
two people 8.7
boyfriend 8.7
girlfriend 8.7
eyes 8.6
friends 8.5
blond 8.2
success 8
look 7.9
70s 7.9
seniors 7.9
pensioner 7.8
their 7.8
black 7.8
hugging 7.8
dating 7.8
30s 7.7
age 7.6
life 7.6
teen 7.4
sexy 7.2

Google
created on 2018-02-19

Microsoft
created on 2018-02-19

person 94
people 70.9
posing 41.4
crowd 1.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Female, 59.7%
Calm 49.1%
Surprised 1.3%
Disgusted 2.4%
Angry 31.9%
Sad 9.8%
Confused 2.9%
Happy 2.7%

AWS Rekognition

Age 38-59
Gender Female, 83.8%
Surprised 0.9%
Sad 39.6%
Disgusted 2.1%
Calm 41.7%
Happy 1.1%
Angry 4.2%
Confused 10.5%

AWS Rekognition

Age 35-55
Gender Female, 98.2%
Happy 47.9%
Angry 1.6%
Disgusted 1.4%
Sad 11.1%
Surprised 0.7%
Confused 2.3%
Calm 35%

AWS Rekognition

Age 57-77
Gender Female, 88.4%
Surprised 7.8%
Disgusted 5.5%
Confused 11.4%
Happy 37.8%
Calm 27%
Sad 5.3%
Angry 5.2%

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 56
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 76
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for the camera 95.8%
a group of people posing for a photo 93.5%
a couple of people posing for the camera 93.3%