Human Generated Data

Title

The Brown Sisters, Cataumet, Massachusetts

Date

2007

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, 2007.186

Copyright

© Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Cataumet, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2007

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Person 99.5
Human 99.5
Person 99.5
Person 99.4
Face 99.3
Person 98.4
Apparel 92.6
Clothing 92.6
Head 79.9
Dating 77.4
Portrait 70.8
Photo 70.8
Photography 70.8
Man 70.1
Female 69.8
People 68.8
Hair 64.5
Sleeve 61.1
Text 60.7
Woman 56.5
Beard 56.3

Clarifai
created on 2019-10-30

people 99.6
group 99
man 98.9
portrait 98.9
group together 98.1
monochrome 98.1
three 97.2
four 96.7
adult 96.5
two 92.9
woman 92.8
music 89.4
musician 88
actor 84.6
facial expression 84.4
actress 84
black and white 82.8
love 82.7
singer 82.2
guitarist 81.2

Imagga
created on 2019-10-30

kin 70.9
couple 51.5
man 47.8
happy 46.4
family 46.3
love 42.7
together 42.1
male 41.7
smiling 38.4
mother 36.9
senior 36.6
husband 36
people 35.2
portrait 35
elderly 33.6
mature 32.6
grandma 32.1
daughter 31.7
lifestyle 29.7
wife 29.4
father 29.1
parent 27.7
happiness 27.5
adult 27.2
smile 27.1
grandfather 27
retired 23.3
home 22.4
person 22.3
affection 20.3
old 20.2
togetherness 19.9
relationship 19.7
attractive 19.6
cheerful 19.5
retirement 19.2
married 19.2
child 18.7
two 18.7
grandmother 18.6
dad 18.2
romance 17.9
camera 17.6
hug 17.4
fun 17.2
laughing 17
sibling 16.9
looking 16.8
park 16.5
affectionate 16.5
outdoors 16.4
loving 16.2
casual 16.1
pretty 16.1
handsome 16.1
romantic 16.1
horizontal 15.1
joy 15.1
middle aged 14.6
relaxing 14.6
group 14.5
women 14.3
relaxed 14.1
indoors 14.1
parents 13.7
60s 13.7
boy 13.1
teenager 12.8
sitting 12
men 12
hair 11.9
granddaughter 11.9
hugging 11.7
30s 11.6
aging 11.5
marriage 11.4
friends 11.3
outside 11.1
grandparents 10.9
generations 10.9
cute 10.8
face 10.7
enjoying 10.4
adults 10.4
close 10.3
pensioner 10
grandparent 9.9
70s 9.8
son 9.8
50s 9.8
embracing 9.8
embrace 9.8
two people 9.7
females 9.5
friendship 9.4
clothing 9.2
teen 9.2
girls 9.1
children 9.1
holding 9.1
blond 9
grandchild 8.9
bonding 8.8
mom 8.7
mid adult 8.7
day 8.6
health 8.3
aged 8.2
lady 8.1
gray 8.1
kid 8
couples 7.8
their 7.8
color 7.8
older 7.8
looking camera 7.7
laugh 7.7
buddy 7.7
house 7.5
brother 7.3
modern 7

Google
created on 2019-10-30

People 96.1
Photograph 95.8
Photography 70.6
Fun 70.4
Black-and-white 68.3
Family 58
Smile 54
Portrait 51.6

Microsoft
created on 2019-10-30

human face 99.5
smile 97.1
clothing 94.5
person 94
woman 83.4
man 79.3
standing 78.6
glasses 67.3
people 65.4
portrait 63.2
posing 52.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Female, 94%
Disgusted 3.2%
Confused 15.1%
Fear 3.8%
Happy 2.5%
Sad 4.3%
Angry 15.6%
Surprised 2.5%
Calm 53%

AWS Rekognition

Age 36-54
Gender Female, 95.8%
Calm 8.7%
Surprised 1%
Confused 60%
Angry 4.3%
Fear 0.7%
Disgusted 5.6%
Happy 18.2%
Sad 1.5%

AWS Rekognition

Age 51-69
Gender Male, 56.4%
Disgusted 0.8%
Surprised 0.9%
Happy 1.5%
Confused 2%
Calm 87%
Angry 5.6%
Fear 0.5%
Sad 1.8%

AWS Rekognition

Age 38-56
Gender Female, 58.7%
Angry 0.4%
Disgusted 0.5%
Calm 52.4%
Happy 0.2%
Fear 0.1%
Confused 44.7%
Sad 1.2%
Surprised 0.5%

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 61
Gender Female

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 51
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

Jenni Avins et al. posing for the camera 96.3%
Jenni Avins et al. posing for a photo 94.5%
Jenni Avins et al. posing for a photo 90.3%