Human Generated Data

Title

The Brown Sisters, Cataumet, Massachusetts

Date

2004

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, 2006.75

Copyright

© Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Cataumet, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2004

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.9
Person 99.9
Person 99.5
Person 99.5
Person 99.4
Hair 98.1
Skin 91.6
Face 89.8
Finger 71.1
Clothing 68.3
Apparel 68.3
People 63.1
Haircut 58.7
Female 56.7
Undershirt 56.3

Imagga
created on 2022-01-28

couple 41.9
together 39.5
adult 37.6
people 34.1
happy 33.9
attractive 33.6
person 32.5
sexy 31.4
portrait 31.1
man 31.1
love 30
male 29.8
friends 25.4
fashion 24.9
pretty 23.8
boyfriend 23.2
smiling 22.4
star 21.9
smile 20.7
girlfriend 20.2
actor 20.2
face 19.9
relationship 19.7
performer 19.5
fun 19.5
sensual 19.1
happiness 18.8
women 18.2
lifestyle 18.1
two 17.8
black 17.6
kin 17.6
group 16.9
brunette 16.6
romance 16.1
joy 15.9
dark 15.9
lady 15.4
hair 15.1
youth 14.5
romantic 14.3
model 14
married 13.4
handsome 13.4
spectator 13.3
cheerful 13
party 12.9
looking 12.8
girls 12.8
night 12.4
passion 12.2
friendship 12.2
three 12.1
entertainer 12
sibling 11.9
casual 11.9
double 11.8
dress 11.8
suit 11.7
lovers 11.6
family 11.6
posing 11.6
cute 11.5
studio 11.4
togetherness 11.3
groom 11.2
men 11.2
skin 11.2
expression 11.1
joyful 11
teenager 10.9
sensuality 10.9
make 10.9
flirt 10.7
loving 10.5
body 10.4
style 10.4
lips 10.2
mother 10.1
nightclub 9.8
lovely 9.8
lover 9.8
hug 9.7
affectionate 9.7
sexual 9.6
room 9.6
fashionable 9.5
laughing 9.5
elegant 9.4
husband 9.3
entertainment 9.2
indoor 9.1
outdoors 9
hugging 8.8
boy 8.7
affection 8.7
diversity 8.7
eyes 8.6
club 8.5
leisure 8.3
blond 8.3
makeup 8.2
buddy 8.2
look 7.9
vogue 7.8
underwear 7.7
dancing 7.7
laugh 7.7
date 7.7
wife 7.6
erotic 7.6
drink 7.5
glasses 7.4
emotion 7.4
brown 7.4
guy 7.3
gorgeous 7.3
home 7.2
lingerie 7.1
indoors 7

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

person 99.5
smile 98.2
human face 97.7
posing 97.6
standing 94.8
clothing 94.7
woman 91.5
outdoor 86
people 80.6
black and white 75.3
text 66.2
dress 57
crowd 2.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Confused 99.5%
Calm 0.3%
Disgusted 0.1%
Angry 0%
Happy 0%
Sad 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Female, 99.9%
Confused 41.3%
Calm 15.6%
Disgusted 14.5%
Happy 12%
Sad 5.9%
Angry 4.5%
Fear 3.3%
Surprised 2.8%

AWS Rekognition

Age 38-46
Gender Male, 95.6%
Confused 64.1%
Calm 23%
Sad 4.1%
Angry 2.5%
Happy 2.4%
Disgusted 2.2%
Surprised 0.9%
Fear 0.7%

AWS Rekognition

Age 54-62
Gender Female, 99.6%
Confused 98%
Sad 0.8%
Calm 0.4%
Disgusted 0.2%
Angry 0.2%
Surprised 0.2%
Fear 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 64
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people posing for a photo 97.8%
a group of people posing for the camera 97.7%
a woman standing in front of a group of people posing for a photo 94%