Human Generated Data

Title

The Brown Sisters, Marblehead, Massachusetts

Date

2002

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kate, Maurice R. and Melvin R. Seiden Purchase Fund for Photographs, P2003.6

Copyright

© 2003 Nicholas Nixon

Human Generated Data

Title

The Brown Sisters, Marblehead, Massachusetts

People

Artist: Nicholas Nixon, American born 1947

Date

2002

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-27

Clothing 99.8
Apparel 99.8
Person 99.7
Human 99.7
Person 99.7
Face 99.6
Person 99.1
Smile 98.1
Person 97.4
Female 97.3
Dress 91.8
Woman 89.9
Shorts 88.7
People 87.1
Plant 86.6
Tree 86.6
Man 86.5
Portrait 78.7
Photography 78.7
Photo 78.7
Laughing 73.4
Pants 73.1
Girl 72.6
Outdoors 69.7
Shirt 69.4
Military Uniform 65.8
Military 65.8
Soldier 65.8
Skin 61.2
Overcoat 60
Suit 60
Coat 60
Hug 59.5
Sleeve 59
Hair 56.9
Teen 56.6
Crowd 56.1
Glasses 55.7
Accessories 55.7
Accessory 55.7
Dating 55.1

Imagga
created on 2022-05-27

kin 100
mother 55.7
happy 52.7
together 52.6
family 49.9
smiling 48.5
male 45.3
man 43.1
father 41.7
people 41.3
daughter 38.1
portrait 35.6
child 35.6
love 34.8
couple 34
parent 33.4
adult 31.1
park 30.5
outdoors 29.9
happiness 29.8
children 28.3
boy 27.8
lifestyle 27.5
senior 26.3
group 25.8
smile 25.7
dad 25.7
women 24.5
togetherness 23.6
son 23.2
home 23.1
camera 23.1
friends 21.6
sitting 21.5
outside 20.6
cheerful 19.5
mature 18.6
sibling 18.5
mom 18.4
joy 18.4
relaxing 18.2
loving 18.1
laughing 18
person 17.8
two 17.8
grandmother 17.6
affectionate 17.4
countryside 17.4
grandfather 17.2
fun 17.2
wife 17.1
horizontal 16.8
husband 16.4
casual 16.1
middle aged 15.6
hug 15.5
30s 15.4
outdoor 15.3
enjoying 15.2
parents 14.7
sister 14.7
affection 14.5
generation 14.4
brother 14.1
60s 13.7
thirties 13.6
grass 13.5
elderly 13.4
relationship 13.1
friendship 13.1
cute 12.9
summer 12.9
attractive 12.6
garden 12.6
looking camera 12.5
men 12
girls 11.9
mum 11.8
hugging 11.7
relaxed 11.3
three 11.2
youth 11.1
teen 11
forties 10.8
sixties 10.8
40s 10.7
married 10.6
indoors 10.6
healthy 10.1
teenager 10
playing 10
leisure 10
grandparents 9.9
granddaughter 9.9
embracing 9.8
old 9.8
two people 9.7
romance 8.9
grandma 8.9
5 year old 8.9
four people 8.9
their 8.8
retirement 8.7
walk 8.6
kids 8.5
pretty 8.4
kid 8
grandchild 7.9
to camera 7.9
three quarter length 7.9
50s 7.8
standing 7.8
embrace 7.8
walking 7.6
holding 7.4
handsome 7.1
face 7.1
to 7.1
day 7.1

Google
created on 2022-05-27

Microsoft
created on 2022-05-27

person 99.9
posing 99.3
smile 99.1
human face 98.5
standing 97.8
clothing 96.8
outdoor 95
woman 90.7
white 75.1
group 67.4
black and white 59.6
crowd 0.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Female, 99.8%
Calm 53.2%
Happy 32.3%
Surprised 7.2%
Fear 6.2%
Confused 3.9%
Angry 3.6%
Sad 3%
Disgusted 1.8%

AWS Rekognition

Age 41-49
Gender Female, 99.9%
Happy 66.4%
Calm 17.2%
Confused 6.7%
Surprised 6.5%
Fear 6.1%
Disgusted 4.5%
Sad 2.8%
Angry 2.2%

AWS Rekognition

Age 47-53
Gender Female, 99.7%
Calm 96.8%
Surprised 6.4%
Fear 6%
Sad 2.2%
Confused 0.9%
Angry 0.7%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 42-50
Gender Female, 99%
Calm 71.1%
Confused 16%
Happy 6.7%
Surprised 6.7%
Fear 6.1%
Sad 2.5%
Disgusted 1.9%
Angry 1.8%

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 52
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 45
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 98.7%
a group of people posing for the camera 98.6%
a group of people posing for a picture 98.5%

Text analysis

Amazon

ONLS
THE
FLA
BMW

Google

Of