Human Generated Data

Title

Edith and Ruth, Danville, Virginia

Date

1966

People

Artist: Emmet Gowin, American born 1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.275

Copyright

© Emmet Gowin

Human Generated Data

Title

Edith and Ruth, Danville, Virginia

People

Artist: Emmet Gowin, American born 1941

Date

1966

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Human 99.9
Person 99.9
Face 99.9
Person 99.8
Clothing 96.3
Apparel 96.3
Head 92.7
Photography 88
Portrait 88
Photo 88
Female 85.1
Coat 79.6
Tree 79.5
Plant 79.5
Smile 78.9
Jaw 75.2
Outdoors 71.4
Man 70.3
Overcoat 66.7
Woman 64.5
Sleeve 64.3
Selfie 62.9
Girl 61.3
People 56.3
Teen 56.1

Imagga
created on 2022-05-28

kin 48.7
love 44.3
happy 43.3
portrait 42.1
people 41.9
couple 41.9
man 40.7
family 40.1
together 39.5
male 39.2
smile 38.5
smiling 37
happiness 34.5
mother 32.9
parent 32.8
outdoors 30.7
person 29.5
lifestyle 28.2
adult 27.8
park 26.4
two 26.3
outside 25.7
father 25.1
daughter 24.9
child 24.2
dad 22.6
relationship 21.6
cheerful 21.2
joy 20.9
fun 19.5
boy 19.2
husband 19
mature 18.6
attractive 18.2
loving 17.2
togetherness 17
outdoor 16.8
sibling 16.8
embracing 16.6
kid 16
camera 15.7
summer 15.5
son 15.3
casual 15.3
looking 15.2
romance 15.2
wife 15.2
handsome 15.2
laughing 15.1
women 15
grass 15
pretty 14.7
senior 14.1
cute 13.7
affection 13.5
face 13.5
romantic 13.4
friends 13.2
friendship 13.1
brother 13.1
embrace 12.7
hugging 12.7
boyfriend 12.6
girlfriend 12.5
children 11.9
world 11.7
middle aged 11.7
childhood 11.7
hug 11.6
affectionate 11.6
group 11.3
hair 11.1
garden 10.9
retired 10.7
youth 10.2
confident 10
suit 9.9
mom 9.7
elderly 9.6
sitting 9.5
buddy 9.4
day 9.4
expression 9.4
countryside 9.1
grandmother 8.8
two people 8.8
looking camera 8.7
30s 8.7
men 8.6
friend 8.6
close 8.6
groom 8.5
horizontal 8.4
old 8.4
teen 8.3
friendly 8.2
relaxing 8.2
grandfather 8
blond 8
bonding 7.8
40s 7.8
partners 7.8
diversity 7.7
married 7.7
laugh 7.7
pair 7.6
smart 7.5
lying 7.5
leisure 7.5
natural 7.4
darling 7.2
meadow 7.2
team 7.2
pensioner 7.1
businessman 7.1

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

outdoor 100
sky 99.9
tree 99.8
human face 99.3
person 98.6
clothing 95.1
portrait 87.4
black and white 86.9
boy 83.2
white 68.1
smile 52.5
posing 49.9
crowd 0.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Female, 100%
Calm 90.2%
Surprised 6.5%
Fear 6%
Sad 3.7%
Confused 3%
Angry 1.8%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Female, 98.2%
Calm 94.4%
Surprised 6.9%
Fear 6%
Sad 2.7%
Confused 1.2%
Angry 0.6%
Happy 0.5%
Disgusted 0.3%

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people posing for a photo 96.1%
a man and woman posing for a photo 92.3%
a man and a woman posing for a photo 92.2%