Human Generated Data

Title

Untitled (man, possibly father, with baby outside on blanket)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16974

Human Generated Data

Title

Untitled (man, possibly father, with baby outside on blanket)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.9
Clothing 99.9
Dress 99.2
Person 98.7
Human 98.7
Person 98.2
Grass 94.9
Plant 94.9
Face 93.7
Baby 92.5
Female 87
Shorts 79.3
Kid 78.4
Child 78.4
Outdoors 77.7
Nature 76.7
Tree 76
People 75.9
Smile 74.3
Pants 73.5
Portrait 71.3
Photo 71.3
Photography 71.3
Woman 69.7
Yard 65.9
Fashion 65.6
Gown 65.1
Girl 64.9
Robe 61.8
Blossom 59.1
Flower 59.1
Suit 58.4
Overcoat 58.4
Coat 58.4
Man 55.8
Field 55.3
Teen 55.2

Imagga
created on 2022-02-26

kin 73.1
child 46.7
portrait 31.1
people 29
man 28.9
happy 27
outdoors 26.1
happiness 25.1
park 24.7
dad 22.9
love 22.9
parent 21.7
adult 21.4
father 21.1
male 20.6
family 20.5
outdoor 19.9
fun 19.5
joy 19.2
leisure 19.1
smiling 18.8
mother 18.4
couple 18.3
lifestyle 18.1
person 17.3
together 16.7
smile 16.4
childhood 16.1
day 15.7
daughter 15.4
outside 15.4
autumn 14.9
summer 14.8
sibling 14.7
face 14.2
togetherness 14.2
laughing 13.2
boy 13
cheerful 13
women 12.7
little 12.4
human 12
youth 11.9
casual 11.9
playing 11.9
cute 11.5
senior 11.3
pretty 10.5
one 10.5
black 10.2
two 10.2
kid 9.8
relationship 9.4
world 9.3
girls 9.1
attractive 9.1
holding 9.1
vacation 9
active 9
looking 8.8
hair 8.7
grass 8.7
season 8.6
enjoying 8.5
fashion 8.3
clothing 8.3
children 8.2
baby 8.1
romantic 8
grandfather 7.9
bench 7.9
forest 7.8
play 7.8
affectionate 7.7
men 7.7
affection 7.7
sitting 7.7
old 7.7
husband 7.6
relax 7.6
blond 7.6
relaxation 7.5
enjoy 7.5
20s 7.3
son 7.3
dress 7.2
handsome 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

outdoor 97.6
text 96.6
toddler 95
clothing 93.1
baby 91.2
person 88.6
boy 79.2
human face 74.9
sport 69.3
white 68.9
black 66.1
black and white 58.6
old 51.8

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99%
Calm 96.4%
Sad 1.9%
Confused 0.6%
Surprised 0.4%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 1-7
Gender Female, 93.6%
Calm 43.3%
Sad 35.3%
Fear 9.5%
Happy 7.1%
Surprised 2.3%
Angry 1.2%
Disgusted 0.9%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

an old photo of a boy 84%
old photo of a boy 79.3%
a old photo of a boy 79.2%