Human Generated Data

Title

Untitled (woman and two children on lawn in front of house)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16824

Human Generated Data

Title

Untitled (woman and two children on lawn in front of house)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Yard 99.6
Outdoors 99.6
Nature 99.6
Boy 99.5
Human 99.5
Person 99.5
Person 99.5
Grass 99.4
Plant 99.4
Play 98.7
Clothing 98.6
Shorts 98.6
Apparel 98.6
Face 98.5
Furniture 97.7
Chair 97.7
Smile 96.6
Vegetation 94.7
Tree 90.3
Kid 89.7
Child 89.7
Baby 76.7
Portrait 74.8
Photography 74.8
Photo 74.8
People 69.2
Park 68.5
Lawn 68.5
Housing 63.2
Building 63.2
Meal 63
Food 63
Female 62.5
Sitting 59.6
Backyard 59.3
Girl 56.3

Imagga
created on 2022-02-26

kin 49.9
sibling 36.1
child 28.2
parent 27.7
people 26.8
mother 23.8
adult 23.3
beach 21.9
man 21.5
outdoors 20.9
summer 19.9
outdoor 19.9
love 19.7
dad 19.1
portrait 18.8
youth 17
lifestyle 16.6
father 16.6
fun 16.5
pretty 16.1
male 15.8
happy 15.7
joy 15
couple 14.8
body 14.4
hair 14.3
women 14.2
grass 14.2
family 14.2
sand 13.4
black 13.2
together 13.1
attractive 12.6
tricycle 12.6
brother 12.5
model 12.4
person 12.4
face 12.1
sexy 12.1
outside 12
two 11.9
playing 11.9
happiness 11.8
field 11.7
smiling 11.6
children 10.9
active 10.8
park 10.7
vacation 10.6
fashion 10.6
boy 10.4
health 10.4
sport 10.4
play 10.3
wheeled vehicle 10.3
sea 10.2
relax 10.1
relaxation 10
sunset 9.9
childhood 9.9
kid 9.8
sun 9.7
free 9.4
hand 9.1
lady 8.9
athlete 8.9
healthy 8.8
smile 8.6
lips 8.3
leisure 8.3
sky 8.3
girls 8.2
water 8
little 8
cute 7.9
day 7.9
sunny 7.8
skin 7.6
one 7.5
holding 7.4
rest 7.4
natural 7.4
countryside 7.3
vehicle 7.3
romance 7.1
farm 7.1

Google
created on 2022-02-26

Smile 96.8
Vertebrate 92.2
Shorts 90.7
Black 89.6
Mammal 86.1
Black-and-white 84.6
Style 83.8
Hat 82.5
Building 80.3
Plant 80.1
Adaptation 79.3
Happy 78.8
Grass 78.3
People 77.7
Monochrome photography 75.6
Monochrome 74.6
Vintage clothing 74.5
Tree 70.8
Stock photography 65
Photo caption 64.9

Microsoft
created on 2022-02-26

grass 99.8
outdoor 99.7
person 94.5
clothing 93.8
posing 88.3
human face 85.6
text 80.8
boy 71.8
toddler 71.4
smile 56.6

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Female, 99.8%
Happy 99.7%
Calm 0.1%
Sad 0.1%
Surprised 0.1%
Fear 0%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Female, 78.3%
Calm 71.7%
Happy 19.9%
Surprised 3.5%
Sad 1.6%
Confused 1.5%
Fear 0.8%
Disgusted 0.7%
Angry 0.3%

AWS Rekognition

Age 33-41
Gender Female, 65.1%
Happy 89.8%
Calm 4.7%
Surprised 3.2%
Angry 0.8%
Confused 0.6%
Disgusted 0.5%
Sad 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a boy and girl posing for a photo 73.9%
a boy and a girl posing for a photo 73.8%
a boy posing for a photo 73.7%

Text analysis

Amazon

YT73A-NAOY
30