Human Generated Data

Title

Untitled (children sitting on folding-chair on lawn)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16394

Human Generated Data

Title

Untitled (children sitting on folding-chair on lawn)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Furniture 99.9
Chair 99.9
Plant 99.8
Grass 99.8
Person 99.6
Human 99.6
Person 99.4
Machine 98.5
Wheel 98.5
Clothing 98.1
Apparel 98.1
Person 96.3
Play 92.8
Person 89.8
Face 89.4
Footwear 88.5
Shoe 88.5
Outdoors 88.3
Vehicle 87.8
Transportation 87.8
Bike 87.8
Bicycle 87.8
Yard 87.7
Nature 87.7
Shorts 86.8
Female 82.3
Lawn 81.5
Dress 79.2
Park 77.9
Kid 77.3
Child 77.3
Vegetation 73.6
Tree 73.1
Photo 72.2
Photography 72.2
Portrait 72.2
Girl 68.7
Baby 66

Imagga
created on 2022-02-11

swing 99.5
plaything 71.1
mechanical device 70.5
mechanism 52.5
child 44.5
happy 28.8
kid 25.7
fun 25.5
people 25.1
beach 23.6
summer 23.2
park 23.1
boy 21.7
childhood 21.5
parent 21.1
outside 20.5
outdoor 19.1
smiling 18.8
cute 18.7
playing 18.2
mother 17.9
smile 17.8
pretty 17.5
outdoors 17.2
youth 17
little 16.8
vacation 16.4
portrait 16.2
family 16
lifestyle 15.9
happiness 15.7
play 15.5
children 15.5
sitting 15.5
sky 14.7
sand 14.6
relax 14.3
active 13.5
resort area 13.5
sit 13.2
dad 13.2
father 13.1
man 12.8
girls 12.8
women 12.7
leisure 12.5
adult 12.3
male 12.3
daughter 11.7
person 11.5
holiday 11.5
toddler 11.5
area 11.3
sun 11.3
attractive 11.2
sunny 11.2
grass 11.1
love 11
sea 10.9
joy 10.9
recreation 10.8
face 10.7
day 10.2
healthy 10.1
relaxation 10.1
playground 9.8
baby 9.7
together 9.6
couple 9.6
enjoying 9.5
laughing 9.5
kids 9.4
two 9.3
ocean 9.1
blond 9
activity 9
hair 8.7
water 8.7
laugh 8.6
bench 8.6
chair 8.6
warm 8.3
relaxing 8.2
chairlift 8
sexy 8
region 8
sport 8
tricycle 7.9
model 7.8
eyes 7.7
conveyance 7.6
togetherness 7.6
enjoy 7.5
sibling 7.5
teen 7.4
freedom 7.3
alone 7.3
son 7.2
work 7.1
autumn 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

outdoor 99.1
text 84.8
clothing 69.2
person 68
posing 54.8
black and white 54.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 93.8%
Calm 98.7%
Surprised 0.3%
Sad 0.3%
Fear 0.2%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Happy 89.1%
Surprised 4.2%
Calm 3%
Sad 1.4%
Disgusted 0.8%
Angry 0.7%
Fear 0.5%
Confused 0.3%

AWS Rekognition

Age 52-60
Gender Male, 99%
Sad 76.8%
Happy 11%
Calm 6.5%
Disgusted 1.5%
Angry 1.4%
Surprised 1%
Confused 1%
Fear 0.8%

AWS Rekognition

Age 7-17
Gender Male, 97%
Happy 75.3%
Fear 14%
Surprised 5.1%
Sad 2.9%
Calm 1.2%
Angry 0.8%
Disgusted 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Wheel 98.5%
Shoe 88.5%
Bicycle 87.8%

Captions

Microsoft

a little girl posing for a photo 83.2%
a little girl posing for a picture 83.1%
a woman holding a dog posing for the camera 78.7%

Text analysis

Amazon

2
7
KODAK-A-EITW

Google

-
XAGON
MJI7--YT3RA°2-
2 MJI7--YT3RA°2- - XAGON
2