Human Generated Data

Title

Untitled (children playing outside with wagon)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17052

Human Generated Data

Title

Untitled (children playing outside with wagon)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Grass 99.9
Plant 99.9
Clothing 99.7
Apparel 99.7
Person 99.5
Human 99.5
Person 98.3
Nature 96.9
Yard 96.9
Outdoors 96.9
Shorts 96.5
Dress 95.4
Bush 92
Vegetation 92
Face 89.4
Female 89
Person 87.8
Kid 86.9
Child 86.9
People 84.7
Play 82.4
Boy 81
Tree 78.7
Pants 77.1
Girl 74.4
Lawn 73.6
Portrait 70.9
Photography 70.9
Photo 70.9
Park 69.9
Field 69.6
Woman 65.7
Machine 63.8
Wheel 63.8
Hand 60.1
Baby 57.7
Grassland 56.9
Skirt 56.9
Leisure Activities 56.2
Teen 56.1

Imagga
created on 2022-02-26

tricycle 93.5
wheeled vehicle 75.9
vehicle 53.7
conveyance 37.7
child 37.5
sport 35.1
ball 33.9
man 26.2
outdoors 24.8
outdoor 24.5
grass 23.7
people 23.4
fun 22.5
playing 21.9
boy 21.7
leisure 21.6
male 21.5
person 20.2
active 19.8
outside 18.8
soccer ball 18.7
game 16.9
play 16.4
happy 16.3
golfer 16.3
recreation 16.1
field 15.9
golf 15.3
park 14.8
course 14.5
kid 14.2
summer 14.1
lifestyle 13.7
player 13.7
activity 13.4
happiness 13.3
sand 13.1
beach 12.6
sunset 12.6
family 12.5
walking 12.3
adult 12.3
competition 11.9
game equipment 11.7
walk 11.4
exercise 10.9
smiling 10.9
vacation 10.6
football 10.6
parent 10
joy 10
fitness 9.9
silhouette 9.9
putt 9.8
run 9.6
together 9.6
soccer 9.6
running 9.6
women 9.5
love 9.5
day 9.4
equipment 9.4
two 9.3
action 9.3
children 9.1
athlete 9
health 9
childhood 9
golfing 8.8
couple 8.7
goal 8.6
men 8.6
smile 8.6
lawn 8.5
trees 8
little 8
cute 7.9
kick 7.8
portrait 7.8
practice 7.7
father 7.7
athletic 7.7
sky 7.7
dusk 7.6
drive 7.6
club 7.5
human 7.5
senior 7.5
one 7.5
sports 7.4
back 7.3
water 7.3
cheerful 7.3
team 7.2
dad 7.1
sunlight 7.1
autumn 7

Google
created on 2022-02-26

Standing 86.4
Black-and-white 85.5
Style 83.9
Grass 81.3
Playing with kids 80.5
Toddler 80.2
People in nature 79.6
Child 79.2
Happy 78.6
Tints and shades 76.6
Monochrome photography 76.4
Fun 76.2
Sports equipment 75.8
Monochrome 75.4
Vintage clothing 71.2
Flash photography 69.8
Recreation 68.6
Plant 67.4
Play 58.1
Sitting 55.8

Microsoft
created on 2022-02-26

grass 99.3
outdoor 98
toddler 96.5
text 91.8
person 88.9
field 84.9
footwear 84.8
baby 84.6
boy 83.7
clothing 83.5
sport 77.9
athletic game 76.6
child 75.3
black 67.7
player 63.2
playground 55.1

Face analysis

Amazon

Google

AWS Rekognition

Age 7-17
Gender Female, 99.9%
Happy 73.7%
Surprised 17.5%
Sad 5.2%
Disgusted 1.2%
Angry 0.7%
Calm 0.7%
Fear 0.6%
Confused 0.4%

AWS Rekognition

Age 26-36
Gender Male, 88.9%
Sad 97%
Calm 2.2%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Wheel 63.8%

Captions

Microsoft

a young boy holding a baseball bat on a field 46.4%
a young boy standing on a baseball field 46.3%
a young boy holding a baseball bat 34.1%

Text analysis

Amazon

MJI3
MJI3 ACCUA
ACCUA

Google

MJIR
YT3RA2
MJIR YT3RA2