Human Generated Data

Title

Untitled (boy with dog outside)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17615

Human Generated Data

Title

Untitled (boy with dog outside)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 98.1
Person 98.1
Apparel 97.1
Clothing 97.1
Grass 87.2
Plant 87.2
Outdoors 87.1
Face 85.1
Nature 84.5
Dog 84.2
Animal 84.2
Mammal 84.2
Pet 84.2
Canine 84.2
Pants 77.2
Female 73
Shorts 70.3
Child 69.8
Kid 69.8
Portrait 69.7
Photography 69.7
Photo 69.7
Light 67.9
Traffic Light 67.9
People 65
Girl 64
Food 63
Meal 63
Boy 60.7
Ground 59.1
Play 59
Tree 58.9
Skin 58.9
Sand 56.6

Imagga
created on 2022-02-26

child 34.1
dad 33.2
parent 33.2
people 30.1
father 28.6
happy 26.3
man 26.2
lifestyle 25.3
outdoor 25.2
world 25.2
portrait 23.3
outdoors 22.4
love 21.3
summer 21.2
male 21
couple 20.9
person 20.2
adult 20.1
athlete 19.9
ballplayer 19.5
joy 19.2
happiness 18.8
park 18.1
player 17.7
smiling 16.7
beach 16
fun 15.7
family 15.1
mother 14.9
pretty 14.7
cute 14.4
leisure 14.1
together 14
contestant 13.8
two 13.6
women 13.5
childhood 13.4
day 13.3
smile 12.8
attractive 12.6
life 12.4
sibling 11.9
laughing 11.3
boy 11.3
grass 11.1
countryside 11
active 10.8
sport 10.7
water 10.7
vacation 10.6
sun 10.5
outside 10.3
son 10.3
youth 10.2
casual 10.2
sea 10.2
relax 10.1
healthy 10.1
face 10
sunset 9.9
meadow 9.9
cheerful 9.8
kid 9.8
sky 9.6
relationship 9.4
holiday 9.3
ball 9.2
field 9.2
playing 9.1
girls 9.1
exercise 9.1
human 9
romantic 8.9
little 8.8
boyfriend 8.7
play 8.6
men 8.6
walk 8.6
black 8.4
dark 8.4
holding 8.3
body 8
hair 7.9
kin 7.8
girlfriend 7.7
old 7.7
husband 7.6
walking 7.6
enjoying 7.6
enjoy 7.5
one 7.5
adorable 7.4
back 7.3
game equipment 7.3
romance 7.1

Microsoft
created on 2022-02-26

outdoor 96.5
text 92
toddler 88.1
person 86.2
baby 81.9
boy 77.3
human face 69.6
child 65.1
clothing 59.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 82.2%
Happy 61.6%
Calm 30.9%
Surprised 3.1%
Fear 1.6%
Disgusted 0.8%
Sad 0.8%
Angry 0.6%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Dog 84.2%

Captions

Microsoft

a boy on a baseball field 57.2%
a young boy on a baseball field 47.9%
a young boy standing on a baseball field 38.9%

Text analysis

Amazon

٤١٢
ФИЗСО ٤١٢
ФИЗСО