Human Generated Data

Title

Untitled (little boy on rocking horse, little girl nearby)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17528

Human Generated Data

Title

Untitled (little boy on rocking horse, little girl nearby)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Shorts 98.5
Apparel 98.5
Clothing 98.5
Person 98.2
Human 98.2
Person 97.9
Mammal 95.3
Horse 95.3
Animal 95.3
People 92.8
Play 84.8
Team 78.7
Sport 78.7
Sports 78.7
Team Sport 78.7
Football 73
Child 72.2
Kid 72.2
Boy 69.6
Sphere 66.1
Girl 64.5
Female 64.5
Face 64.3
Photography 64.3
Photo 64.3
Portrait 64.3
Baby 58.5
Ball 57.1

Imagga
created on 2022-02-26

man 28.9
hairdresser 26.1
male 24.3
adult 23.1
people 22.9
chair 22.3
person 20.6
salon 16.8
barber chair 16.4
couple 15.7
seat 15.6
youth 14.5
black 14.4
portrait 13.6
home 12.8
dress 12.6
pretty 12.6
family 12.4
lifestyle 12.3
teacher 11.9
hair 11.9
barbershop 11.6
furniture 11.5
professional 11.5
bride 11.5
human 11.2
looking 11.2
two 11
room 10.8
world 10.8
face 10.6
happy 10.6
sexy 10.4
wedding 10.1
women 9.5
love 9.5
men 9.4
smile 9.3
mother 9.2
shop 9.1
handsome 8.9
new 8.9
life 8.8
happiness 8.6
sitting 8.6
business 8.5
wheelchair 8.4
attractive 8.4
future 8.4
one 8.2
girls 8.2
exercise 8.2
romantic 8
interior 8
businessman 7.9
together 7.9
tenderness 7.8
model 7.8
old 7.7
casual 7.6
bouquet 7.5
leisure 7.5
building 7.4
educator 7.4
care 7.4
back 7.3
window 7.3
office 7.3
active 7.3
mercantile establishment 7.2
indoors 7
child 7
look 7

Google
created on 2022-02-26

Shorts 95.3
Photograph 94.1
White 92.2
Black 89.8
Black-and-white 86.8
Standing 86.4
Style 84.2
Monochrome 78
Monochrome photography 77.8
Happy 77.2
Font 76.3
Snapshot 74.3
Toddler 73.2
Visual arts 64.9
Sitting 64.1
Room 63.9
Street 63.6
Stock photography 63.6
Pattern 62.8
Flooring 58.9

Microsoft
created on 2022-02-26

outdoor 94.6
person 93.3
woman 91.7
clothing 87.7
text 80.4
boy 71.9
human face 65.5
toddler 55.6
black and white 54.4
posing 38.9

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Male, 69.8%
Calm 63.2%
Surprised 35.3%
Happy 0.5%
Disgusted 0.4%
Angry 0.3%
Confused 0.2%
Fear 0.1%
Sad 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Horse 95.3%

Captions

Microsoft

a person standing in front of a building 93.1%
a person standing in front of a brick building 88.9%
a man and a woman standing in front of a building 82%

Text analysis

Amazon

3

Google

MJI7--
Y
-
MJI7-- Y T37A°2 - - XAGO
T37A°2
XAGO