Human Generated Data

Title

Untitled (little girl standing on snowy sidewalk)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17512

Human Generated Data

Title

Untitled (little girl standing on snowy sidewalk)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.9
Clothing 99.9
Person 98.2
Human 98.2
Person 97.9
Helmet 80.8
Person 75.3
Shorts 74.4
Footwear 74.1
Shoe 74.1
Person 73.5
Female 70.7
Coat 69.1
Hat 67.9
Shoe 67.2
Girl 65.4
Overcoat 63.6
Suit 62.1
Bonnet 59.8
Plant 56.3

Imagga
created on 2022-02-26

dress 35.2
bride 31.8
wedding 31.3
people 30.1
groom 25.9
love 24.4
fashion 23.4
adult 23.3
married 22
man 21.5
person 21
happy 20.7
model 20.2
couple 20
clothing 19.4
male 19.1
outdoor 19.1
portrait 18.8
women 18.2
marriage 18
lifestyle 17.3
day 17.3
smile 16.4
face 16.3
posing 16
veil 15.7
weapon 15.1
coat 15.1
sword 15.1
nurse 15.1
hair 15
attractive 14.7
outside 14.5
celebration 14.3
romance 14.3
human 14.2
bouquet 14.1
lady 13.8
one 13.4
outdoors 13.4
happiness 13.3
hat 13.2
park 13.2
city 12.5
walking 12.3
summer 12.2
looking 12
pretty 11.9
suit 11.9
umbrella 11.8
cute 11.5
gown 11.3
street 11
blond 10.9
business 10.3
clothes 10.3
professional 10.3
black 10.2
elegance 10.1
makeup 10.1
joy 10
life 9.9
wed 9.8
garment 9.6
flowers 9.6
men 9.4
holding 9.1
fun 9
sunlight 8.9
healthy 8.8
together 8.8
smiling 8.7
bright 8.6
walk 8.6
wall 8.5
church 8.3
bonnet 8.2
relaxing 8.2
cheerful 8.1
sun 8
sexy 8
cool 8
businessman 7.9
headdress 7.9
standing 7.8
bridal 7.8
flower 7.7
bag 7.5
future 7.4
jacket 7.3
alone 7.3
tourist 7.2
morning 7.2
romantic 7.1
covering 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

building 99.4
street 98.2
black and white 94.2
text 93.4
outdoor 88.5
monochrome 85.2
footwear 79

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 90.6%
Calm 75.1%
Happy 20.9%
Angry 1.3%
Surprised 0.9%
Sad 0.7%
Confused 0.4%
Fear 0.4%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 98.2%
Helmet 80.8%
Shoe 74.1%

Captions

Microsoft

a person standing in front of a building 61.5%
a person standing in front of a brick building 52.2%
a person is walking down the street in front of a building 52.1%

Text analysis

Google

MJIA- -YT R2- -NA GO SMPP
-NA
-YT
R2-
SMPP
GO
MJIA-