Human Generated Data

Title

Untitled (little girl with hat looking at mirror)

Date

c. 1950, printed later

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.136

Human Generated Data

Title

Untitled (little girl with hat looking at mirror)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 96
Human 96
Clothing 93.2
Apparel 93.2
Bird 88.7
Animal 88.7
Floor 83.5
Flooring 81
Person 80.1
Evening Dress 66.1
Fashion 66.1
Gown 66.1
Robe 66.1
Indoors 62.9
Toy 57.6
Door 57.4
Room 55.7

Imagga
created on 2022-01-23

kimono 94.9
robe 82
garment 62.1
clothing 45.5
dress 25.3
people 25.1
person 24.7
covering 22.7
bride 22.1
consumer goods 21.1
man 19.5
wedding 19.3
adult 19.2
male 19.1
happy 18.2
portrait 17.5
love 16.6
groom 16.1
couple 14.8
pretty 14.7
smile 14.2
fashion 13.6
black 12.8
women 12.6
lady 12.2
room 12
attractive 11.9
happiness 11.7
married 11.5
marriage 11.4
men 11.2
smiling 10.8
lifestyle 10.8
looking 10.4
style 10.4
cleaner 10.3
future 10.2
two 10.2
alone 10
indoor 10
posing 9.8
interior 9.7
one 9.7
home 9.6
sitting 9.4
bouquet 9.4
elegance 9.2
pose 9.1
human 9
holiday 8.6
face 8.5
youth 8.5
business 8.5
casual 8.5
hand 8.4
holding 8.2
fun 8.2
cheerful 8.1
life 8.1
suit 8.1
active 8.1
family 8
indoors 7.9
gown 7.8
bridal 7.8
model 7.8
dance 7.6
wife 7.6
joy 7.5
weapon 7.5
light 7.3
window 7.3
girls 7.3
stylish 7.2
child 7.2
building 7.2
cute 7.2
romance 7.1
together 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

drawing 96.6
text 95.8
cartoon 87.9
cat 87.8
black and white 86.7
sketch 85.6
clothing 79.9
person 77.4
painting 63.6
room 42.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Sad 72.3%
Calm 15%
Angry 7%
Disgusted 1.7%
Surprised 1.5%
Fear 1.2%
Happy 0.8%
Confused 0.5%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 96%
Bird 88.7%

Captions

Microsoft

a person holding a cat 46.5%
a person holding a cat in a room 46.4%
a person sitting next to a cat 40.9%