Human Generated Data

Title

Untitled (boy and girl in white)
Date

c. 1970
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.548

Human Generated Data

Title

Untitled (boy and girl in white)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.9
Clothing 99.9
Shorts 99.9
Footwear 98.4
Shoe 98.4
Human 98.4
Person 98.4
Person 96.4
Shoe 92.8
Shoe 87.6
Sleeve 78.8
Female 68.1
Girl 68.1
Dress 65.2
Shoe 60.6
Pants 59
Home Decor 57.9
Long Sleeve 57.6
Door 56.5
Fashion 56
Robe 56
Evening Dress 56
Gown 56
Flooring 55.1

Imagga
created on 2022-02-26

happy 43.3
people 36.9
smiling 36.2
child 34
smile 32.8
male 31
person 29.5
daughter 29.5
man 28.9
fun 27
happiness 25.9
family 25.8
together 25.4
miniskirt 24.9
lifestyle 24.6
couple 24.4
joy 24.2
adult 24.1
kid 24
sibling 23.9
portrait 23.3
cute 22.3
boy 21.8
standing 20.9
skirt 20.8
cheerful 19.5
mother 19.4
brother 18.4
garment 18.2
youth 17.9
clothing 17.9
casual 17.8
love 17.4
children 17.3
parent 16.9
holding 16.5
outdoors 16.4
father 16
friends 16
pretty 15.4
son 15.2
attractive 14.7
women 14.2
little 14.1
outdoor 13.8
looking 13.6
two 13.6
husband 13.5
home 12.8
active 12.6
day 12.6
model 12.5
wife 12.3
walking 12.3
human 12
teen 12
teenager 11.9
house 11.7
childhood 11.7
running 11.5
school 11.4
face 11.4
senior 11.3
one 11.2
outside 11.1
expression 11.1
adorable 11.1
girls 11
togetherness 10.4
student 10.4
play 10.4
friendship 10.3
mature 10.2
joyful 10.1
leisure 10
park 9.9
dad 9.8
lady 9.8
group 9.7
summer 9.7
teenage 9.6
nurse 9.6
education 9.5
enjoying 9.5
men 9.5
enjoy 9.4
grandma 9.4
indoor 9.1
playing 9.1
dress 9
indoors 8.8
students 8.8
full length 8.7
stand 8.5
playful 8.5
laughing 8.5
bag 8.5
kids 8.5
relationship 8.4
life 8.4
covering 8.2
new 8.1
lovely 8
blond 7.9
vertical 7.9
work 7.9
looking camera 7.7
move 7.7
estate 7.6
real 7.6
healthy 7.6
fashion 7.5
enjoyment 7.5
color 7.2
room 7.1
interior 7.1
look 7

Google
created on 2022-02-26

Clothing 98.8
Footwear 98.3
Smile 96
Leg 91.5
Dress 87.7
Sleeve 87.2
Standing 86.4
Gesture 85.3
Happy 83.9
Shorts 74.9
Vintage clothing 74.8
Formal wear 74
Child 73.4
Waist 72.9
Toddler 72.3
Pattern 71.5
Knee 70.8
Day dress 66.9
Fashion design 63.9
Stock photography 62.3

Microsoft
created on 2022-02-26

person 98.7
clothing 94.9
dress 93.7
smile 93
footwear 89.8
skirt 85.2
human face 84.6
toddler 83.5
standing 83.4
girl 54.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Male, 100%
Happy 99.7%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Sad 0%
Surprised 0%
Fear 0%
Calm 0%

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Happy 99.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Sad 0%
Fear 0%
Calm 0%

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 15
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 98.4%
Person 98.4%

Captions

Microsoft

a little girl standing in front of a window 83.4%
a little girl standing next to a window 82.2%
a young girl standing next to a window 82.1%