Human Generated Data

Title

Untitled (two girls and doll)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17570

Human Generated Data

Title

Untitled (two girls and doll)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.6
Human 99.6
Person 98.9
Clothing 97.2
Apparel 97.2
Face 93.1
Person 89.3
Hair 78
Female 73.1
Head 70
Door 70
Girl 68.9
Child 66.3
Kid 66.3
Photo 66
Portrait 66
Photography 66
People 65.7
Dress 59.4
Sleeve 58.6
Costume 58.6
Shorts 56.6
Performer 55.9

Imagga
created on 2022-02-26

people 24.5
man 24.2
mask 23.3
device 21.9
portrait 21.3
male 20.6
person 19.7
adult 18.9
guillotine 18
black 17.6
world 15.8
smile 15.7
happiness 15.7
couple 14.8
instrument 14.5
instrument of execution 14.4
happy 14.4
dress 13.5
human 13.5
women 13.4
smiling 13
looking 12.8
life 12.6
fun 12
love 11.8
elevator 11.7
face 11.4
fashion 11.3
men 11.2
hair 11.1
clothing 10.5
standing 10.4
celebration 10.4
camera 10.3
child 10.3
elegance 10.1
negative 9.8
film 9.6
bride 9.6
home 9.6
lifting device 9.4
youth 9.4
casual 9.3
two 9.3
locker 9.3
girls 9.1
one 9
outdoors 9
urban 8.7
disguise 8.5
groom 8.4
wedding 8.3
holding 8.2
cheerful 8.1
suit 8.1
family 8
job 8
cute 7.9
together 7.9
work 7.8
veil 7.8
blond 7.8
culture 7.7
adults 7.6
covering 7.6
city 7.5
leisure 7.5
protection 7.3
danger 7.3
body 7.2
art 7.2
posing 7.1

Google
created on 2022-02-26

Hairstyle 95.1
Photograph 94.3
Window 92.2
Black 89.9
Human 89.6
Black-and-white 88.1
Style 84.2
Flash photography 81.5
Monochrome 78.3
Picture frame 78.2
Monochrome photography 77.7
Snapshot 74.3
Display case 74
Fashion design 73.9
Art 73.5
Fun 73.3
Happy 73
Glass 72.4
Event 71.5
Child 69.8

Microsoft
created on 2022-02-26

person 95.2
clothing 95.2
human face 94
text 93.8
toddler 81.9
girl 59.8
dress 57.2
boy 56.7

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Female, 85.7%
Happy 88.6%
Calm 7.2%
Surprised 2%
Disgusted 0.6%
Fear 0.5%
Angry 0.4%
Confused 0.4%
Sad 0.3%

AWS Rekognition

Age 22-30
Gender Female, 99.8%
Calm 70.6%
Surprised 18%
Happy 6.3%
Disgusted 1.9%
Fear 1.4%
Sad 1%
Angry 0.5%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 92.2%
a girl standing in front of a mirror posing for the camera 85.1%
a little girl standing in front of a mirror posing for the camera 75.3%

Text analysis

Amazon

3