Human Generated Data

Title

Untitled (woman in floral patterned dress with young girl on lap, seated in front of plant and patio door)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12788

Human Generated Data

Title

Untitled (woman in floral patterned dress with young girl on lap, seated in front of plant and patio door)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.1
Person 99.1
Person 98.4
Clothing 98.1
Apparel 98.1
Shoe 97.3
Footwear 97.3
Shorts 74.6
Finger 65.1
Back 58.8
Shoe 57.6
Tire 55.4

Clarifai
created on 2019-11-16

people 99.8
monochrome 98.6
woman 98.5
child 97.6
portrait 97.3
adult 97.2
wear 95.8
two 94.9
actress 94.6
one 92.3
girl 90.8
street 90.7
facial expression 90.3
man 88.3
music 84.1
dress 82
group 80.4
outfit 80.3
furniture 80.2
singer 79.5

Imagga
created on 2019-11-16

sexy 29.7
adult 27.8
black 27.2
portrait 26.5
kin 26.2
fashion 25.6
people 25.1
person 22.8
hair 22.2
attractive 21.7
face 21.3
model 21
man 20.4
pretty 20.3
male 18.2
love 18.2
human 18
body 17.6
women 17.4
groom 16.6
lady 16.2
couple 15.7
dress 15.4
brunette 14.8
skin 14.4
sensuality 13.6
posing 13.3
sensual 12.7
style 12.6
parent 11.9
make 11.8
two 11
gorgeous 10.9
child 10.8
cute 10.8
happy 10.7
looking 10.4
passion 10.3
youth 10.2
mother 10.2
dark 10
dad 10
holding 9.9
bride 9.9
hand 9.9
serious 9.5
lips 9.3
makeup 9.2
girls 9.1
vintage 9.1
pose 9.1
window 9
romantic 8.9
father 8.8
sepia 8.7
standing 8.7
eyes 8.6
elegant 8.6
wall 8.6
expression 8.5
art 8.5
erotic 8.5
world 8.4
strength 8.4
head 8.4
studio 8.4
sport 8.2
one 8.2
romance 8
lovely 8
lifestyle 8
smile 7.8
happiness 7.8
monochrome 7.8
sitting 7.7
sexual 7.7
lingerie 7.6
power 7.6
hot 7.5
room 7.5
wedding 7.4

Google
created on 2019-11-16

Photograph 97.2
Black-and-white 91.8
Snapshot 87.2
Photography 83.6
Photographic paper 76.6
Monochrome 75.8
Stock photography 73.7
Picture frame 72.4
Fun 70.4
Child 69.3
Room 65.7
Monochrome photography 64.7
Portrait 64.3
Style 55
Smile 54
Daughter 52.1
Art 50.2

Microsoft
created on 2019-11-16

human face 96.8
toddler 96.6
person 95.8
clothing 95.4
baby 94.8
black and white 88.8
child 82.3
text 80.9
girl 78.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-46
Gender Female, 99.7%
Fear 1.9%
Calm 82.7%
Sad 2.7%
Surprised 1.2%
Disgusted 2.2%
Angry 2.4%
Happy 1.2%
Confused 5.8%

AWS Rekognition

Age 0-4
Gender Female, 54.1%
Happy 0%
Sad 30%
Disgusted 0%
Calm 69.5%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Shoe 97.3%

Captions

Microsoft

a woman standing in front of a window 94%
a woman standing next to a window 91%
a girl standing in front of a window 86.8%

Text analysis

Amazon

8 0 2 1t

Google

13
13