Human Generated Data

Title

Untitled (mother seated in chair with three children beside her, in living room under chandelier sconce)

Date

c. 1940, printed later

People

Artist: Paul Gittings, American 1900 - 1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12897

Human Generated Data

Title

Untitled (mother seated in chair with three children beside her, in living room under chandelier sconce)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.1
Person 99.1
Person 98.3
Person 96.4
Leisure Activities 94.4
Dance Pose 94.4
Person 94.3
Lamp 82
Flooring 81.1
Accessory 76.8
Tie 76.8
Accessories 76.8
People 73.6
Clothing 65.5
Coat 65.5
Overcoat 65.5
Suit 65.5
Apparel 65.5
Dance 65.1
Person 62.3
Chandelier 61.7

Clarifai
created on 2019-11-16

people 99.8
woman 97.7
adult 97.4
group 96.6
man 94.7
group together 94.1
portrait 90
monochrome 89.4
leader 88.7
wear 88.6
music 88.5
outfit 87.2
room 87.1
two 86.8
musician 85.6
actress 85.3
singer 82.1
chair 78.7
five 78.2
street 76

Imagga
created on 2019-11-16

sexy 33.7
person 29.2
adult 28.9
black 28.2
people 26.8
attractive 25.9
portrait 24.6
fashion 24.1
model 23.3
man 22.9
style 21.5
pretty 19.6
dress 19
lady 17.9
hair 16.6
couple 16.6
male 16.5
brunette 14.8
two 14.4
elegance 14.3
one 14.2
passion 14.1
device 14
lifestyle 13.7
elegant 13.7
body 13.6
love 13.4
posing 13.3
room 13.1
sensual 12.7
gorgeous 12.7
dark 12.5
elevator 12.4
interior 12.4
studio 12.2
face 12.1
human 12
women 11.9
sensuality 11.8
stylish 11.8
salon 11.3
youth 11.1
pose 10.9
lingerie 10.9
vintage 10.8
romantic 10.7
night 10.7
erotic 10.5
urban 10.5
old 10.4
cute 10
lifting device 9.9
girlfriend 9.6
happy 9.4
clothing 9.4
casual 9.3
make 9.1
retro 9
bow tie 9
nightlife 8.8
home 8.8
vogue 8.7
glamorous 8.7
seductive 8.6
sitting 8.6
men 8.6
expression 8.5
call 8.5
legs 8.5
relationship 8.4
inside 8.3
romance 8
smile 7.8
standing 7.8
hugging 7.8
party 7.7
underwear 7.7
skin 7.6
club 7.5
shop 7.5
city 7.5
emotion 7.4
slim 7.4
smiling 7.2
looking 7.2
indoors 7
modern 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

text 95.5
person 95.1
clothing 94.2
smile 86.6
black and white 83
human face 80.3
woman 72.8
man 65.9
posing 61

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 53.5%
Fear 46.2%
Disgusted 45.8%
Surprised 45.5%
Sad 45.9%
Happy 45.2%
Confused 46.4%
Angry 46.4%
Calm 48.6%

AWS Rekognition

Age 12-22
Gender Female, 52%
Angry 45%
Disgusted 45%
Surprised 45%
Fear 45%
Confused 45%
Happy 45%
Sad 45.9%
Calm 53.9%

AWS Rekognition

Age 32-48
Gender Female, 99.9%
Disgusted 2.8%
Happy 63.4%
Angry 1.1%
Fear 0.9%
Calm 27.3%
Confused 1.7%
Surprised 1.4%
Sad 1.2%

AWS Rekognition

Age 12-22
Gender Female, 54.8%
Calm 53.7%
Sad 45.3%
Happy 45.1%
Angry 45.1%
Fear 45.2%
Confused 45.2%
Surprised 45.2%
Disgusted 45%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 76.8%
Suit 65.5%

Captions

Microsoft

a group of people posing for a photo 90.9%
a group of people posing for a picture 90.8%
a group of people posing for the camera 90.7%