Human Generated Data

Title

Untitled (Beaux Arts Ball, woman with man in caveman costume)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15653.3

Human Generated Data

Title

Untitled (Beaux Arts Ball, woman with man in caveman costume)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 97.3
Person 97.3
Apparel 97.1
Clothing 97.1
Face 96.7
Person 96.2
Female 83.8
Hair 76.7
Costume 76.6
Indoors 76.3
Painting 76.2
Art 76.2
Room 70.9
Door 69.9
Photo 68.5
Portrait 68.5
Photography 68.5
Woman 67.8
Evening Dress 61.3
Gown 61.3
Fashion 61.3
Robe 61.3
Dating 59.9
Furniture 59.8
Floor 58.6

Imagga
created on 2022-02-05

portrait 27.2
person 25.2
people 24.5
adult 23.9
lady 21.9
dress 20.8
happy 20.7
bride 20.1
pretty 18.9
blond 17.8
senior 17.8
room 17.5
wedding 17.5
old 17.4
fashion 16.6
happiness 16.5
smiling 15.9
love 15.8
elderly 15.3
home 15.2
smile 15
face 14.9
couple 14.8
grandma 14.4
mature 13.9
cheerful 13.8
aged 13.6
human 13.5
women 13.4
man 13.4
attractive 13.3
indoors 13.2
lifestyle 13
alone 12.8
groom 12.6
model 12.4
sitting 12
holding 11.6
interior 11.5
clothing 11.3
one 11.2
pensioner 10.9
retired 10.7
retirement 10.6
together 10.5
luxury 10.3
expression 10.2
sensuality 10
grandmother 9.8
family 9.8
style 9.6
sexy 9.6
costume 9.6
gown 9.5
hair 9.5
color 9.5
elegant 9.4
male 9.3
two 9.3
mother 9.1
look 8.8
vertical 8.7
cute 8.6
loving 8.6
age 8.6
wife 8.5
bouquet 8.5
elegance 8.4
vintage 8.3
fun 8.2
care 8.2
indoor 8.2
looking 8
pension 7.9
veil 7.8
standing 7.8
sofa 7.8
older 7.8
eyes 7.7
health 7.6
marriage 7.6
bathroom 7.2
stylish 7.2
life 7.2
celebration 7.2
romantic 7.1

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

person 99.2
woman 93.4
human face 85.8
clothing 81.1
dress 79.9
text 79.6
posing 58

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Happy 89.4%
Disgusted 4.4%
Angry 4.3%
Confused 0.5%
Fear 0.4%
Surprised 0.4%
Calm 0.3%
Sad 0.3%

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 90.3%
Angry 4.2%
Fear 1.9%
Confused 1.6%
Surprised 1.2%
Disgusted 0.4%
Sad 0.2%
Calm 0.1%

AWS Rekognition

Age 25-35
Gender Female, 99.7%
Calm 99.9%
Sad 0%
Fear 0%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%
Surprised 0%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Painting 76.2%

Captions

Microsoft

a woman standing in front of a mirror posing for the camera 94.9%
woman standing in front of a mirror posing for the camera 92.7%
a woman is standing in front of a mirror posing for the camera 91.3%