Human Generated Data

Title

Untitled (studio portrait of two couples)

Date

c. 1930

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4348

Human Generated Data

Title

Untitled (studio portrait of two couples)

People

Artist: Durette Studio, American 20th century

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.4
Clothing 99.4
Person 98.9
Human 98.9
Person 98.7
Person 98.7
Person 96.7
Tie 91.4
Accessory 91.4
Accessories 91.4
Furniture 85.1
Chair 85.1
Robe 80.1
Fashion 80.1
People 80.1
Person 79.2
Face 69.5
Gown 65.4
Female 65.4
Photography 62.7
Photo 62.7
Portrait 62
Wedding 61.3
Nurse 58.7
Evening Dress 57.6
Veil 55.8

Clarifai
created on 2019-06-01

people 99.1
wedding 98.4
veil 97.9
man 96.6
woman 95.2
bride 95
groom 94.5
adult 94.1
vertical 93.4
wear 93.1
indoors 88.8
ceremony 88.1
monochrome 86.1
portrait 85
two 84.8
group 82.9
uniform 76
three 75.4
retro 75
dress 74.9

Imagga
created on 2019-06-01

negative 100
film 90.5
photographic paper 69.2
photographic equipment 46.1
statue 25.4
sculpture 22.6
art 19.4
portrait 16.8
human 15
fountain 14.7
dress 14.4
fashion 14.3
people 13.9
marble 13.9
body 13.6
adult 13.6
face 12.8
pretty 12.6
attractive 12.6
stone 11.8
person 11.8
history 11.6
lady 11.4
love 11
old 10.4
monument 10.3
culture 10.3
architecture 10.2
black 9.6
male 9.2
religion 9
bride 8.9
look 8.8
man 8.7
ancient 8.6
bright 8.6
model 8.6
historical 8.5
head 8.4
structure 8.4
health 8.3
church 8.3
tourism 8.2
makeup 8.2
style 8.2
decoration 8.2
detail 8
sexy 8
romantic 8
posing 8
celebration 8
medical 7.9
travel 7.7
party 7.7
hand 7.6
elegance 7.6
clothing 7.5
famous 7.4
wedding 7.4
historic 7.3
cute 7.2
science 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

window 97.5
wedding 97.3
wedding dress 93.7
posing 89.8
clothing 88.6
person 87.1
bride 83.3
dress 74.4
black and white 68.7
woman 67.9
marriage 60.1
picture frame 23.1

Face analysis

Amazon

AWS Rekognition

Age 48-68
Gender Male, 96.6%
Confused 1.8%
Surprised 2.5%
Calm 86.1%
Sad 3.2%
Happy 2.3%
Disgusted 1.9%
Angry 2.3%

AWS Rekognition

Age 26-43
Gender Male, 95.2%
Disgusted 3.2%
Happy 42.1%
Surprised 9.2%
Sad 3.6%
Angry 5%
Confused 3.2%
Calm 33.9%

AWS Rekognition

Age 35-55
Gender Male, 64.3%
Angry 2.5%
Happy 4%
Confused 2.3%
Calm 74.7%
Disgusted 6.8%
Sad 5%
Surprised 4.6%

Feature analysis

Amazon

Person 98.9%
Tie 91.4%
Chair 85.1%

Captions

Microsoft

a group of people posing for a photo 83%
a group of people posing for a photo in front of a window 78.2%
a group of people posing for a picture 78.1%