Human Generated Data

Title

Untitled (Studio family portrait of couple with two children. Man, seated, holds infant)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3650

Human Generated Data

Title

Untitled (Studio family portrait of couple with two children. Man, seated, holds infant)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.4
Clothing 99.4
Furniture 98.9
Chair 98.9
Person 98.7
Human 98.7
Person 98.3
Person 97.5
Dress 97.4
Face 95.2
Person 90.2
Female 89.4
Sleeve 79.3
Plant 78.1
People 76.6
Kid 74.2
Child 74.2
Portrait 74.2
Photography 74.2
Photo 74.2
Girl 73.4
Costume 73.1
Door 72.9
Floor 70.2
Smile 69.1
Overcoat 65.2
Suit 65.2
Coat 65.2
Woman 64.8
Blossom 61.3
Flower 61.3
Shirt 58.9
Grass 56.5
Fashion 56.4
Robe 56.4
Baby 55.3

Clarifai
created on 2019-06-01

people 99.9
adult 96.8
woman 95.6
wear 95.2
man 94.6
two 93.3
group 92.8
child 91.4
portrait 88.4
sit 82.7
retro 82.1
actress 81.7
one 79.7
three 78.4
group together 78.1
monochrome 77.1
administration 76.6
actor 76.4
leader 75.5
veil 75.3

Imagga
created on 2019-06-01

kin 98.8
groom 64.5
bride 44.2
couple 41.8
wedding 35.9
dress 32.5
love 32.4
people 30.1
happiness 28.2
married 27.8
bouquet 26.6
two 22.9
adult 22.8
happy 21.9
portrait 20.7
male 20.6
man 19.5
ceremony 19.4
gown 18.6
husband 18.3
wife 18
family 17.8
veil 17.6
person 17.5
flowers 17.4
marriage 17.1
celebration 16.8
wed 16.7
women 16.6
men 16.3
romance 16.1
smiling 15.9
mother 15.7
romantic 15.1
attractive 14.7
bridal 14.6
engagement 14.5
cheerful 13.8
fashion 13.6
home 13.6
smile 13.5
flower 13.1
elegance 12.6
together 12.3
lady 12.2
day 11.8
indoors 11.4
face 11.4
rose 11.2
church 11.1
newly 10.9
life 10.8
parent 10.7
new 10.5
sexy 10.4
suit 9.9
old 9.8
loving 9.5
pair 9.4
passion 9.4
traditional 9.2
pretty 9.1
human 9
wedded 8.9
posing 8.9
tenderness 8.8
relationship 8.4
clothing 8.4
tradition 8.3
religion 8.1
look 7.9
matrimony 7.9
commitment 7.9
kiss 7.8
marble 7.8
sitting 7.7
tender 7.7
culture 7.7
senior 7.5
outdoors 7.5
event 7.4
room 7.3
nurse 7.2
cute 7.2
handsome 7.1
interior 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 98.9
clothing 96.3
human face 96.1
person 95
smile 91
old 66.5
posing 63.8
baby 55.4
boy 50.2

Face analysis

Amazon

AWS Rekognition

Age 19-36
Gender Female, 77.9%
Sad 50.7%
Angry 3.3%
Surprised 3.6%
Calm 20.1%
Disgusted 8.4%
Happy 10.7%
Confused 3.2%

AWS Rekognition

Age 26-43
Gender Male, 87.4%
Sad 11.8%
Angry 1.4%
Calm 83.2%
Confused 1.1%
Disgusted 0.5%
Happy 1.1%
Surprised 1%

AWS Rekognition

Age 23-38
Gender Female, 50.9%
Confused 45.3%
Sad 48.6%
Calm 48.1%
Happy 46.8%
Surprised 45.5%
Disgusted 45.4%
Angry 45.4%

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people posing for a photo 93.2%
a group of people posing for the camera 93.1%
a group of people posing for a picture 93%