Human Generated Data

Title

Untitled (formal studio portrait of family of adults and children in seated and standing poses)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3718

Human Generated Data

Title

Untitled (formal studio portrait of family of adults and children in seated and standing poses)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.6
Human 99.6
Person 99.3
Person 98.8
Person 98.8
People 98.1
Person 98.1
Person 97.8
Family 97.5
Person 97.4
Person 92.4
Clothing 91
Apparel 91
Photo 63.2
Photography 63.2
Accessory 60.5
Tie 60.5
Accessories 60.5
Female 57.2

Clarifai
created on 2019-06-01

people 99.9
group 98.3
adult 98.2
veil 96.1
group together 95.8
woman 95.1
wear 94.5
man 94.3
portrait 91.5
leader 89.1
child 89
wedding 88.5
several 86
music 82.2
four 81
administration 80.7
actor 78.8
many 78.8
five 76.5
outfit 76.3

Imagga
created on 2019-06-01

groom 94.3
bride 63.1
wedding 55.2
dress 47
negative 44.1
love 42.6
couple 39.2
marriage 38.9
married 37.4
film 34.9
happiness 33.7
bouquet 31.3
people 30.7
happy 27.6
photographic paper 27
veil 26.4
kin 25.2
gown 24.4
person 23.8
flowers 23.5
celebration 21.5
ceremony 21.3
fashion 21.1
wife 20.9
adult 20.5
bridal 20.4
man 20.2
two 19.5
wed 18.7
portrait 18.1
day 18
photographic equipment 18
women 17.4
romance 17
husband 15.8
together 15.8
smile 15.7
flower 15.4
romantic 15.1
face 14.9
male 14.9
attractive 14.7
cheerful 14.6
engagement 14.5
smiling 14.5
matrimony 13.8
human 13.5
outdoors 13.4
event 12.9
family 12.5
joy 11.7
holiday 11.5
men 11.2
church 11.1
elegance 10.9
commitment 10.8
outdoor 10.7
clothing 10.6
party 10.3
summer 10.3
art 10.1
suit 9.9
hand 9.9
pretty 9.8
marry 9.8
posing 9.8
lady 9.7
pair 9.4
rose 9.4
clothes 9.4
cute 9.3
girls 9.1
newlywed 9.1
holding 9.1
black 9
fun 9
tuxedo 8.9
looking 8.8
world 8.7
hair 8.7
hands 8.7
loving 8.6
model 8.6
youth 8.5
relationship 8.4
life 8.4
park 8.2
dance 8.2
group 8.1
bridegroom 7.9
nuptials 7.9
brunette 7.8
kiss 7.8
roses 7.8
old 7.7
formal 7.6
ring 7.6
future 7.4
new 7.3
blond 7.2

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 99.4
posing 98.8
wedding dress 95.5
clothing 93.7
old 91.9
bride 90.5
dress 79.3
standing 76.8
group 76
woman 73.8
player 69.2
smile 59.7

Face analysis

Amazon

AWS Rekognition

Age 15-25
Gender Female, 52.6%
Confused 45.4%
Surprised 45.5%
Sad 45.8%
Angry 45.2%
Happy 45.4%
Calm 52.4%
Disgusted 45.2%

AWS Rekognition

Age 23-38
Gender Female, 50.9%
Disgusted 45.1%
Sad 45.5%
Surprised 45.3%
Happy 45.2%
Angry 45.4%
Calm 53.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 96.5%
Disgusted 1.1%
Sad 3.1%
Confused 2.9%
Happy 4.7%
Angry 2.7%
Surprised 3.7%
Calm 81.7%

AWS Rekognition

Age 20-38
Gender Female, 52%
Confused 45.3%
Disgusted 45.2%
Happy 45.5%
Surprised 45.3%
Calm 51.1%
Sad 47.2%
Angry 45.3%

AWS Rekognition

Age 14-25
Gender Female, 54.8%
Disgusted 45.1%
Calm 51.2%
Sad 47.3%
Confused 45.4%
Angry 45.2%
Surprised 45.3%
Happy 45.5%

AWS Rekognition

Age 14-25
Gender Female, 54.8%
Disgusted 45.3%
Sad 46.2%
Happy 45.2%
Surprised 47%
Angry 45.5%
Calm 47.6%
Confused 48.2%

Feature analysis

Amazon

Person 99.6%
Tie 60.5%

Captions

Microsoft

a group of people posing for a photo 96.1%
a vintage photo of a group of people posing for the camera 94.4%
a vintage photo of a group of people posing for a picture 94.3%