Human Generated Data

Title

Untitled (nine member family portrait on porch of house)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3678

Human Generated Data

Title

Untitled (nine member family portrait on porch of house)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.6
Human 99.6
Apparel 99.4
Clothing 99.4
Person 99
Person 98.7
Person 97.9
Person 97.6
Person 97.6
Person 96.5
People 94.9
Person 90.8
Dress 80
Family 75.8
Person 75.5
Coat 72.9
Suit 72.9
Overcoat 72.9
Female 70.1
Door 62.6
Sleeve 57.6
Robe 55.6
Fashion 55.6

Clarifai
created on 2019-06-01

people 99.9
group 98.6
group together 98.1
leader 96.3
adult 96.1
administration 95.4
many 94.5
several 92.9
wear 92.8
woman 90.8
man 90.1
five 88.7
four 88.3
three 84.7
outfit 82.4
veil 79.6
actress 79.5
chair 78.8
actor 76.5
home 76.1

Imagga
created on 2019-06-01

nurse 75.2
groom 56.8
bride 35.3
couple 34.8
people 31.2
man 28.2
wedding 27.6
person 27.1
happy 26.3
male 26.2
adult 26.2
love 25.2
happiness 25.1
two 23.7
dress 23.5
married 21.1
bouquet 20
clothing 18.2
marriage 18
kin 18
family 17.8
together 17.5
portrait 17.5
men 17.2
smiling 16.6
day 16.5
businessman 15.9
smile 15
gown 14.8
ceremony 14.5
husband 14.3
women 14.2
wife 14.2
bridal 13.6
standing 13
flowers 12.2
looking 12
celebration 12
40s 11.7
business 11.5
fan 11.4
face 11.4
fashion 11.3
group 11.3
home 11.2
church 11.1
lab coat 10.6
new 10.5
life 10.5
professional 10
suit 9.9
matrimony 9.8
attractive 9.8
formal 9.5
adults 9.5
mature 9.3
elegance 9.2
follower 9.2
old 9.1
human 9
outdoors 9
cheerful 8.9
romance 8.9
lady 8.9
romantic 8.9
veil 8.8
indoors 8.8
full length 8.7
mid adult 8.7
mother 8.7
30s 8.7
coat 8.6
daughter 8.6
corporate 8.6
businesspeople 8.5
flower 8.5
clothes 8.4
black 8.4
health 8.3
emotion 8.3
20s 8.2
businesswoman 8.2
team 8.1
medical 7.9
bridegroom 7.9
wed 7.9
teacher 7.8
colleagues 7.8
pretty 7.7
partnership 7.7
doctor 7.5
future 7.4
room 7.4
holding 7.4
teamwork 7.4
girls 7.3
lifestyle 7.2
worker 7.2
holiday 7.2
hair 7.1
handsome 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

outdoor 98.9
person 97.2
clothing 95.7
wedding dress 92.7
woman 84
bride 82.9
black 82
standing 80.6
dress 76.8
white 66.6
people 61.2
man 57.8
posing 53.5

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 53.4%
Calm 50%
Disgusted 45.1%
Confused 45.7%
Surprised 45.5%
Happy 45.2%
Sad 48.3%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Female, 54.2%
Disgusted 45.3%
Calm 50.6%
Sad 46.3%
Confused 45.3%
Angry 45.6%
Surprised 45.6%
Happy 46.3%

AWS Rekognition

Age 19-36
Gender Female, 54.1%
Disgusted 48.2%
Calm 49.3%
Surprised 45.3%
Angry 45.2%
Happy 45.4%
Sad 46.3%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Disgusted 45.6%
Calm 46.9%
Surprised 45.8%
Angry 46.1%
Happy 47.8%
Sad 47.1%
Confused 45.6%

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people standing in front of a building 96.3%
a group of people posing for a photo 95.6%
a group of people standing in front of a train 86.2%