Human Generated Data

Title

Untitled (couple standing next to six elderly women seated)

Date

c. 1939

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5701

Human Generated Data

Title

Untitled (couple standing next to six elderly women seated)

People

Artist: Durette Studio, American 20th century

Date

c. 1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.6
Person 99.6
Clothing 99.6
Apparel 99.6
Person 99.4
Person 99.3
Person 99.2
Person 99
Person 99
Person 97.9
Dress 97.8
Person 97.7
Female 91.4
People 82.7
Sleeve 82.3
Face 82.2
Shorts 80.1
Woman 77.9
Shoe 77.4
Footwear 77.4
Accessory 69.6
Accessories 69.6
Tie 69.6
Girl 68.5
Overcoat 66.3
Suit 66.3
Coat 66.3
Shoe 65.7
Long Sleeve 65
Photography 64.6
Photo 64.6
Portrait 64.6
Costume 59.1
Bag 58.7
Crowd 56.7
Kid 55.2
Child 55.2

Clarifai
created on 2019-06-01

people 99.9
group 99.3
adult 99
woman 97.7
man 97.7
group together 97.2
child 93.7
portrait 91.3
several 90.7
five 87.2
wear 85.1
facial expression 81.7
many 80.6
leader 80.3
four 79.8
offspring 79.3
wedding 77.9
indoors 76.7
uniform 72.6
monochrome 72.2

Imagga
created on 2019-06-01

kin 88.5
people 34
happy 25.7
man 25.5
male 25.5
person 25.1
adult 24.5
couple 24.4
portrait 22
nurse 21.4
men 20.6
bride 19.2
dress 19
group 17.7
smiling 17.3
happiness 17.2
groom 16.7
women 16.6
business 16.4
businessman 15.9
family 15.1
medical 15
senior 15
love 15
wedding 14.7
professional 14.1
two 13.5
team 13.4
marriage 13.3
old 13.2
together 13.1
mother 12.8
human 12.7
golfer 12.5
married 12.5
bouquet 12.3
husband 11.6
home 11.2
mature 11.1
20s 11
hospital 10.6
child 10.6
30s 10.6
cheerful 10.6
standing 10.4
looking 10.4
celebration 10.4
lifestyle 10.1
smile 10
brass 9.9
worker 9.8
fashion 9.8
player 9.8
daughter 9.7
indoors 9.7
elderly 9.6
hands 9.5
day 9.4
doctor 9.4
camera 9.2
aged 9
lady 8.9
job 8.8
flowers 8.7
wife 8.5
face 8.5
casual 8.5
friends 8.4
black 8.4
elegance 8.4
care 8.2
businesswoman 8.2
suit 8.1
father 8
medicine 7.9
patient 7.9
holiday 7.9
wind instrument 7.9
brunette 7.8
bridal 7.8
ceremony 7.8
sitting 7.7
attractive 7.7
contestant 7.7
health 7.6
holding 7.4
teamwork 7.4
teacher 7.3
romance 7.1
handsome 7.1
romantic 7.1
to 7.1
look 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 93.2
posing 90.8
clothing 86.3
standing 84.9
old 80.4
smile 77
group 67
woman 62.1
dress 56.7

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Female, 51.8%
Confused 46.2%
Surprised 45.8%
Happy 46.7%
Angry 45.7%
Sad 46.7%
Disgusted 45.7%
Calm 48.3%

AWS Rekognition

Age 57-77
Gender Male, 98.2%
Sad 9.7%
Surprised 6.6%
Happy 37%
Angry 3.8%
Calm 28.5%
Confused 4.1%
Disgusted 10.3%

AWS Rekognition

Age 48-68
Gender Male, 54%
Disgusted 46.3%
Sad 45.3%
Confused 46%
Happy 46.5%
Angry 45.2%
Surprised 45.4%
Calm 50.3%

AWS Rekognition

Age 35-52
Gender Male, 82.8%
Sad 5.8%
Angry 1.5%
Surprised 2.9%
Calm 78.7%
Disgusted 1.1%
Happy 7.4%
Confused 2.5%

AWS Rekognition

Age 35-55
Gender Male, 54.5%
Sad 45.3%
Surprised 45.6%
Disgusted 45.3%
Angry 45.3%
Calm 52.6%
Happy 45.6%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 55%
Confused 45.1%
Happy 45.2%
Surprised 45.1%
Angry 45.1%
Disgusted 45%
Calm 54.4%
Sad 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Happy 52.6%
Disgusted 45.1%
Angry 45.3%
Surprised 45.6%
Sad 45.4%
Calm 45.7%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Sad 45.6%
Confused 45.2%
Disgusted 45.2%
Surprised 45.6%
Angry 45.2%
Happy 48.6%
Calm 49.5%

Feature analysis

Amazon

Person 99.6%
Shoe 77.4%
Tie 69.6%

Captions

Microsoft

a group of people posing for a photo 96.7%
an old photo of a group of people posing for the camera 95.9%
an old photo of a group of people posing for a picture 95.8%