Human Generated Data

Title

Untitled (wedding reception)
Date

1970s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3389

Human Generated Data

Title

Untitled (wedding reception)

People

Artist: Unidentified Artist,

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 100
Apparel 100
Hat 99.8
Person 99.6
Human 99.6
Person 99.5
Person 99.4
Person 99.1
Dress 94.8
Female 88.6
Face 85.6
Sun Hat 81.3
Woman 74.2
People 62.9
Evening Dress 62
Fashion 62
Robe 62
Gown 62
Plant 60.3
Girl 60.1
Photography 58.8
Portrait 58.8
Photo 58.8
Flower 58.5
Blossom 58.5
Overcoat 57.8
Coat 57.8
Suit 57.8

Imagga
created on 2022-02-26

smiling 38.4
happy 34.5
people 34
couple 34
person 31.5
man 28.2
adult 28.2
mortarboard 27.1
happiness 26.6
together 25.4
male 25
smile 25
women 24.5
love 24.5
cheerful 24.4
pretty 23.1
cap 21.9
clothing 21.8
portrait 20.7
fun 20.2
student 20
lifestyle 19.5
mother 18.8
child 18.3
oriental 18.3
fashion 17.3
two 16.9
friends 16.9
family 16.9
headdress 16.5
holding 16.5
buddy 16.3
attractive 16.1
cute 15.8
shopping 14.7
girls 14.6
casual 14.4
boy 13.9
sitting 13.7
mall 13.6
husband 13.4
looking 12.8
shopper 12.7
dress 12.7
customer 12.4
wife 12.3
sexy 12.1
girlfriend 11.6
hand 11.4
lady 11.4
laughing 11.3
group 11.3
relationship 11.2
friendship 11.2
expression 11.1
youth 11.1
20s 11
groom 11
handsome 10.7
face 10.7
parent 10.6
brunette 10.5
standing 10.4
enrollee 10.4
togetherness 10.4
home 10.4
enjoyment 10.3
camera 10.2
leisure 10
boyfriend 9.6
date 9.6
shop 9.6
ethnic 9.5
hair 9.5
party 9.5
pair 9.4
outside 9.4
holiday 9.3
positive 9.2
pink 9.2
joyful 9.2
drink 9.2
outdoor 9.2
children 9.1
color 8.9
daughter 8.8
indoors 8.8
joy 8.4
outdoors 8.2
teenager 8.2
romantic 8
kid 8
interior 8
education 7.8
consumer goods 7.7
covering 7.7
married 7.7
enjoying 7.6
alcohol 7.4
emotion 7.4
indoor 7.3
gown 7.2
celebration 7.2
romance 7.1
to 7.1
life 7.1
summer 7.1
day 7.1
look 7

Google
created on 2022-02-26

Clothing 98.7
Photograph 94.2
Smile 89.7
Hat 89.5
Purple 88.2
Fashion 87.8
Happy 87.4
Sun hat 85.9
Yellow 84.4
One-piece garment 84.4
Pink 83.5
Fedora 81.4
Fun 79.4
Fashion design 78.6
Friendship 74.7
Event 74.6
Magenta 72.8
Formal wear 72.6
Decoration 72.3
Day dress 69.3

Microsoft
created on 2022-02-26

person 100
fashion accessory 99.2
wall 97.8
hat 97.3
smile 97.2
indoor 96.7
human face 95.8
clothing 93.9
woman 92.5
dress 89.5
girl 82.6
sun hat 77.2
fedora 72.2
cowboy hat 52.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Female, 100%
Happy 99.2%
Surprised 0.5%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%
Calm 0%

AWS Rekognition

Age 21-29
Gender Female, 85.8%
Calm 98.6%
Surprised 0.7%
Happy 0.2%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 82.1%
Calm 12.6%
Sad 1.4%
Confused 1.4%
Fear 1.1%
Surprised 0.5%
Disgusted 0.5%
Angry 0.4%

AWS Rekognition

Age 30-40
Gender Female, 100%
Happy 64.9%
Calm 30.1%
Disgusted 1.4%
Angry 1%
Sad 0.9%
Confused 0.7%
Surprised 0.5%
Fear 0.5%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 99.6%

Captions

Microsoft

a woman holding a birthday cake 74.4%
a woman holding a cake 74.3%
a woman standing in front of a cake 74.2%