Human Generated Data

Title

Untitled (wedding party)

Date

1940s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3305

Human Generated Data

Title

Untitled (wedding party)

People

Artist: Unidentified Artist,

Date

1940s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Person 98.9
Human 98.9
Person 98.5
Person 98.4
Person 98.2
Person 97.5
Person 97.3
Dress 95.2
Evening Dress 94.1
Gown 94.1
Fashion 94.1
Robe 94.1
Person 94
Person 93.8
Female 89.9
Tie 86.3
Accessory 86.3
Accessories 86.3
People 78.1
Woman 76.9
Coat 72.8
Overcoat 72.8
Sleeve 59.5
Wedding 58.8
Suit 57.7

Imagga
created on 2022-01-08

groom 100
bride 70.3
wedding 59.8
dress 55.1
couple 53.2
love 49.7
bouquet 47.2
happiness 41.5
married 39.3
marriage 38.9
flowers 33
people 32.9
happy 29.5
kin 29.2
veil 28.4
gown 25.4
adult 24.2
two 23.7
person 23.6
man 23.5
attendant 23.5
male 22.7
wed 22.6
ceremony 22.3
fashion 21.9
wife 21.8
celebration 21.5
bridal 21.4
portrait 19.4
romance 18.8
family 18.7
flower 18.5
together 18.4
husband 17.7
day 16.5
attractive 16.1
romantic 16
elegance 16
smiling 15.9
outdoors 15.7
engagement 15.4
women 15
smile 15
church 14.8
human 14.2
cheerful 13.8
commitment 13.8
event 12.9
men 12.9
life 12.7
suit 12.6
holding 12.4
summer 12.2
relationship 12.2
matrimony 11.8
outdoor 11.5
face 11.4
newly 10.9
standing 10.4
hands 10.4
pair 10.4
party 10.3
hair 10.3
clothing 10.2
hand 9.9
pretty 9.8
new 9.7
loving 9.5
model 9.3
future 9.3
joy 9.2
park 9.1
old 9.1
black 9
bridegroom 8.9
wedded 8.9
tuxedo 8.9
brunette 8.7
youth 8.5
rose 8.4
emotion 8.3
gorgeous 8.2
lady 8.1
sexy 8
handsome 8
lifestyle 8
cute 7.9
nuptials 7.9
engaged 7.9
holiday 7.9
embrace 7.8
union 7.7
outside 7.7
formal 7.6
studio 7.6
clothes 7.5
style 7.4
joyful 7.4
dinner dress 7.3
group 7.3
pose 7.3
religion 7.2
posing 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 99.9
posing 99.9
standing 98.6
dress 98.2
clothing 95.8
woman 94.8
man 92.9
smile 88.7
text 83.9
wedding dress 81.9
group 81.3
bride 74
old 67.8
white 63.9
suit 60
people 59.6
clothes 23.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 100%
Happy 80.4%
Surprised 10.2%
Fear 2.3%
Angry 2.3%
Calm 2%
Confused 1.2%
Sad 0.8%
Disgusted 0.8%

AWS Rekognition

Age 35-43
Gender Female, 100%
Happy 98.4%
Surprised 0.6%
Calm 0.4%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 84.7%
Sad 7.2%
Happy 2.7%
Confused 1.8%
Angry 1.2%
Surprised 0.9%
Fear 0.9%
Disgusted 0.6%

AWS Rekognition

Age 14-22
Gender Female, 100%
Calm 95.4%
Confused 1.4%
Happy 0.8%
Surprised 0.7%
Angry 0.6%
Sad 0.5%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 21-29
Gender Male, 100%
Happy 48.6%
Calm 18.2%
Angry 13.2%
Surprised 8.8%
Confused 4.2%
Fear 2.7%
Disgusted 2.4%
Sad 2%

AWS Rekognition

Age 24-34
Gender Female, 100%
Happy 97.1%
Surprised 0.7%
Angry 0.5%
Calm 0.4%
Confused 0.4%
Fear 0.3%
Disgusted 0.3%
Sad 0.3%

AWS Rekognition

Age 34-42
Gender Male, 100%
Happy 99.4%
Calm 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%
Sad 0%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 62.9%
Happy 30.5%
Confused 2.6%
Surprised 1.6%
Angry 0.8%
Sad 0.6%
Fear 0.5%
Disgusted 0.5%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Tie 86.3%

Captions

Microsoft

a group of people posing for a photo 98.9%
a person standing in front of a group of people posing for a photo 96.7%
a person standing in front of a group of people posing for a photo 96.5%