Human Generated Data

Title

Untitled (young couple dancing, stream of light)

Date

1965

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19293

Human Generated Data

Title

Untitled (young couple dancing, stream of light)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Clothing 99.3
Apparel 99.3
Human 99
Person 99
Person 98.4
Person 97.1
Evening Dress 95.8
Fashion 95.8
Gown 95.8
Robe 95.8
Person 95.7
Sleeve 75.2
Long Sleeve 75.2
Door 69.9
Female 66
Woman 59.9
Advertisement 58.4
Poster 58.4
Suit 56
Coat 56
Overcoat 56
Costume 55

Imagga
created on 2022-02-25

groom 51.6
dress 47.9
boutique 43.8
bride 40.9
wedding 35.9
couple 25.3
love 24.5
fashion 23.4
adult 23
marriage 22.8
person 21.9
people 21.8
attractive 17.5
happiness 17.2
bouquet 17
happy 16.9
sexy 16.9
pretty 16.8
man 16.1
women 15.8
clothing 15.6
portrait 15.5
married 15.3
model 14.8
standing 14.8
gown 14.6
domestic 14.5
lady 13.8
looking 13.6
locker 13.3
male 12.8
hair 12.7
lifestyle 12.3
brunette 12.2
flowers 12.2
dinner dress 12.1
celebration 12
style 11.9
elegance 11.8
bridal 11.7
ceremony 11.6
indoors 11.4
smile 11.4
wife 11.4
luxury 11.1
two 11
black 11
romantic 10.7
posing 10.7
fastener 10.6
clothes 10.3
cute 10
outfit 10
romance 9.8
lovely 9.8
together 9.6
dance 9.6
stand 9.5
day 9.4
smiling 9.4
church 9.2
face 9.2
flower 9.2
holding 9.1
gorgeous 9.1
pose 9.1
one 9
family 8.9
interior 8.8
wall 8.6
passion 8.5
attendant 8.4
long 8.3
restraint 8.2
device 8.1
husband 8
veil 7.8
party 7.7
engagement 7.7
youth 7.7
formal 7.6
human 7.5
professional 7.5
cheerful 7.3
sensuality 7.3
make 7.3
holiday 7.2
dancer 7.1

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99.5
wall 99.3
dress 98.5
wedding dress 98.3
bride 96.7
person 95.4
indoor 94.9
clothing 85.4
woman 84.3
wedding 83.3
standing 81.8
smile 75
posing 56.6
suit 54.3
picture frame 8.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Happy 45.7%
Calm 22.7%
Disgusted 18.7%
Confused 5.5%
Surprised 3.2%
Sad 2%
Angry 1.2%
Fear 1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 98.6%
Sad 0.6%
Angry 0.3%
Confused 0.3%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 98.6%
Confused 0.5%
Surprised 0.3%
Sad 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 54-62
Gender Female, 100%
Happy 75.7%
Fear 8.7%
Angry 5.8%
Surprised 4.3%
Calm 3%
Confused 1.2%
Disgusted 0.9%
Sad 0.4%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 60.9%
Sad 20.7%
Angry 9.3%
Confused 3.1%
Happy 1.9%
Surprised 1.6%
Disgusted 1.5%
Fear 0.8%

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Poster 58.4%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 86.5%
a person standing in a room 86.4%
a man and a woman standing in a room 86.3%

Text analysis

Amazon

65
JAN
121
132

Google

121 132
121
132