Human Generated Data

Title

The Burtons, Academy Awards

Date

1978

People

Artist: Robert Cumming, American 1943 -

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.92

Copyright

© Robert Cumming / Artists Rights Society (ARS), New York

Human Generated Data

Title

The Burtons, Academy Awards

People

Artist: Robert Cumming, American 1943 -

Date

1978

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.4
Human 99.4
Tie 98.4
Accessories 98.4
Accessory 98.4
Person 97.7
Person 95
Fashion 95
Person 93.6
Premiere 93.5
Person 92.7
Clothing 85.2
Robe 85.2
Gown 85.2
Apparel 85.2
Evening Dress 85.2
Suit 71.5
Coat 71.5
Overcoat 71.5
Hair 69.9

Imagga
created on 2022-02-26

bow tie 76
necktie 58.9
adult 39.6
couple 38.3
man 37
love 34.7
people 34
groom 33.4
male 31.2
garment 29.9
portrait 29.8
person 28.9
attractive 26.6
dress 25.3
happiness 25.1
happy 24.4
sexy 21.7
clothing 21.6
suit 21.5
wedding 20.2
together 20.2
black 20.1
fashion 19.6
bride 19.2
married 19.2
two 18.6
smile 18.5
mask 18.4
handsome 17.8
women 17.4
smiling 17.4
party 17.2
men 15.5
studio 15.2
face 14.9
celebration 14.4
romance 14.3
fun 14.2
pretty 14
boyfriend 13.5
elegant 12.9
attendant 12.7
romantic 12.5
bouquet 12.3
passion 12.2
husband 12.1
model 11.7
girlfriend 11.5
covering 11.4
cheerful 11.4
brunette 11.3
friendship 11.2
luxury 11.1
lifestyle 10.8
lady 10.6
disguise 10.5
group 10.5
marriage 10.4
tie 10.4
flower 10
lovers 9.7
look 9.6
hair 9.5
wife 9.5
pair 9.4
togetherness 9.4
friends 9.4
expression 9.4
entertainment 9.2
costume 9.2
sensual 9.1
guy 9.1
sensuality 9.1
holding 9.1
pose 9.1
style 8.9
family 8.9
night 8.9
businessman 8.8
standing 8.7
flowers 8.7
club 8.5
elegance 8.4
vintage 8.3
retro 8.2
lovely 8
looking 8
posing 8
spectator 7.9
business 7.9
cute 7.9
nightclub 7.8
hands 7.8
kiss 7.8
erotic 7.8
attire 7.8
dancer 7.7
date 7.7
performer 7.6
joy 7.5
human 7.5
relationship 7.5
rose 7.5
glasses 7.4
make 7.3

Google
created on 2022-02-26

Dress 88.8
Flash photography 87.9
Coat 86.6
Tie 81.1
Fashion design 79.5
Formal wear 78.4
Blazer 78.1
Suit 77.8
Prom 76.6
Event 74.2
Bow tie 73.4
Fun 72.5
Gown 71.9
Haute couture 68.9
Strapless dress 66.5
Cocktail dress 65.2
Jewellery 62
Entertainment 61.1
Tuxedo 60.7
Ceremony 60.4

Microsoft
created on 2022-02-26

person 99.5
dress 98.4
suit 97.4
man 95.6
clothing 94
wedding 91
text 89.3
wedding dress 88.7
necktie 87.1
human face 85
bride 82.6
dance 79.1
smile 70.7
woman 64.1
posing 62

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-58
Gender Male, 100%
Angry 72.3%
Fear 14.7%
Surprised 3.7%
Confused 2.7%
Happy 2.1%
Disgusted 1.9%
Sad 1.7%
Calm 0.7%

AWS Rekognition

Age 39-47
Gender Male, 99.8%
Surprised 29.9%
Calm 29.5%
Angry 11.1%
Fear 10.9%
Disgusted 5.8%
Confused 5%
Sad 4.9%
Happy 3%

AWS Rekognition

Age 51-59
Gender Female, 98.6%
Sad 35.5%
Happy 18.3%
Surprised 17.4%
Angry 8%
Fear 6.4%
Disgusted 6.4%
Calm 4.2%
Confused 3.8%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 43.3%
Fear 28.4%
Sad 16.4%
Angry 7.9%
Surprised 1.7%
Disgusted 1.1%
Confused 0.7%
Happy 0.5%

AWS Rekognition

Age 21-29
Gender Male, 97.6%
Fear 72.5%
Sad 17.3%
Calm 8.1%
Angry 0.6%
Surprised 0.6%
Happy 0.4%
Disgusted 0.2%
Confused 0.2%

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 98.4%
Suit 71.5%

Captions

Microsoft

Richard Burton wearing a suit and tie 96.7%
Richard Burton et al. wearing a suit and tie 93.3%
Richard Burton wearing a suit and tie standing next to a woman 93.2%