Human Generated Data

Title

Untitled (San Gennaro Festival, Greenwich Village, New York City)

Date

September 1950

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3284

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (San Gennaro Festival, Greenwich Village, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

September 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3284

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Formal Wear 100
Adult 99
Male 99
Man 99
Person 99
Suit 98.8
Adult 98.7
Person 98.7
Bride 98.7
Female 98.7
Wedding 98.7
Woman 98.7
Adult 98.6
Person 98.6
Bride 98.6
Female 98.6
Woman 98.6
Adult 98
Male 98
Man 98
Person 98
Suit 97.8
Adult 97.2
Male 97.2
Man 97.2
Person 97.2
Adult 97.2
Male 97.2
Man 97.2
Person 97.2
Person 96.4
Person 95.5
Tuxedo 93.7
Person 93.1
Dress 93
Coat 92.4
People 92.1
Face 92
Head 92
Person 91.1
Adult 90.8
Male 90.8
Man 90.8
Person 90.8
Fashion 85
Accessories 82.5
Tie 82.5
Suit 76.9
Suit 76.1
Person 74
Photography 72.6
Suit 69.1
Crowd 68.3
Electrical Device 65.3
Microphone 65.3
Bridegroom 65
Gown 64.6
Person 64.4
Suit 63.5
Person 59
Portrait 56.6
Body Part 55.9
Finger 55.9
Hand 55.9
Jacket 55.6
Flower 55.6
Flower Arrangement 55.6
Flower Bouquet 55.6
Plant 55.6

Clarifai
created on 2018-05-10

people 99.9
many 99
group 98.6
leader 98.2
adult 97.4
administration 97.3
group together 94.7
chair 93.9
man 93.6
woman 92.3
wear 89.7
several 86.2
music 85.2
portrait 84.8
outfit 83.7
military 81.8
war 79.7
movie 78.3
crowd 77.6
actor 77.1

Imagga
created on 2023-10-07

groom 66.6
couple 43.6
man 39
people 34
male 32
adult 31.4
love 30
dress 28.9
person 26.1
happiness 24.3
happy 23.2
bride 23.2
suit 23.2
wedding 23
together 21.9
attractive 20.3
married 19.2
men 18.9
business 18.2
women 18.2
two 17.8
businessman 17.7
smile 16.4
portrait 16.2
marriage 16.1
smiling 15.9
bouquet 15.1
group 14.5
romantic 14.3
sexy 13.7
romance 13.4
lifestyle 13
handsome 12.5
corporate 12
husband 11.8
attendant 11.7
formal 11.5
pair 11.3
relationship 11.2
pretty 11.2
sitting 11.2
celebration 11.2
spectator 10.9
boyfriend 10.6
outdoors 10.4
office 10.4
flowers 10.4
wife 10.4
meeting 10.4
party 10.3
holding 9.9
fashion 9.8
bridal 9.7
girlfriend 9.6
looking 9.6
standing 9.6
businesspeople 9.5
elegant 9.4
work 9.4
executive 9.3
flower 9.2
bow tie 9.2
businesswoman 9.1
fun 9
cheerful 8.9
family 8.9
veil 8.8
hugging 8.8
black 8.7
gown 8.7
engagement 8.7
outside 8.6
passion 8.5
friends 8.5
elegance 8.4
building 8.3
teamwork 8.3
leisure 8.3
room 8.2
outfit 8.2
pose 8.2
team 8.1
clothing 8
night 8
staff 8
tuxedo 7.9
ceremony 7.8
life 7.7
professional 7.6
fan 7.4
20s 7.3
success 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 100
people 94.3
outdoor 93.7
standing 79.3
group 67.6
suit 63.6
crowd 27.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 67.4%
Angry 15.2%
Surprised 7.7%
Fear 6.8%
Confused 5.3%
Sad 3.1%
Disgusted 2.5%
Happy 1.8%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Sad 99.7%
Calm 25.3%
Fear 6.8%
Surprised 6.5%
Confused 2.1%
Angry 0.6%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 45-53
Gender Female, 100%
Sad 100%
Fear 6.4%
Surprised 6.4%
Calm 4.5%
Disgusted 2%
Confused 0.9%
Angry 0.7%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 71.4%
Confused 12.5%
Sad 11.2%
Surprised 6.4%
Fear 6%
Angry 2.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 48-56
Gender Female, 97.5%
Calm 83.8%
Happy 11.5%
Surprised 6.4%
Fear 6%
Sad 2.4%
Angry 2%
Disgusted 0.7%
Confused 0.6%

AWS Rekognition

Age 18-26
Gender Male, 98.6%
Happy 45.7%
Calm 19%
Fear 11%
Angry 8.2%
Surprised 6.9%
Sad 6.5%
Disgusted 5.3%
Confused 2.3%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Sad 100%
Surprised 6.5%
Fear 6.2%
Confused 5.4%
Calm 1.1%
Angry 0.8%
Happy 0.7%
Disgusted 0.5%

AWS Rekognition

Age 51-59
Gender Male, 98.3%
Angry 62%
Calm 33.3%
Surprised 7.1%
Fear 5.9%
Confused 2.5%
Sad 2.3%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 52-60
Gender Male, 99.4%
Calm 80.2%
Confused 9.5%
Surprised 7.1%
Fear 6.7%
Angry 3.5%
Sad 2.7%
Disgusted 0.8%
Happy 0.6%

AWS Rekognition

Age 40-48
Gender Male, 99.8%
Calm 71.7%
Sad 40.1%
Surprised 6.4%
Fear 6.3%
Angry 1.5%
Confused 1%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 54-64
Gender Male, 97.5%
Sad 55%
Calm 39.2%
Angry 10%
Fear 8.8%
Surprised 8.4%
Confused 8.3%
Disgusted 2.6%
Happy 1.6%

AWS Rekognition

Age 24-34
Gender Female, 93.8%
Surprised 57.9%
Happy 20.2%
Sad 16.6%
Disgusted 8.8%
Fear 7.8%
Angry 7.1%
Calm 5.9%
Confused 2.8%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 63
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99%
Male 99%
Man 99%
Person 99%
Suit 98.8%
Bride 98.7%
Female 98.7%
Woman 98.7%

Text analysis

Amazon

PATRON
SUP PATRON
SUP