Human Generated Data

Title

Untitled (San Gennaro Festival, Mulberry Street, New York City)
Date

September 1950
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4341.1
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (San Gennaro Festival, Mulberry Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

September 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4341.1

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

People 99.8
Clothing 97.7
Dress 97.7
Person 97.2
Person 95
Adult 95
Male 95
Man 95
Crowd 94.8
Person 93.5
Person 93.3
Person 93.1
Person 91.6
Person 91.2
Adult 91.2
Male 91.2
Man 91.2
Person 90.2
Person 90.1
Person 90
Kindergarten 89.7
Face 88.7
Head 88.7
Person 88.5
Person 87.7
Baby 87.7
Person 87.3
Person 87.1
Person 87.1
Adult 87.1
Male 87.1
Man 87.1
Person 86.9
Person 86.6
Person 86
Person 85.6
Person 85.1
Person 84.9
Person 84.4
Person 84.2
Person 82.8
Person 80.6
Person 79.4
Person 77.4
Formal Wear 77.3
Person 77.1
Child 77.1
Female 77.1
Girl 77.1
Person 76.9
Person 76.6
Person 76.3
Person 75.9
Adult 75.9
Male 75.9
Man 75.9
Person 75.1
Footwear 74.8
Shoe 74.8
Person 73.5
Person 72.9
Fashion 72.5
Gown 72.5
Person 71.5
Person 70.6
Person 68
Person 67.2
Person 66.1
Person 65.2
Person 64.4
Person 63
Person 61
Person 60.9
Audience 60.4
Person 59.4
Person 57.5
Architecture 56.9
Building 56.9
Classroom 56.9
Indoors 56.9
Room 56.9
School 56.9
Shoe 56.7
Hat 55.9

Clarifai
created on 2018-05-09

people 100
many 99.8
group 99.6
group together 98.8
child 97.3
adult 95.4
crowd 95.1
administration 94.8
man 93.2
leader 89.6
military 88.2
woman 87.9
wear 85.9
outfit 83.7
uniform 83.2
war 83
boy 81.3
recreation 80.9
education 80.4
several 80.1

Imagga
created on 2023-10-07

people 32.3
man 27.5
room 25.9
person 25.6
classroom 25.3
male 24.1
happy 21.3
teacher 20.7
world 20.3
men 18.9
portrait 18.7
senior 18.7
couple 18.3
adult 16.8
old 16.7
family 16
smiling 15.9
love 15.8
women 14.2
happiness 14.1
group 13.7
child 13.6
home 13.5
spectator 13.1
smile 12.8
mother 12.6
black 12.6
kin 11.6
student 11.4
education 11.2
school 11.1
newspaper 11.1
together 10.5
two 10.2
educator 9.9
hand 9.9
business 9.7
professional 9.7
married 9.6
vintage 9.1
new 8.9
blackboard 8.8
teaching 8.8
youth 8.5
product 8.5
friends 8.4
friendship 8.4
human 8.2
time 8.2
cheerful 8.1
businessman 7.9
daughter 7.9
holiday 7.9
seniors 7.8
face 7.8
ancient 7.8
sepia 7.8
sitting 7.7
bride 7.7
husband 7.6
marriage 7.6
togetherness 7.5
creation 7.5
wedding 7.3
aged 7.2
lifestyle 7.2
violin 7.2
team 7.2
history 7.1
handsome 7.1
night 7.1

Google
created on 2018-05-09

people 95.8
photograph 95.4
black and white 93.8
monochrome photography 87.7
photography 79.6
monochrome 74.6
crowd 71.1
child 66.5
religion 62.1
girl 59.4
recreation 56.2
style 50.2

Microsoft
created on 2018-05-09

person 91.5
text 89.4
player 81.8
old 45.6
posing 42
female 25.1
crowd 21.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 21-29
Gender Male, 86.6%
Happy 70.1%
Sad 15.8%
Calm 11.4%
Surprised 6.7%
Fear 6.1%
Confused 1%
Disgusted 0.6%
Angry 0.4%

AWS Rekognition

Age 23-31
Gender Male, 95.9%
Calm 88.7%
Surprised 6.4%
Fear 6.1%
Angry 4.6%
Sad 2.7%
Happy 2.4%
Disgusted 1.3%
Confused 0.6%

AWS Rekognition

Age 13-21
Gender Male, 97.2%
Calm 55.9%
Happy 18.2%
Sad 16.2%
Surprised 7.8%
Fear 6.3%
Disgusted 3.2%
Angry 2.8%
Confused 0.8%

AWS Rekognition

Age 23-31
Gender Male, 54.9%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.4%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 29-39
Gender Female, 100%
Calm 76.4%
Happy 8.6%
Surprised 6.7%
Fear 6.3%
Angry 5.5%
Sad 3.1%
Disgusted 2.8%
Confused 2%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Sad 57.9%
Calm 56.4%
Surprised 6.9%
Fear 6.9%
Happy 4.2%
Angry 2.6%
Confused 2.4%
Disgusted 1.5%

AWS Rekognition

Age 24-34
Gender Male, 67.3%
Sad 88.6%
Calm 39.2%
Angry 9.4%
Surprised 7.3%
Fear 6%
Disgusted 3.8%
Confused 2.8%
Happy 1.4%

AWS Rekognition

Age 22-30
Gender Male, 88.2%
Happy 90.9%
Surprised 6.5%
Fear 6%
Calm 2.8%
Sad 2.8%
Angry 2.5%
Disgusted 0.8%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 55.3%
Calm 91%
Surprised 6.4%
Fear 5.9%
Happy 5.6%
Sad 2.7%
Confused 0.8%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 37-45
Gender Male, 98.8%
Sad 97.4%
Calm 42.8%
Surprised 6.5%
Fear 6%
Confused 2.6%
Happy 0.7%
Angry 0.6%
Disgusted 0.4%

AWS Rekognition

Age 4-12
Gender Female, 74.6%
Happy 91.9%
Calm 7.3%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 27-37
Gender Male, 56.3%
Sad 46.2%
Calm 44.3%
Happy 21.3%
Surprised 6.7%
Fear 6.2%
Disgusted 3%
Angry 2.2%
Confused 1.7%

AWS Rekognition

Age 36-44
Gender Male, 93.1%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 1%
Happy 0.4%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Male, 95.4%
Happy 47.1%
Surprised 19.9%
Disgusted 14%
Fear 8.2%
Sad 4.8%
Confused 4.6%
Calm 4.1%
Angry 3.8%

AWS Rekognition

Age 1-7
Gender Male, 96.6%
Fear 76%
Happy 18.5%
Sad 13.5%
Surprised 6.7%
Angry 3.1%
Calm 1.9%
Confused 1.8%
Disgusted 1.4%

AWS Rekognition

Age 21-29
Gender Female, 88.6%
Angry 37%
Happy 33.1%
Fear 12.2%
Calm 7.2%
Surprised 7%
Sad 4.6%
Disgusted 2%
Confused 1.9%

AWS Rekognition

Age 21-29
Gender Male, 96.9%
Sad 93.8%
Calm 21.8%
Fear 15.4%
Surprised 7.2%
Happy 6.7%
Confused 5%
Disgusted 1.9%
Angry 1.2%

AWS Rekognition

Age 26-36
Gender Male, 97.2%
Disgusted 35.3%
Happy 22.2%
Calm 12.8%
Sad 12.3%
Surprised 8.1%
Angry 7.9%
Fear 6.6%
Confused 3.7%

AWS Rekognition

Age 26-36
Gender Female, 57.7%
Calm 40.5%
Happy 39.5%
Disgusted 10.4%
Surprised 6.9%
Fear 6.2%
Sad 4.6%
Angry 1.4%
Confused 0.7%

AWS Rekognition

Age 14-22
Gender Female, 65.3%
Sad 95.6%
Happy 25.4%
Calm 13.6%
Surprised 7.5%
Fear 6.5%
Angry 4.1%
Disgusted 3.2%
Confused 1.4%

AWS Rekognition

Age 24-34
Gender Male, 95.3%
Happy 50.2%
Calm 45.3%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Angry 1.9%
Disgusted 0.9%
Confused 0.6%

AWS Rekognition

Age 23-31
Gender Male, 68.2%
Calm 47%
Angry 27.3%
Sad 16.4%
Fear 8.4%
Surprised 7.1%
Disgusted 1.4%
Confused 0.9%
Happy 0.7%

AWS Rekognition

Age 16-24
Gender Female, 96.3%
Calm 53.5%
Disgusted 13.6%
Sad 12.5%
Happy 8.8%
Fear 8.5%
Surprised 6.9%
Angry 2.8%
Confused 1%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Disgusted 50%
Angry 12%
Surprised 11.1%
Confused 10.6%
Fear 9%
Calm 6.4%
Sad 3.6%
Happy 3.2%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Happy 60.1%
Surprised 9.4%
Calm 8.8%
Disgusted 7.8%
Fear 7.8%
Sad 5.4%
Angry 5.1%
Confused 1.9%

AWS Rekognition

Age 13-21
Gender Female, 87.3%
Happy 73.9%
Surprised 7.2%
Fear 6.5%
Angry 5.1%
Sad 4.8%
Confused 4.7%
Calm 4.2%
Disgusted 2.9%

Feature analysis

Amazon

Person
Adult
Male
Man
Baby
Child
Female
Girl
Shoe
Person 97.2%
Person 95%
Person 93.5%
Person 93.3%
Person 93.1%
Person 91.6%
Person 91.2%
Person 90.2%
Person 90.1%
Person 90%
Person 88.5%
Person 87.7%
Person 87.3%
Person 87.1%
Person 87.1%
Person 86.9%
Person 86.6%
Person 86%
Person 85.6%
Person 85.1%
Person 84.9%
Person 84.4%
Person 84.2%
Person 82.8%
Person 80.6%
Person 79.4%
Person 77.4%
Person 77.1%
Person 76.9%
Person 76.6%
Person 76.3%
Person 75.9%
Person 75.1%
Person 73.5%
Person 72.9%
Person 71.5%
Person 70.6%
Person 68%
Person 67.2%
Person 66.1%
Person 65.2%
Person 64.4%
Person 63%
Person 61%
Person 60.9%
Person 59.4%
Person 57.5%
Adult 95%
Adult 91.2%
Adult 87.1%
Adult 75.9%
Male 95%
Male 91.2%
Male 87.1%
Male 75.9%
Man 95%
Man 91.2%
Man 87.1%
Man 75.9%
Baby 87.7%
Child 77.1%
Female 77.1%
Girl 77.1%
Shoe 74.8%
Shoe 56.7%

Text analysis

Amazon

of
College
and
Art
(Harvard
Fellows
Museums)
Harvard
© President and Fellows of Harvard College (Harvard University Art Museums)
University
President
WINES
P1970.4341.0001
GRILL
©
IDAR A GRILL
BER WINES D LEQUORES
BER
D
LEQUORES
IDAR A
MARAGHAHO
MARAGHAHO ITEL
ITEL

Google

© President and Fellows of Harvard College (Harvard University Art Museums) P1970.4341.0001
©
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.4341.0001