Human Generated Data

Title

Untitled (Jewish children between First and Second Avenues, New York City)

Date

1931-1932

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2975

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Jewish children between First and Second Avenues, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1931-1932

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-10

Human 99.8
Person 99.8
Clothing 99.7
Apparel 99.7
Person 99.3
Person 99.1
Person 96.7
Face 87.3
Hat 79.4
People 78.4
Female 76.3
Cap 72.4
Girl 67.7
Photography 60.3
Photo 60.3
Portrait 59.1
Bonnet 56.9
Brick 56.8

Imagga
created on 2022-06-10

people 31.2
adult 31.1
child 29.6
happy 29.5
portrait 29.1
kin 28.8
groom 27.9
attractive 27.3
couple 26.1
smiling 25.3
person 25
happiness 23.5
pretty 21.7
male 21.5
love 21.3
man 20.2
two 18.6
looking 18.4
hair 18.2
lifestyle 18.1
face 17.8
women 17.4
mother 17.2
brunette 16.6
smile 15.7
bride 15.5
cheerful 15.4
dress 15.4
parent 15.2
family 15.1
fashion 15.1
joy 15
park 14.8
outdoor 14.5
cute 14.4
together 14
wedding 13.8
casual 13.6
outdoors 13.4
teen 12.9
sexy 12.9
black 12.8
holding 12.4
marriage 12.3
lady 12.2
expression 11.9
model 11.7
son 11.3
human 11.2
elegance 10.9
romance 10.7
daughter 10.7
posing 10.7
sibling 10.6
fun 10.5
flowers 10.4
teenager 10
leisure 10
romantic 9.8
kid 9.8
wife 9.5
sitting 9.4
youth 9.4
relationship 9.4
one 9
standing 8.7
bouquet 8.6
husband 8.6
togetherness 8.5
friends 8.5
summer 8.4
phone 8.3
student 8.2
childhood 8.1
lovely 8
look 7.9
boy 7.8
father 7.8
men 7.7
outside 7.7
hand 7.6
horizontal 7.5
emotion 7.4
executive 7.4
makeup 7.3
business 7.3
sensuality 7.3
gorgeous 7.3
school 7.2
handsome 7.1
work 7.1
clothing 7

Google
created on 2022-06-10

Photograph 94.3
Facial expression 93.2
Human 90.3
Black 89.8
Black-and-white 87.3
Happy 85.9
Style 84.1
Monochrome 79.8
Adaptation 79.3
Monochrome photography 78.8
People 78.2
Toddler 78.1
Smile 75.6
Beauty 75.5
Snapshot 74.3
Vintage clothing 71.5
Fun 69.3
Event 69.1
Baby 67.7
Hat 66

Microsoft
created on 2022-06-10

human face 99.2
text 99.2
smile 98.5
clothing 98.3
person 96.9
outdoor 96.6
baby 95.5
toddler 95.1
black and white 86.7
boy 79.7
girl 75.6
woman 73.2
posing 70.4
child 66.9
black 66.3
crowd 1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-22
Gender Female, 100%
Happy 38%
Disgusted 22.9%
Calm 20.4%
Confused 8.9%
Surprised 8.6%
Fear 6.6%
Sad 3.1%
Angry 1.2%

AWS Rekognition

Age 6-14
Gender Female, 100%
Sad 99.4%
Confused 26.7%
Fear 6.9%
Surprised 6.4%
Angry 4.5%
Calm 2.3%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 4-12
Gender Female, 100%
Calm 69.6%
Happy 24.9%
Surprised 6.5%
Fear 6%
Sad 2.4%
Angry 1.9%
Disgusted 1.3%
Confused 0.5%

AWS Rekognition

Age 9-17
Gender Female, 95.7%
Calm 59.8%
Fear 34.2%
Surprised 7.8%
Sad 2.7%
Confused 1.5%
Happy 1.2%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 13-21
Gender Male, 95.2%
Happy 82.2%
Calm 9.3%
Surprised 6.9%
Fear 6.6%
Confused 2.6%
Sad 2.6%
Angry 0.8%
Disgusted 0.6%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 95.2%
a group of people posing for the camera 95.1%
a group of people posing for a picture 95%