Human Generated Data

Title

Untitled (Union Square and Fourteenth Street District, New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2079
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Union Square and Fourteenth Street District, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.8
Person 99.8
Person 99.5
Apparel 98.7
Clothing 98.7
Building 94
Metropolis 94
Town 94
Urban 94
City 94
Hat 89.8
Crowd 68.4
Pedestrian 62.4
People 61.6
Hair 60.9
Undershirt 58.6
Person 43.9

Clarifai
created on 2018-03-23

people 99.8
street 98.4
adult 98
monochrome 97.5
portrait 96.2
woman 96.1
man 95.3
two 94
one 93.3
administration 91.4
group 91
wear 90.4
leader 89.8
child 82.5
city 79.9
black and white 79
music 78.9
war 77.2
three 75.1
military 73.5

Imagga
created on 2018-03-23

man 42.3
male 31.4
people 30.1
person 27.7
men 22.3
face 22
couple 20.9
portrait 20.7
senior 20.6
adult 20.1
love 19.7
hair 19
old 18.1
smile 16.4
black 15.6
happy 15
grandfather 15
looking 14.4
mature 13.9
handsome 13.4
marriage 13.3
expression 12.8
attractive 12.6
elderly 12.4
husband 12.4
hand 12.2
hat 12
pretty 11.9
casual 11.9
lifestyle 11.6
wind instrument 11.5
one 11.2
head 10.9
married 10.5
together 10.5
serious 10.5
mother 10.3
happiness 10.2
beard 9.9
romance 9.8
sexy 9.6
look 9.6
wife 9.5
smiling 9.4
fashion 9
human 9
outdoors 9
life 8.8
home 8.8
women 8.7
guy 8.6
vintage 8.3
device 8.2
call 8.2
lady 8.1
gray 8.1
family 8
world 7.9
work 7.8
parent 7.8
model 7.8
eyes 7.7
skin 7.7
musical instrument 7.7
two 7.6
mouth 7.5
dark 7.5
fun 7.5
style 7.4
retro 7.4
pose 7.2
eye 7.1
romantic 7.1
groom 7.1
summer 7.1

Google
created on 2018-03-23

photograph 95.5
black and white 85.9
snapshot 81.8
photography 79.1
temple 71.6
monochrome photography 69.5
vintage clothing 59.7
street 59.3
monochrome 59
girl 55.8
road 54.2

Microsoft
created on 2018-03-23

person 100
building 99.4
outdoor 90.8
standing 87.9
crowd 0.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 35-53
Gender Female, 96.3%
Disgusted 1%
Confused 3.9%
Calm 8.5%
Surprised 0.9%
Angry 1.5%
Sad 82.9%
Happy 1.3%

AWS Rekognition

Age 16-27
Gender Female, 68.1%
Happy 2.5%
Disgusted 3.2%
Confused 3.6%
Calm 26.6%
Sad 53.8%
Angry 7.6%
Surprised 2.7%

Feature analysis

Amazon

Person 99.8%
Hat 89.8%

Captions

Microsoft

a man and a woman standing in front of a building 84.3%
a person standing in front of a building 84.2%
a man and a woman standing in front of a store 74.3%

Text analysis

Amazon

hiwemu
ESA