Human Generated Data

Title

Greenwich Village (Bethune Street, New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2476
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Greenwich Village (Bethune Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.7
Person 99.7
Person 99.5
Person 99.3
Person 99.1
Person 98.8
Person 97.9
Apparel 95.4
Clothing 95.4
Person 89.9
Person 88
Person 84.2
Shoe 75.4
Footwear 75.4
People 68.9
Shoe 63.2
Coat 60.2
Overcoat 60.2
Outdoors 58.5
Porch 55.2

Clarifai
created on 2018-03-23

people 99.9
group together 99
adult 98.6
group 97.7
man 97
two 95.8
three 95.8
woman 94.9
four 93.1
recreation 92.1
outfit 91.1
several 91
five 90.5
wear 89.9
athlete 88
child 87.1
uniform 83.9
military 83.8
vehicle 83.7
sports equipment 83.5

Imagga
created on 2018-03-23

man 30.4
uniform 26.4
person 23.6
clothing 23.4
military uniform 22
male 22
people 21.2
military 18.3
soldier 16.6
protection 16.4
adult 15.6
war 14.5
city 14.1
gun 13.4
mask 12.6
weapon 12.4
portrait 12.3
men 12
danger 11.8
industrial 11.8
black 11.5
equipment 11.1
sport 10.9
dark 10.9
camouflage 10.8
army 10.7
world 10.7
covering 10.5
power 10.1
battle 9.8
business 9.7
metal 9.7
urban 9.6
guy 9.4
consumer goods 9.2
player 9.1
hand 9.1
silhouette 9.1
holding 9.1
fun 9
sculpture 9
game 8.9
photographer 8.8
symbol 8.7
light 8.7
sitting 8.6
television camera 8.3
one 8.2
dirty 8.1
suit 8.1
night 8
architecture 7.8
protective 7.8
gas 7.7
old 7.7
casual 7.6
musical instrument 7.6
sign 7.5
human 7.5
leisure 7.5
building 7.2
shadow 7.2
women 7.1
to 7.1

Google
created on 2018-03-23

photograph 95.5
human behavior 85.7
snapshot 81.8
black and white 75.2
vintage clothing 75.2

Microsoft
created on 2018-03-23

person 99.1
outdoor 85.7
people 74.2
group 68.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 52.8%
Sad 47.1%
Disgusted 45.1%
Surprised 45.1%
Confused 45.1%
Angry 45.2%
Happy 45.1%
Calm 52.4%

AWS Rekognition

Age 26-43
Gender Female, 50.6%
Confused 45.2%
Surprised 45.1%
Happy 45.2%
Angry 45.3%
Disgusted 45.6%
Sad 53%
Calm 45.5%

AWS Rekognition

Age 6-13
Gender Female, 53.5%
Calm 47.9%
Sad 51.7%
Confused 45.1%
Disgusted 45%
Happy 45.1%
Surprised 45.1%
Angry 45.2%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 75.4%

Captions

Microsoft

a group of people standing in front of a building 92.7%
a group of people standing outside of a building 92.2%
a group of people standing next to a building 91.8%

Text analysis

Amazon

Ben
Ben shan
shan
llne
ecmvic llne
ecmvic