Human Generated Data

Title

Untitled (demonstration, Union Square, New York City)
Date

1934-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5592

Human Generated Data

Title

Untitled (demonstration, Union Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5592

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Apparel 100
Clothing 100
Human 98.9
Person 98.9
Person 97.6
Coat 96.7
Overcoat 96.7
Person 96.1
Person 94.1
Person 92.7
Suit 92.4
Person 92.4
Person 88.9
Person 88.3
Person 87.8
Person 82.7
Person 81.4
Person 76.8
Person 73.9
Crowd 68.6
Cloak 67.1
Fashion 67.1
Person 65.2
Tuxedo 58.6
Face 58.3
People 55.2
Person 50.6
Person 45.5

Clarifai
created on 2019-11-11

people 99.9
many 99.6
group 99.4
group together 98.7
adult 98
leader 97.5
administration 96.5
wear 94.8
woman 92.7
man 92.4
outfit 89.8
military 89.6
crowd 88.9
war 85.3
ceremony 85.1
several 84.5
vehicle 82.3
child 81.9
veil 81.2
chair 79.3

Imagga
created on 2019-11-11

military uniform 100
uniform 100
clothing 91.1
consumer goods 60.3
covering 59.7
city 29.9
commodity 29.7
private 23.7
man 22.8
architecture 22.6
people 21.2
male 17
history 16.1
street 15.6
old 15.3
building 15.1
urban 14.8
person 14
business 13.4
buildings 13.2
adult 12.3
day 11.8
businessman 11.5
new 11.3
group 11.3
men 11.2
work 11
tourism 10.7
black 10.2
sky 10.2
landmark 9.9
travel 9.9
statue 9.5
cityscape 9.5
portrait 9.1
tower 8.9
aerial 8.7
military 8.7
corporate 8.6
center 8.5
house 8.4
town 8.3
historic 8.2
suit 8.1
scene 7.8
construction 7.7
crowd 7.7
sculpture 7.6
historical 7.5
executive 7.4
protection 7.3
industrial 7.3
tourist 7.2
women 7.1
job 7.1

Google
created on 2019-11-11

Photograph 96.1
People 94.9
Snapshot 84.5
Uniform 70.8
History 66.1
Photography 62.4
Stock photography 59.4
Vintage clothing 55.9
Crowd 50.7

Microsoft
created on 2019-11-11

text 98.4
clothing 96.4
person 95.8
old 93.6
group 91.7
outdoor 90
white 85.1
black 75.7
posing 71
people 68.2
clothes 46
vintage 31

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Male, 52.4%
Confused 45.2%
Angry 45.6%
Fear 45.4%
Disgusted 45.6%
Happy 45.2%
Surprised 45.2%
Calm 46.6%
Sad 51.3%

AWS Rekognition

Age 19-31
Gender Female, 52.3%
Happy 45.3%
Calm 54.4%
Angry 45%
Surprised 45%
Fear 45%
Disgusted 45%
Confused 45%
Sad 45.2%

AWS Rekognition

Age 31-47
Gender Male, 51.7%
Disgusted 49.3%
Sad 45.5%
Angry 49.4%
Fear 45.4%
Happy 45%
Surprised 45.1%
Confused 45.1%
Calm 45.2%

AWS Rekognition

Age 24-38
Gender Female, 54.7%
Disgusted 45.1%
Calm 45%
Fear 47.7%
Surprised 45.1%
Happy 46.3%
Confused 45.1%
Angry 45.2%
Sad 50.5%

AWS Rekognition

Age 28-44
Gender Female, 50.8%
Surprised 45.2%
Calm 45.8%
Disgusted 46.1%
Happy 45.3%
Angry 51.8%
Confused 45.1%
Sad 45.3%
Fear 45.3%

AWS Rekognition

Age 28-44
Gender Male, 54.7%
Happy 45%
Confused 45.1%
Surprised 45.1%
Angry 45%
Calm 54.7%
Disgusted 45%
Sad 45%
Fear 45%

AWS Rekognition

Age 22-34
Gender Male, 50.1%
Confused 45%
Sad 45.1%
Angry 45%
Happy 45%
Fear 45%
Disgusted 45%
Surprised 45%
Calm 54.8%

AWS Rekognition

Age 19-31
Gender Male, 54.7%
Sad 45.5%
Surprised 45.1%
Happy 45%
Confused 47.9%
Fear 45.1%
Angry 45%
Disgusted 45%
Calm 51.5%

AWS Rekognition

Age 13-25
Gender Female, 53.5%
Disgusted 45.2%
Fear 47.6%
Calm 46%
Surprised 45.6%
Happy 45.9%
Angry 48.1%
Sad 46.3%
Confused 45.4%

AWS Rekognition

Age 22-34
Gender Male, 54.8%
Happy 45.4%
Disgusted 45%
Confused 45%
Fear 45%
Surprised 45%
Sad 45.3%
Calm 54.1%
Angry 45.1%

AWS Rekognition

Age 29-45
Gender Male, 52.8%
Disgusted 45%
Fear 45.1%
Angry 45%
Sad 45.8%
Calm 53.8%
Surprised 45.1%
Confused 45.1%
Happy 45%

AWS Rekognition

Age 26-42
Gender Male, 54.8%
Angry 45.2%
Disgusted 45.4%
Sad 45.1%
Fear 45.2%
Happy 50.6%
Confused 45.2%
Calm 47.7%
Surprised 45.7%

AWS Rekognition

Age 23-37
Gender Female, 51.2%
Angry 45.3%
Calm 51%
Happy 45.9%
Fear 45.2%
Surprised 45.2%
Disgusted 45.9%
Sad 46.3%
Confused 45.2%

AWS Rekognition

Age 13-23
Gender Female, 54.2%
Happy 45%
Angry 45%
Fear 45.1%
Sad 54.5%
Confused 45%
Surprised 45%
Disgusted 45%
Calm 45.3%

AWS Rekognition

Age 30-46
Gender Male, 54.9%
Fear 45%
Angry 45.4%
Calm 53.6%
Disgusted 45.4%
Sad 45.4%
Happy 45%
Confused 45.1%
Surprised 45%

AWS Rekognition

Age 39-57
Gender Female, 52.6%
Happy 46.6%
Calm 46.9%
Sad 48.4%
Fear 45.9%
Disgusted 45.5%
Surprised 45.4%
Confused 45.3%
Angry 46%

AWS Rekognition

Age 6-16
Gender Male, 54.3%
Happy 45.1%
Sad 50.8%
Disgusted 45%
Confused 45.1%
Calm 46.2%
Angry 47.5%
Surprised 45.1%
Fear 45.2%

AWS Rekognition

Age 7-17
Gender Male, 53%
Surprised 45.1%
Calm 52%
Angry 45.9%
Fear 45.1%
Happy 45.1%
Disgusted 45.2%
Sad 46.5%
Confused 45.1%

AWS Rekognition

Age 35-51
Gender Male, 53.8%
Sad 45.3%
Surprised 45.6%
Happy 45.1%
Confused 45.2%
Fear 45.1%
Angry 45.2%
Disgusted 45.1%
Calm 53.5%

AWS Rekognition

Age 22-34
Gender Male, 52.5%
Confused 45.1%
Sad 45.3%
Angry 45.2%
Happy 45.2%
Fear 45.1%
Disgusted 45.5%
Surprised 45.2%
Calm 53.5%

AWS Rekognition

Age 26-40
Gender Male, 52.8%
Confused 45.5%
Fear 45.2%
Surprised 47.5%
Happy 45.9%
Calm 50.3%
Angry 45.1%
Sad 45.5%
Disgusted 45.1%

AWS Rekognition

Age 22-34
Gender Female, 50.6%
Fear 45.7%
Sad 45.7%
Disgusted 45.7%
Surprised 45.3%
Happy 45.5%
Angry 50.2%
Confused 45.4%
Calm 46.5%

AWS Rekognition

Age 22-34
Gender Male, 50.4%
Fear 49.6%
Angry 49.5%
Confused 49.5%
Sad 49.5%
Happy 50%
Disgusted 49.5%
Surprised 49.6%
Calm 49.7%

AWS Rekognition

Age 28-44
Gender Female, 51.4%
Disgusted 45.7%
Happy 47.4%
Fear 47.9%
Calm 45.5%
Angry 45.2%
Surprised 45.8%
Sad 46.3%
Confused 46.2%

AWS Rekognition

Age 35-51
Gender Male, 51.4%
Sad 46.8%
Disgusted 45.2%
Angry 45.7%
Surprised 45.1%
Calm 51.6%
Happy 45%
Fear 45.1%
Confused 45.4%

AWS Rekognition

Age 26-42
Gender Female, 50%
Calm 47.1%
Angry 45.1%
Disgusted 45%
Surprised 45.1%
Happy 45.5%
Fear 45.1%
Confused 45.1%
Sad 52.1%

AWS Rekognition

Age 36-52
Gender Male, 54.6%
Disgusted 45.1%
Surprised 45.1%
Calm 54%
Fear 45%
Sad 45.4%
Angry 45.1%
Happy 45.1%
Confused 45.1%

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Text analysis

Amazon

S.KLEIP

Google

S.KLEI sar saB
S.KLEI
sar
saB