Human Generated Data

Title

Untitled (demonstration, Union Square, New York City)
Date

1934-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5593

Human Generated Data

Title

Untitled (demonstration, Union Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5593

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Apparel 100
Clothing 100
Person 98.6
Human 98.6
Person 98.1
Overcoat 97.9
Coat 97.9
Person 96.2
Suit 95.6
Person 94.6
Person 94.4
Person 92.2
Person 90.7
Person 88.9
Person 88.3
Person 85.9
Crowd 81
Tie 79.5
Accessory 79.5
Accessories 79.5
Person 79.2
Person 75.6
Person 74.2
Tuxedo 67.7
Face 65.1
Person 61.1
Pedestrian 61

Clarifai
created on 2019-11-11

people 99.9
many 99.5
group 99
group together 98.3
adult 98.1
leader 95.8
administration 95.2
man 94.4
wear 93.9
military 93.8
woman 91.3
crowd 91.3
war 88.4
outfit 87.4
uniform 85.2
ceremony 80.2
vehicle 79
soldier 78
child 74.9
several 74

Imagga
created on 2019-11-11

military uniform 100
uniform 100
clothing 89.8
consumer goods 61.3
covering 60.7
man 30.9
commodity 30.1
male 29
business 28.5
businessman 28.2
work 25.1
person 20.4
job 20.3
people 20.1
professional 17.7
office 17.6
corporate 17.2
adult 16.8
men 14.6
portrait 14.2
handsome 13.4
meeting 13.2
smiling 13
suit 12.8
city 12.5
smile 12.1
group 12.1
success 12.1
architecture 11.7
new 11.3
standing 11.3
looking 11.2
old 10.4
student 10.4
building 10.3
private 10.3
room 10.2
worker 9.8
black 9.6
plan 9.4
construction 9.4
doctor 9.4
executive 9.3
manager 9.3
guy 9.2
team 8.9
medical 8.8
center 8.8
education 8.6
thinking 8.5
senior 8.4
occupation 8.2
human 8.2
confident 8.2
businesswoman 8.2
history 8
working 7.9
modern 7.7
chart 7.6
casual 7.6
finance 7.6
tie 7.6
businesspeople 7.6
happy 7.5
engineer 7.5
classroom 7.5
company 7.4
school 7.2
medicine 7
travel 7
sky 7

Google
created on 2019-11-11

Photograph 95.8
Snapshot 83.9
History 70.9
Family 52.5
Vintage clothing 50.7

Microsoft
created on 2019-11-11

text 99.6
person 97.5
clothing 97
old 95.7
outdoor 95.4
group 92.5
white 86.4
black 79.3
people 66.5
posing 47.3
clothes 39
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-67
Gender Male, 52.8%
Confused 45.2%
Calm 45.7%
Sad 52.7%
Angry 45.5%
Happy 45.2%
Fear 45.4%
Surprised 45.1%
Disgusted 45.2%

AWS Rekognition

Age 23-37
Gender Male, 53.9%
Sad 45.1%
Happy 52.2%
Surprised 45.5%
Fear 45.2%
Angry 45.1%
Calm 46.8%
Disgusted 45.1%
Confused 45.2%

AWS Rekognition

Age 5-15
Gender Female, 51.3%
Confused 45%
Angry 45%
Happy 45.3%
Calm 54.5%
Disgusted 45%
Surprised 45%
Fear 45%
Sad 45.1%

AWS Rekognition

Age 23-35
Gender Male, 50%
Sad 45.4%
Confused 45.2%
Angry 48%
Fear 45.2%
Happy 45.4%
Surprised 45.3%
Calm 49.6%
Disgusted 46%

AWS Rekognition

Age 23-37
Gender Male, 54.5%
Surprised 45%
Happy 45.1%
Disgusted 45%
Calm 52.9%
Fear 45%
Sad 46.3%
Angry 45.5%
Confused 45%

AWS Rekognition

Age 22-34
Gender Male, 53%
Calm 45.6%
Sad 51.1%
Angry 45.4%
Fear 45.1%
Disgusted 46%
Surprised 45%
Confused 45.1%
Happy 46.6%

AWS Rekognition

Age 24-38
Gender Male, 51.8%
Surprised 45%
Fear 45%
Sad 45%
Calm 54.9%
Confused 45%
Happy 45%
Disgusted 45%
Angry 45%

AWS Rekognition

Age 23-35
Gender Male, 54.6%
Confused 45%
Sad 45%
Angry 45%
Fear 45%
Calm 54.9%
Happy 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 34-50
Gender Male, 54.7%
Happy 45%
Confused 45%
Angry 45.2%
Sad 45.1%
Surprised 45%
Disgusted 45.2%
Calm 54.4%
Fear 45%

AWS Rekognition

Age 23-37
Gender Female, 53.7%
Disgusted 45.2%
Sad 52.3%
Fear 45.3%
Surprised 45.1%
Happy 45.1%
Calm 46.3%
Confused 45.1%
Angry 45.6%

AWS Rekognition

Age 23-35
Gender Female, 53.2%
Fear 47.1%
Disgusted 46.1%
Sad 46.7%
Calm 46.5%
Surprised 45.5%
Confused 45.7%
Angry 46.5%
Happy 45.9%

AWS Rekognition

Age 23-37
Gender Female, 54.8%
Sad 45.4%
Disgusted 45.1%
Angry 45.4%
Confused 45.2%
Fear 46.8%
Happy 51.7%
Surprised 45.3%
Calm 45.1%

AWS Rekognition

Age 26-40
Gender Female, 53.2%
Sad 49.7%
Surprised 45%
Angry 45.1%
Confused 45.2%
Calm 49.8%
Disgusted 45.1%
Fear 45.1%
Happy 45.1%

AWS Rekognition

Age 22-34
Gender Male, 50.1%
Disgusted 45%
Sad 51.7%
Confused 45%
Fear 45%
Calm 48.2%
Surprised 45%
Happy 45%
Angry 45%

AWS Rekognition

Age 29-45
Gender Male, 53.8%
Angry 45%
Sad 45.2%
Surprised 45.1%
Fear 45%
Confused 45.1%
Calm 54.6%
Disgusted 45%
Happy 45%

AWS Rekognition

Age 22-34
Gender Male, 54.5%
Disgusted 45.1%
Calm 46.8%
Sad 45.4%
Happy 45.4%
Angry 51.5%
Confused 45.1%
Surprised 45.1%
Fear 45.6%

AWS Rekognition

Age 27-43
Gender Male, 50.4%
Calm 50.8%
Disgusted 45.1%
Angry 45.1%
Fear 45.1%
Surprised 45%
Happy 45.1%
Sad 48.7%
Confused 45.2%

AWS Rekognition

Age 32-48
Gender Male, 52.4%
Fear 45.2%
Calm 47.3%
Happy 45.1%
Sad 51.3%
Surprised 45.2%
Disgusted 45.1%
Angry 45.5%
Confused 45.3%

AWS Rekognition

Age 30-46
Gender Male, 51.3%
Disgusted 45.7%
Fear 45%
Calm 48%
Surprised 45.1%
Happy 45%
Angry 50.6%
Sad 45.1%
Confused 45.4%

AWS Rekognition

Age 23-37
Gender Female, 52.7%
Calm 54.6%
Angry 45%
Fear 45%
Confused 45.1%
Sad 45.2%
Disgusted 45%
Surprised 45.1%
Happy 45%

AWS Rekognition

Age 23-35
Gender Male, 50.3%
Disgusted 49.5%
Angry 49.6%
Calm 49.6%
Happy 49.9%
Fear 49.8%
Confused 49.5%
Sad 49.5%
Surprised 49.5%

AWS Rekognition

Age 5-15
Gender Male, 53.6%
Angry 45.6%
Sad 51.2%
Confused 45.1%
Calm 45%
Disgusted 45%
Fear 48.1%
Happy 45%
Surprised 45%

AWS Rekognition

Age 41-59
Gender Male, 54.6%
Calm 52.9%
Disgusted 45.2%
Angry 45.4%
Fear 45.1%
Surprised 45%
Happy 45.5%
Sad 45.8%
Confused 45.1%

AWS Rekognition

Age 18-30
Gender Female, 54%
Sad 45.3%
Happy 45.1%
Fear 45.2%
Calm 46.1%
Angry 45.2%
Disgusted 53%
Surprised 45.2%
Confused 45.1%

AWS Rekognition

Age 22-34
Gender Female, 50.2%
Disgusted 45.4%
Calm 45.3%
Angry 45.3%
Sad 48.1%
Happy 47.6%
Surprised 45.4%
Confused 45.4%
Fear 47.5%

AWS Rekognition

Age 21-33
Gender Male, 50.4%
Calm 49.5%
Fear 50.1%
Happy 49.6%
Angry 49.5%
Surprised 49.7%
Disgusted 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 21-33
Gender Female, 51.6%
Angry 45.9%
Surprised 45.2%
Calm 47%
Confused 45.7%
Happy 46.5%
Disgusted 45.3%
Sad 48.3%
Fear 46.2%

AWS Rekognition

Age 22-34
Gender Female, 50.5%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Fear 49.8%
Angry 49.6%
Confused 49.5%
Sad 50%
Happy 49.5%

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Tie 79.5%

Text analysis

Amazon

S.KLEIP
e S.KLEIP
e

Google

he Smart & Sh S.KLEI
he
Smart
&
S.KLEI
Sh