Human Generated Data

Title

Untitled (Civil Works Administration demonstration, near the United States Customs House, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5588

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, near the United States Customs House, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Apparel 100
Clothing 100
Hat 99.7
Human 99.5
Person 99.5
Person 98.3
Person 98.3
Person 98.1
Hat 97
Person 95.8
Sun Hat 94.8
Hat 94.4
Person 94.1
Hat 93.9
Person 91
Person 85.3
Hat 85.3
Person 84.8
Person 84.5
Hat 82.9
Cowboy Hat 82.2
Person 81.7
Person 79.2
Person 78.2
Hat 72.6
Hat 71.9
Hat 70.3
Person 63.4
Crowd 61.9
Hat 60.7
Person 48.5

Clarifai
created on 2019-11-11

people 99.9
many 99.9
veil 99.7
group 99.6
group together 99.4
crowd 98.9
man 98.6
lid 98.2
adult 97.5
audience 97.2
spectator 95.8
leader 95.6
military 94.8
fedora 94.5
wear 94.4
outfit 92.9
war 91.7
uniform 90.1
administration 89.4
woman 89.4

Imagga
created on 2019-11-11

cowboy hat 100
hat 100
headdress 100
clothing 70.6
consumer goods 38.1
covering 37.7
food 16.3
coins 15.4
money 15.3
business 15.2
market 14.2
currency 13.5
close 13.1
many 12
bank 11.6
banking 11
cash 11
wealth 10.8
group 10.5
metal 10.5
dinner 10.2
treasure 9.6
pattern 9.6
coin 9.5
finance 9.3
drink 9.2
objects 8.7
table 8.6
restaurant 8.6
savings 8.4
banquet 8.4
investment 8.2
meal 8.2
closeup 8.1
financial 8
breakfast 7.9
change 7.7
eat 7.5
tea 7.5
coffee 7.4
china 7.4
beverage 7.3
success 7.2
concepts 7.1
summer 7.1

Google
created on 2019-11-11

People 96
Crowd 91
Headgear 72.3
Personal protective equipment 59.3

Microsoft
created on 2019-11-11

hat 98.9
person 97.6
clothing 96.2
man 84.8
fedora 83.5
fashion accessory 80.2
cowboy hat 79.8
sun hat 73.8
group 58
crowd 6

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 33-49
Gender Male, 98.5%
Angry 0%
Calm 99.9%
Happy 0%
Fear 0%
Surprised 0%
Disgusted 0%
Confused 0%
Sad 0%

AWS Rekognition

Age 34-50
Gender Male, 54.9%
Angry 45%
Disgusted 45%
Surprised 45%
Happy 45.1%
Sad 45.2%
Fear 45%
Confused 45%
Calm 54.6%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Angry 45%
Sad 53.6%
Calm 46.3%
Confused 45%
Fear 45%
Surprised 45%
Happy 45%
Disgusted 45%

AWS Rekognition

Age 24-38
Gender Male, 55%
Sad 45.3%
Fear 45.1%
Angry 45.4%
Happy 45.2%
Disgusted 45.1%
Calm 53.8%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 34-50
Gender Male, 92.1%
Disgusted 0%
Fear 0%
Calm 99.8%
Sad 0.1%
Happy 0%
Angry 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 33-49
Gender Male, 54.7%
Sad 46.1%
Calm 48.8%
Angry 49.8%
Happy 45%
Disgusted 45.1%
Fear 45%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 26-40
Gender Male, 55%
Disgusted 45.1%
Fear 45%
Sad 45.6%
Happy 45%
Angry 45.1%
Calm 54.1%
Confused 45%
Surprised 45%

AWS Rekognition

Age 22-34
Gender Male, 53.7%
Fear 45%
Calm 53.2%
Happy 46.4%
Sad 45.3%
Surprised 45%
Disgusted 45%
Angry 45%
Confused 45%

AWS Rekognition

Age 23-37
Gender Male, 54%
Happy 45.4%
Calm 46.7%
Sad 45.3%
Fear 45.4%
Disgusted 45%
Surprised 45.6%
Confused 45.1%
Angry 51.4%

AWS Rekognition

Age 21-33
Gender Female, 50.8%
Disgusted 45.1%
Angry 45.4%
Calm 49.8%
Happy 48.2%
Fear 45.1%
Confused 45.1%
Sad 45.9%
Surprised 45.4%

AWS Rekognition

Age 22-34
Gender Male, 98%
Disgusted 1.9%
Calm 82.4%
Confused 1.1%
Happy 0.3%
Fear 0.7%
Angry 0.8%
Sad 11.8%
Surprised 1.1%

AWS Rekognition

Age 23-35
Gender Male, 51%
Calm 46.3%
Sad 52%
Fear 46.1%
Confused 45.1%
Angry 45.2%
Disgusted 45.2%
Happy 45%
Surprised 45%

AWS Rekognition

Age 21-33
Gender Male, 52.2%
Surprised 45.1%
Sad 45.4%
Angry 45.3%
Calm 53.2%
Fear 45%
Disgusted 45.9%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 30-46
Gender Male, 54.8%
Happy 45%
Disgusted 45.1%
Surprised 45%
Calm 47.6%
Fear 45%
Sad 52.3%
Confused 45%
Angry 45%

AWS Rekognition

Age 32-48
Gender Male, 54.9%
Confused 45%
Sad 45%
Angry 45%
Happy 45%
Fear 45%
Disgusted 45%
Surprised 45%
Calm 55%

AWS Rekognition

Age 29-45
Gender Male, 52.5%
Disgusted 45.1%
Calm 50.9%
Angry 45%
Confused 45%
Fear 45%
Sad 45.1%
Happy 48.7%
Surprised 45.1%

AWS Rekognition

Age 22-34
Gender Male, 54.5%
Happy 45.1%
Disgusted 45.2%
Confused 45.1%
Fear 45%
Surprised 45.1%
Sad 45.7%
Calm 53.6%
Angry 45.2%

AWS Rekognition

Age 21-33
Gender Male, 54.6%
Angry 45.3%
Surprised 45%
Calm 49%
Confused 45.1%
Happy 45.1%
Disgusted 45%
Sad 50.5%
Fear 45%

AWS Rekognition

Age 26-40
Gender Male, 54.5%
Calm 54.2%
Fear 45%
Sad 45.8%
Angry 45%
Surprised 45%
Happy 45%
Disgusted 45%
Confused 45%

AWS Rekognition

Age 33-49
Gender Male, 54.1%
Calm 45.1%
Disgusted 45%
Confused 45%
Fear 45.1%
Happy 45%
Angry 45.2%
Surprised 45%
Sad 54.6%

AWS Rekognition

Age 30-46
Gender Male, 52.4%
Happy 45%
Sad 45%
Disgusted 45%
Confused 45%
Calm 54.9%
Angry 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 16-28
Gender Male, 54.7%
Calm 45.6%
Fear 45.3%
Disgusted 45.1%
Happy 45.6%
Angry 45.5%
Sad 52.5%
Confused 45.3%
Surprised 45.2%

AWS Rekognition

Age 29-45
Gender Male, 52.9%
Disgusted 45%
Angry 45.1%
Calm 54.6%
Surprised 45.1%
Fear 45%
Happy 45%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 44-62
Gender Male, 54.9%
Confused 45%
Angry 45%
Fear 45%
Disgusted 45%
Calm 55%
Surprised 45%
Happy 45%
Sad 45%

AWS Rekognition

Age 28-44
Gender Male, 53.7%
Disgusted 45%
Calm 46.3%
Surprised 45.1%
Fear 45.1%
Angry 45.1%
Confused 45%
Sad 53.3%
Happy 45%

AWS Rekognition

Age 49-67
Gender Male, 55%
Angry 45.1%
Calm 45.9%
Surprised 45%
Fear 45.2%
Happy 45%
Confused 45%
Disgusted 45%
Sad 53.7%

AWS Rekognition

Age 36-54
Gender Male, 54.8%
Calm 46.6%
Disgusted 45.1%
Angry 46.9%
Fear 45.3%
Sad 50.5%
Confused 45.1%
Surprised 45.1%
Happy 45.4%

AWS Rekognition

Age 23-37
Gender Male, 60%
Disgusted 0.1%
Fear 37.5%
Sad 30.1%
Calm 0.9%
Angry 30.8%
Confused 0.2%
Happy 0.1%
Surprised 0.3%

AWS Rekognition

Age 22-34
Gender Male, 54.3%
Fear 45.4%
Confused 45.4%
Sad 50.3%
Happy 45.1%
Disgusted 45.2%
Calm 47.8%
Angry 45.9%
Surprised 45.1%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Surprised 45%
Sad 45.5%
Angry 45%
Disgusted 45%
Calm 54.4%
Confused 45%
Fear 45%
Happy 45%

AWS Rekognition

Age 39-57
Gender Male, 54.2%
Angry 45.3%
Disgusted 47.4%
Confused 45.2%
Sad 50.8%
Calm 45.5%
Surprised 45.1%
Fear 45.5%
Happy 45.1%

AWS Rekognition

Age 49-67
Gender Female, 50%
Calm 50.2%
Sad 46.1%
Confused 45%
Fear 45%
Surprised 45%
Disgusted 45%
Happy 48.6%
Angry 45%

AWS Rekognition

Age 32-48
Gender Male, 51.5%
Calm 50.6%
Sad 48.6%
Angry 45.3%
Fear 45.2%
Disgusted 45%
Surprised 45%
Confused 45.1%
Happy 45.2%

AWS Rekognition

Age 13-25
Gender Female, 54.2%
Fear 45.5%
Sad 49.5%
Disgusted 45.1%
Surprised 45.1%
Happy 48.2%
Angry 45.9%
Confused 45.1%
Calm 45.6%

AWS Rekognition

Age 17-29
Gender Female, 54.4%
Surprised 50.2%
Fear 45.4%
Calm 48.7%
Confused 45.1%
Sad 45.1%
Angry 45.3%
Disgusted 45%
Happy 45.1%

AWS Rekognition

Age 24-38
Gender Male, 54.6%
Happy 46.5%
Sad 45.9%
Fear 45.1%
Confused 45.1%
Disgusted 45.1%
Calm 51.8%
Surprised 45.1%
Angry 45.6%

AWS Rekognition

Age 3-9
Gender Male, 52.6%
Sad 45.4%
Calm 54.1%
Surprised 45.2%
Confused 45%
Fear 45.1%
Happy 45.1%
Disgusted 45%
Angry 45.1%

AWS Rekognition

Age 32-48
Gender Male, 53.8%
Fear 45%
Disgusted 45%
Sad 45.1%
Angry 45%
Happy 45%
Calm 54.8%
Surprised 45%
Confused 45%

AWS Rekognition

Age 23-37
Gender Male, 50.3%
Surprised 49.5%
Sad 49.8%
Angry 49.5%
Calm 50.2%
Fear 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 18-30
Gender Male, 50.2%
Angry 50.4%
Sad 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 39-57
Gender Female, 51.5%
Calm 48.4%
Angry 45.7%
Disgusted 45.1%
Surprised 45.1%
Happy 45.8%
Fear 45.3%
Confused 45.1%
Sad 49.5%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Feature analysis

Amazon

Hat 99.7%
Person 99.5%

Captions

Microsoft

a group of people posing for a photo 89.7%
a group of people posing for a photo in front of a crowd 89.6%
a group of people posing for the camera 89.5%

Text analysis

Amazon

Cha,

Google

Cho 40 ORI
ORI
Cho
40