Human Generated Data

Title

Untitled (Civil Works Administration demonstration, City Hall, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3994
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, City Hall, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3994

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
People 99.9
Person 95.8
Baby 95.8
Face 93.3
Head 93.3
Person 92.8
Person 91.6
Baby 91.6
Sun Hat 90.8
Crowd 90.7
Person 88.3
Adult 88.3
Male 88.3
Man 88.3
Person 86.8
Person 84.9
Person 84.5
Person 84
Person 83.9
Person 83.8
Person 83.7
Person 83.7
Person 83.1
Person 83
Person 82.9
Adult 82.9
Male 82.9
Man 82.9
Person 80.8
Person 80.6
Person 79.9
Person 79.6
Person 78.2
Person 77.6
Person 77.1
Cap 77
Person 76
Person 74.4
Person 73.5
Person 72.7
Person 70.3
Audience 69.3
Person 68
Person 67.8
Person 67.5
Hat 66.3
Person 65.6
Person 65.5
Person 65.4
Person 65.2
Person 63.4
Person 62.2
Person 62
Hat 60.7
Person 60.6
Person 60.6
Officer 55.6
Baseball Cap 55.4
Architecture 55.2
Building 55.2
Classroom 55.2
Indoors 55.2
Room 55.2
School 55.2

Clarifai
created on 2018-05-10

people 99.7
many 98.7
audience 98.4
group 98.2
crowd 98
man 97.4
group together 97.2
stadium 96.6
adult 96.3
monochrome 96.2
woman 92.9
sport 92.8
indoors 91.6
desktop 91.2
recreation 91.1
spectator 90.5
theater 88
seat 88
soccer 86.6
one 86.1

Imagga
created on 2023-10-06

shoe shop 34.6
chair 31.4
shop 28.6
seat 26.8
classroom 26.6
room 25.2
mercantile establishment 21.2
support 17.2
clothing 15.2
place of business 14.4
hall 13.6
spectator 13.3
landscape 12.6
brassiere 12.2
row 12.1
group 12.1
empty 12
industry 12
interior 11.5
device 11.4
computer 11.4
covering 11.1
building 11.1
business 10.9
design 10.7
travel 9.9
woman's clothing 9.8
undergarment 9.8
metal 9.7
pattern 9.6
equipment 9.5
water 9.3
event 9.2
modern 9.1
new 8.9
technology 8.9
garment 8.8
audience 8.8
consumer goods 8.6
furniture 8.4
city 8.3
many 8.3
establishment 8.3
lake 8.2
outdoors 8.2
student 8.2
reflection 8.1
keyboard 7.9
table 7.8
construction 7.7
crowd 7.7
structure 7.6
texture 7.6
horizontal 7.5
restaurant 7.4
vacation 7.4
dumbbell 7.2
summer 7.1
steel 7.1
surface 7.1

Google
created on 2018-05-10

black 95.1
photograph 95.1
black and white 93.5
monochrome photography 87.2
photography 82
crowd 78.1
monochrome 76.5
human behavior 62.6
staff 62.4
military 58.5
troop 54.7
military person 50.1

Microsoft
created on 2018-05-10

person 93.1
white 74.8
crowd 1.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 81.1%
Sad 9.5%
Surprised 6.5%
Fear 6.5%
Happy 2.5%
Confused 1.9%
Disgusted 0.8%
Angry 0.6%

AWS Rekognition

Age 36-44
Gender Female, 64.6%
Calm 78.3%
Sad 25.5%
Surprised 6.5%
Fear 6.2%
Confused 0.3%
Disgusted 0.3%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 36-44
Gender Male, 100%
Happy 85.6%
Surprised 7.9%
Fear 6.1%
Calm 5.8%
Sad 2.3%
Angry 2%
Disgusted 1.9%
Confused 0.8%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 42.2%
Sad 27.5%
Surprised 12.2%
Confused 11.6%
Happy 8.4%
Fear 6.9%
Angry 4.3%
Disgusted 2.5%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 95.8%
Fear 6.5%
Surprised 6.3%
Sad 2.2%
Confused 1.8%
Disgusted 0.4%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 60-70
Gender Male, 99.9%
Fear 32.8%
Calm 19%
Confused 11.7%
Surprised 11%
Angry 9.6%
Happy 7.3%
Disgusted 6.9%
Sad 6.2%

AWS Rekognition

Age 36-44
Gender Male, 98.1%
Fear 83.5%
Calm 26.3%
Surprised 7.1%
Sad 3.1%
Angry 1.5%
Confused 1.1%
Happy 0.8%
Disgusted 0.5%

AWS Rekognition

Age 47-53
Gender Male, 99%
Calm 42.4%
Confused 23.8%
Surprised 13.4%
Fear 12.7%
Happy 4%
Sad 3.3%
Disgusted 2.9%
Angry 1.3%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Calm 56.8%
Sad 20.2%
Surprised 9.1%
Fear 6.4%
Happy 6.1%
Disgusted 5.5%
Confused 5.3%
Angry 3.1%

AWS Rekognition

Age 26-36
Gender Male, 99.6%
Sad 93.3%
Calm 47.3%
Fear 7.9%
Surprised 6.5%
Happy 0.7%
Disgusted 0.6%
Confused 0.6%
Angry 0.6%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Sad 99.8%
Calm 16.4%
Happy 8.9%
Fear 7%
Surprised 6.4%
Confused 0.9%
Disgusted 0.7%
Angry 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 35.3%
Disgusted 27.7%
Fear 16.6%
Surprised 7.5%
Confused 5.6%
Sad 5%
Happy 3.9%
Angry 1.8%

AWS Rekognition

Age 42-50
Gender Male, 98.2%
Calm 93.9%
Fear 7.4%
Surprised 6.5%
Sad 2.3%
Happy 0.7%
Disgusted 0.3%
Angry 0.3%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Male, 91%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 83.6%
Happy 8.1%
Surprised 7.1%
Fear 6.2%
Sad 2.8%
Confused 1.5%
Disgusted 1.4%
Angry 1%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 61.8%
Sad 14.9%
Surprised 9.3%
Fear 7.9%
Happy 6.3%
Disgusted 4.1%
Angry 1.9%
Confused 1.6%

AWS Rekognition

Age 28-38
Gender Male, 99%
Calm 93.6%
Surprised 6.6%
Fear 6.1%
Disgusted 3%
Sad 2.3%
Happy 1%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 38-46
Gender Male, 98.6%
Sad 90.9%
Calm 36.5%
Fear 9.1%
Confused 7.5%
Surprised 7%
Happy 2.1%
Disgusted 1.6%
Angry 1%

AWS Rekognition

Age 33-41
Gender Male, 99.2%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Sad 89.9%
Calm 31.5%
Disgusted 19.8%
Surprised 6.7%
Fear 6.6%
Happy 1.7%
Angry 1.1%
Confused 1%

AWS Rekognition

Age 25-35
Gender Male, 89.2%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 50-58
Gender Female, 71%
Sad 99.9%
Calm 15.3%
Surprised 6.6%
Fear 6.4%
Confused 1.5%
Happy 1%
Disgusted 0.6%
Angry 0.6%

Feature analysis

Amazon

Person 95.8%
Baby 95.8%
Adult 88.3%
Male 88.3%
Man 88.3%
Hat 66.3%

Text analysis

Amazon

College
Art
and
University
of
(Harvard
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
Fellows
Harvard
President
P1970.3994.0000

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.3994.0000
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.3994.0000