Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs' House, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4245

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs' House, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4245

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Interior Design 100
Indoors 100
Person 99.4
Human 99.4
Person 99
Person 98.9
Person 98.5
Person 98.4
Person 97.6
Person 97.3
Room 96.6
Person 95.7
Person 94.2
Person 93.7
Person 93.6
Person 93.5
Person 93
Display 92.4
Electronics 92.4
Monitor 92.4
Screen 92.4
Theater 90.4
Person 88.2
Person 87.6
Sailor Suit 87.4
Person 85.8
Person 82.9
Cinema 77.5
Person 74.5
Crowd 72.7
TV 70
Television 70
Person 68.7
Clothing 67.7
Apparel 67.7
Leisure Activities 59.9
People 56.2

Clarifai
created on 2023-10-25

people 100
group 99.3
adult 98.3
man 96.9
woman 96.9
wear 96.8
many 96.3
group together 95.2
art 94.4
music 94.2
train 93.1
portrait 91.8
furniture 90.9
transportation system 89.5
leader 89.4
child 89.2
movie 88.7
administration 88.5
royalty 88.4
two 87.9

Imagga
created on 2022-01-08

man 29.6
people 26.2
male 24.8
cornet 20.8
wind instrument 20.3
musical instrument 20.1
brass 19.6
person 19.3
adult 16.8
men 16.3
television 16
black 15.9
old 15.3
business 15.2
businessman 15
clothing 13
statue 11.4
silhouette 10.8
religion 10.7
history 10.7
face 10.6
couple 10.4
sitting 10.3
portrait 9.7
sculpture 9.7
happiness 9.4
architecture 9.4
mature 9.3
indoor 9.1
building 9.1
human 9
one 8.9
night 8.9
looking 8.8
standing 8.7
love 8.7
world 8.5
city 8.3
art 8.1
handsome 8
academic gown 8
lifestyle 7.9
hair 7.9
gown 7.8
broadcasting 7.8
corporate 7.7
elegant 7.7
god 7.6
two 7.6
executive 7.6
senior 7.5
monument 7.5
life 7.4
stringed instrument 7.4
group 7.2
shadow 7.2
worker 7.1
suit 7.1
job 7.1
upright 7

Google
created on 2022-01-08

Hat 87.1
Gesture 85.3
Art 81
Font 79.4
Suit 71.9
Event 71.6
Vintage clothing 67.6
Display device 66.9
Visual arts 65.1
Room 62.3
Stock photography 61.8
Monochrome photography 58.9
Crowd 57.9
Collection 56.3
History 55.4
Monochrome 55.3
Advertising 54.5

Microsoft
created on 2022-01-08

person 98.2
text 91.1
clothing 84.5
window 84.3
man 73.6
statue 50.9
old 46.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-36
Gender Male, 99%
Calm 98.3%
Surprised 0.7%
Sad 0.5%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 18-24
Gender Male, 85.6%
Calm 99.6%
Surprised 0.2%
Angry 0.1%
Confused 0%
Sad 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Calm 99.9%
Happy 0.1%
Surprised 0%
Angry 0%
Disgusted 0%
Confused 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 97.8%
Sad 46.1%
Calm 32.7%
Confused 11.6%
Surprised 3%
Angry 2.7%
Happy 1.5%
Disgusted 1.5%
Fear 0.8%

AWS Rekognition

Age 39-47
Gender Male, 92.6%
Calm 91.8%
Sad 5.5%
Happy 0.9%
Fear 0.7%
Disgusted 0.4%
Angry 0.4%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 10-18
Gender Female, 97.6%
Calm 44.3%
Angry 23.9%
Happy 18.5%
Sad 5.9%
Surprised 2.1%
Fear 1.8%
Disgusted 1.8%
Confused 1.7%

AWS Rekognition

Age 14-22
Gender Male, 71.7%
Calm 98.8%
Sad 0.4%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99%
Calm 61.4%
Sad 14%
Surprised 8.1%
Angry 5.2%
Happy 5.1%
Confused 3.4%
Fear 1.5%
Disgusted 1.3%

AWS Rekognition

Age 26-36
Gender Male, 92.6%
Calm 66.1%
Disgusted 9.1%
Happy 8.5%
Sad 7.1%
Angry 4%
Confused 2.8%
Surprised 1.5%
Fear 1%

AWS Rekognition

Age 42-50
Gender Female, 67.6%
Calm 91%
Happy 3.2%
Surprised 1.6%
Sad 1.2%
Angry 0.8%
Fear 0.8%
Disgusted 0.7%
Confused 0.6%

AWS Rekognition

Age 28-38
Gender Female, 75.2%
Calm 78.5%
Angry 11.8%
Disgusted 4%
Surprised 2.9%
Happy 1.7%
Sad 0.5%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Male, 96.7%
Sad 52.5%
Calm 14.2%
Disgusted 14.2%
Angry 6.4%
Fear 4%
Confused 3.7%
Happy 3.1%
Surprised 1.9%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Calm 63.5%
Happy 7.6%
Angry 6.9%
Surprised 6.2%
Fear 6.1%
Sad 4.1%
Disgusted 4%
Confused 1.6%

AWS Rekognition

Age 35-43
Gender Female, 87.2%
Calm 88.7%
Angry 7.7%
Sad 1.9%
Happy 0.6%
Confused 0.4%
Surprised 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Female, 57.7%
Calm 80.8%
Angry 5.6%
Happy 4.4%
Surprised 2.4%
Sad 2.1%
Confused 2.1%
Fear 1.3%
Disgusted 1.3%

AWS Rekognition

Age 26-36
Gender Female, 87.1%
Calm 66.8%
Angry 22%
Disgusted 4.8%
Surprised 2.2%
Happy 1.9%
Sad 1.4%
Confused 0.6%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Fear 59.9%
Angry 15.9%
Disgusted 7.5%
Calm 6.9%
Sad 5.4%
Happy 1.7%
Surprised 1.6%
Confused 1%

AWS Rekognition

Age 25-35
Gender Female, 75.9%
Calm 83%
Happy 4.1%
Sad 4.1%
Disgusted 3.2%
Angry 1.9%
Surprised 1.5%
Fear 1.2%
Confused 1.1%

AWS Rekognition

Age 10-18
Gender Female, 54.4%
Calm 39%
Happy 27.3%
Angry 8.5%
Confused 7.8%
Surprised 7%
Sad 3.7%
Fear 3.6%
Disgusted 3%

AWS Rekognition

Age 16-22
Gender Male, 94.6%
Sad 49.1%
Calm 23.6%
Disgusted 10.2%
Confused 5.6%
Happy 5.1%
Angry 3.8%
Fear 1.7%
Surprised 0.8%

AWS Rekognition

Age 23-33
Gender Female, 96.4%
Calm 97.5%
Happy 0.5%
Fear 0.5%
Sad 0.4%
Confused 0.4%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 41-49
Gender Female, 65.6%
Calm 88.5%
Sad 3.6%
Happy 2.5%
Angry 2.2%
Surprised 1.1%
Disgusted 1%
Confused 0.5%
Fear 0.5%

AWS Rekognition

Age 26-36
Gender Female, 91.6%
Calm 89.9%
Angry 5.2%
Happy 1.2%
Sad 1.2%
Surprised 0.7%
Disgusted 0.7%
Confused 0.6%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Female, 97.9%
Calm 54.1%
Angry 36.8%
Sad 5.7%
Surprised 1.1%
Confused 0.8%
Happy 0.7%
Fear 0.6%
Disgusted 0.3%

AWS Rekognition

Age 22-30
Gender Female, 85.8%
Calm 45.3%
Angry 23.1%
Sad 10.8%
Happy 5.9%
Surprised 5.7%
Confused 3.3%
Disgusted 3.1%
Fear 2.9%

AWS Rekognition

Age 27-37
Gender Female, 93.2%
Calm 56.6%
Angry 16.6%
Sad 13.2%
Disgusted 5.8%
Surprised 4.3%
Fear 1.3%
Happy 1.1%
Confused 1%

AWS Rekognition

Age 29-39
Gender Male, 93.5%
Calm 95.8%
Angry 1.5%
Sad 0.9%
Surprised 0.6%
Happy 0.5%
Disgusted 0.3%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 38-46
Gender Female, 99.2%
Calm 97.2%
Happy 1.1%
Angry 0.7%
Surprised 0.3%
Disgusted 0.2%
Sad 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Female, 88.9%
Calm 98.7%
Angry 0.4%
Surprised 0.2%
Sad 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 14-22
Gender Female, 100%
Calm 92%
Angry 5%
Happy 1.2%
Fear 0.6%
Sad 0.4%
Confused 0.4%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Male, 84.5%
Calm 98.8%
Sad 0.4%
Angry 0.4%
Happy 0.3%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Calm 76%
Angry 6.8%
Sad 5.5%
Happy 3.6%
Disgusted 3%
Surprised 2.3%
Confused 1.9%
Fear 0.9%

AWS Rekognition

Age 25-35
Gender Male, 62.1%
Calm 83.2%
Happy 3.7%
Sad 2.7%
Confused 2.6%
Surprised 2.5%
Angry 2.4%
Fear 1.6%
Disgusted 1.3%

AWS Rekognition

Age 39-47
Gender Female, 98.5%
Calm 87.9%
Happy 4.5%
Angry 3.4%
Surprised 2.1%
Sad 1.2%
Disgusted 0.4%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Female, 82.2%
Calm 71.6%
Happy 13.6%
Disgusted 5.3%
Surprised 2.5%
Angry 2.5%
Sad 2.1%
Fear 1.6%
Confused 0.8%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 70.8%
Happy 11.2%
Sad 7.6%
Confused 2.8%
Angry 2.6%
Fear 2%
Surprised 1.6%
Disgusted 1.4%

AWS Rekognition

Age 27-37
Gender Female, 99.4%
Calm 88%
Sad 3.8%
Angry 2.8%
Happy 2.5%
Fear 1%
Surprised 1%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 23-33
Gender Female, 97%
Calm 51.2%
Angry 12.1%
Happy 8.5%
Sad 8.5%
Confused 6.7%
Disgusted 6.3%
Surprised 4.2%
Fear 2.4%

AWS Rekognition

Age 14-22
Gender Female, 64%
Calm 87.5%
Angry 4.6%
Surprised 2.3%
Happy 1.8%
Sad 1.6%
Fear 1.2%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 16-22
Gender Female, 71.1%
Calm 98.4%
Sad 0.6%
Angry 0.4%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Male, 84.8%
Calm 92%
Confused 1.7%
Surprised 1.7%
Angry 1.6%
Sad 1%
Disgusted 0.9%
Happy 0.7%
Fear 0.4%

Feature analysis

Amazon

Person 99.4%

Text analysis

Amazon

STOP
BLACKList
IN
is
is THE
AND IN STOP
THE
INSTITUTE
DO
DIES
CHURCH
DO BONT
AND
IV
SEAMLAS
A DIES EU SEAMLAS CHURCH
A
BONT
Jon
EU
aart
MANERS

Google

Dn
bOnI
Dn bOnI