Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)
Date

May 1934-June 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.17
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.17

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.6
Human 99.6
Person 99.2
Person 99
Person 98.8
Person 98.6
Person 97.9
Sitting 97.8
Person 97.6
Person 97.6
Person 97.6
Person 97.3
Person 94.5
Brick 92.4
Clothing 90.8
Apparel 90.8
Person 90.6
Furniture 87.4
People 81.3
Person 79.4
Person 77.6
Outdoors 77.2
Person 70.7
Female 69.8
Nature 64.6
Crowd 61.1
Bench 61
Military Uniform 59.7
Military 59.7
Pants 59.5
Shorts 56.2
Army 55.3
Armored 55.3

Clarifai
created on 2023-10-29

people 99.9
group together 99.2
group 99.1
many 98.8
adult 98.6
man 96.1
child 94
administration 93.8
education 93.8
woman 93
position 91.2
leader 90.6
several 89.6
five 88
school 86.9
boy 86.7
music 83.5
baseball 83.1
sit 83
wear 82.5

Imagga
created on 2022-06-25

statue 22
military 18.3
classroom 17.5
man 17.5
old 17.4
sculpture 17.2
monument 16.8
architecture 16.4
building 16.1
room 15.9
people 15.6
male 15
soldier 14.7
history 14.3
kin 14.3
uniform 14.1
city 14.1
war 13.5
travel 13.4
historic 12.8
religion 12.5
clothing 12.4
person 12.1
gun 11.5
culture 11.1
world 11.1
danger 10.9
camouflage 10.8
army 10.7
tourism 10.7
weapon 10.3
musical instrument 10.2
dirty 9.9
art 9.8
ancient 9.5
adult 9.2
street 9.2
protection 9.1
industrial 9.1
landmark 9
historical 8.5
stone 8.4
religious 8.4
famous 8.4
color 8.3
traditional 8.3
destruction 7.8
antique 7.8
portrait 7.8
nuclear 7.8
men 7.7
mask 7.7
child 7.6
vehicle 7.5
classic 7.4
tradition 7.4
girls 7.3
military uniform 7.3
day 7.1

Google
created on 2022-06-25

Trousers 96.3
Window 86.7
Black-and-white 82.2
Monochrome 74.6
Team 72.5
Event 71.6
Art 69.6
Sitting 69.4
Facade 69.1
Monochrome photography 68.2
Crew 68.1
Brick 67.1
Motor vehicle 62.9
Vintage clothing 60.9
Street 60.9
Building 60.1
History 59.8
Suit 59.5
Crowd 54.5
Transport 50.6

Microsoft
created on 2022-06-25

building 99
person 97.4
clothing 97.3
man 91.7
outdoor 88.7
footwear 80.9
group 79.2
black and white 69.2
old 58
posing 39.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 100%
Confused 52.9%
Angry 25%
Calm 8.4%
Fear 7.2%
Surprised 6.7%
Disgusted 6.2%
Sad 2.9%
Happy 1.2%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 84.2%
Angry 11.4%
Surprised 6.5%
Fear 5.9%
Sad 2.5%
Happy 1.3%
Confused 1.1%
Disgusted 0.3%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 98%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.5%
Confused 0.3%
Calm 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Angry 74.6%
Disgusted 17.8%
Surprised 6.4%
Fear 6%
Confused 5.7%
Sad 2.4%
Calm 0.3%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 64.6%
Confused 24.3%
Surprised 6.9%
Fear 6.1%
Angry 4.6%
Sad 3.8%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 48-54
Gender Male, 100%
Angry 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Happy 0%
Disgusted 0%
Confused 0%
Calm 0%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 6.1%
Calm 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 34-42
Gender Male, 100%
Sad 83.9%
Calm 38.7%
Surprised 8.1%
Fear 7.9%
Confused 6.6%
Angry 3.7%
Disgusted 2.4%
Happy 2.3%

AWS Rekognition

Age 27-37
Gender Male, 83.1%
Happy 68.8%
Calm 13.5%
Confused 7.7%
Surprised 7.1%
Fear 6.3%
Sad 4.2%
Disgusted 1.3%
Angry 1.2%

AWS Rekognition

Age 25-35
Gender Male, 80.3%
Sad 95.4%
Confused 14.1%
Disgusted 11.1%
Surprised 8.6%
Fear 8.5%
Calm 7.2%
Angry 5.7%
Happy 4%

AWS Rekognition

Age 20-28
Gender Male, 99%
Sad 99.7%
Calm 18.8%
Surprised 6.7%
Fear 6.4%
Angry 5.2%
Happy 3.1%
Confused 2.8%
Disgusted 1.5%

AWS Rekognition

Age 30-40
Gender Male, 98.6%
Calm 85.7%
Angry 7%
Surprised 6.5%
Fear 5.9%
Confused 4.1%
Sad 2.9%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Sad 69.8%
Angry 48.6%
Calm 14.6%
Surprised 6.5%
Fear 6.1%
Confused 2.6%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 24-34
Gender Male, 99.1%
Confused 48.1%
Angry 19.3%
Calm 9.1%
Sad 8.1%
Surprised 7.8%
Fear 6.4%
Disgusted 5.4%
Happy 4%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.6%

Text analysis

Amazon

MURDERS
DOLLERSS
zu

Google

产 F
产
F