Human Generated Data

Title

Untitled (Lower East Side, New York City)
Date

April 1936
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2944
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2944

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Poster 100
Collage 100
Advertisement 100
Person 98.9
Human 98.9
Person 97.7
Person 97.4
Person 97.2
Person 96.4
Person 94.1
Person 94.1
Person 93.1
Person 90.4
Person 84
Person 83.4
Head 82
Person 77.8
Art 72.4
Person 70.1
Person 70.1
Person 64.7
Person 64.5
Person 63.8
Person 58.9
Person 57.4
Face 57.3
Painting 56
Person 47.3
Person 43.4

Clarifai
created on 2018-03-23

people 99.8
group 99.2
adult 98.8
many 97.7
print 97.2
woman 97.1
man 96.4
no person 94.7
portrait 94
one 93.1
art 92.1
museum 92.1
room 91.4
hospital 91.1
illustration 90.2
medicine 87.9
painting 87.1
music 87
set 84.8
wear 84.1

Imagga
created on 2018-03-23

locker 72.9
fastener 67.4
restraint 49.9
device 32.7
case 27.7
old 23.7
door 22.1
paper 19
architecture 18.7
frame 17.5
texture 16.7
lock 16.6
business 16.4
design 16.3
window 15.6
building 15.5
vintage 14.9
antique 14.1
art 13.9
ancient 13.8
grunge 13.6
symbol 12.8
money 12.7
entrance 12.5
wood 12.5
combination lock 12.5
telephone 12.4
set 11.9
finance 11.8
icon 11.1
house 10.9
currency 10.8
religion 10.7
retro 10.6
wooden 10.5
style 10.4
home 10.4
blank 10.3
pattern 10.2
shop 10.2
collection 9.9
gold 9.9
history 9.8
dollars 9.6
detail 9.6
wall 9.4
sign 9
office 9
wealth 9
sliding door 8.9
brown 8.8
urban 8.7
ornament 8.6
structure 8.6
close 8.6
glass 8.5
pay-phone 8.5
icons 8.4
church 8.3
electronic equipment 8.3
traditional 8.3
cash 8.2
decoration 8
gate 7.8
hundred 7.7
culture 7.7
card 7.6
temple 7.6
communication 7.5
city 7.5
historic 7.3
bank 7.3
aged 7.2
market 7.1
button 7
travel 7

Google
created on 2018-03-23

collection 92.9
art 69.7
museum 65.6
art gallery 61
history 61
black and white 60.2
hall of fame 57.4
visual arts 50.3

Microsoft
created on 2018-03-23

gallery 95
scene 76.4
bunch 75.3
room 72.7
old 67.5
white 65.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-13
Gender Male, 51%
Sad 46.2%
Calm 45.1%
Confused 45%
Disgusted 45.1%
Surprised 45.2%
Happy 53.4%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Happy 54.3%
Surprised 45%
Disgusted 45%
Confused 45%
Angry 45%
Calm 45%
Sad 45.7%

AWS Rekognition

Age 48-68
Gender Male, 54.3%
Happy 50.9%
Surprised 45.5%
Disgusted 45.2%
Confused 45.3%
Angry 45.9%
Calm 46.6%
Sad 45.7%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Calm 45.1%
Angry 45.1%
Happy 53.4%
Disgusted 45.1%
Sad 46.2%
Surprised 45.1%
Confused 45%

AWS Rekognition

Age 35-52
Gender Male, 52.5%
Confused 45.1%
Sad 51.8%
Angry 45.1%
Calm 45%
Happy 48%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Confused 45.2%
Sad 45.9%
Angry 45.4%
Calm 45.3%
Happy 48.5%
Surprised 45.3%
Disgusted 49.4%

AWS Rekognition

Age 26-43
Gender Female, 53.7%
Calm 49.1%
Angry 46.8%
Disgusted 46.2%
Happy 46.3%
Confused 45.2%
Surprised 45.5%
Sad 46%

AWS Rekognition

Age 35-52
Gender Female, 51%
Surprised 45.1%
Angry 45.2%
Sad 50.5%
Calm 48.9%
Disgusted 45.1%
Confused 45.1%
Happy 45.1%

AWS Rekognition

Age 38-59
Gender Female, 53.8%
Confused 45.1%
Surprised 45.2%
Happy 52.2%
Angry 45.2%
Disgusted 45.9%
Sad 46.1%
Calm 45.5%

AWS Rekognition

Age 1-5
Gender Female, 55%
Sad 46.1%
Disgusted 45.2%
Confused 45.2%
Surprised 45.4%
Calm 52.3%
Angry 45.3%
Happy 45.5%

AWS Rekognition

Age 48-68
Gender Male, 54.1%
Disgusted 45.5%
Confused 45.4%
Calm 49.5%
Surprised 45.5%
Angry 45.6%
Sad 46.7%
Happy 46.8%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Calm 45.1%
Surprised 45.2%
Happy 49.5%
Sad 49.7%
Disgusted 45.1%
Confused 45.2%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50%
Angry 45.3%
Happy 45.5%
Calm 46.4%
Surprised 45.2%
Confused 45.2%
Disgusted 45.2%
Sad 52.1%

AWS Rekognition

Age 14-23
Gender Female, 50.3%
Calm 49.5%
Surprised 49.5%
Happy 49.6%
Sad 50.3%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Surprised 49.5%
Confused 49.5%
Disgusted 49.6%
Calm 49.7%
Angry 49.5%
Sad 50%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Female, 52.8%
Calm 45.6%
Disgusted 52.7%
Angry 45.6%
Happy 45.2%
Confused 45.2%
Surprised 45.2%
Sad 45.5%

AWS Rekognition

Age 60-90
Gender Female, 54.4%
Calm 45%
Surprised 45%
Confused 45.1%
Angry 45.1%
Sad 53.4%
Happy 46.3%
Disgusted 45%

AWS Rekognition

Age 35-52
Gender Female, 54.8%
Calm 45%
Surprised 45.1%
Angry 45.1%
Sad 46.1%
Disgusted 45.1%
Confused 45%
Happy 53.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 50.1%
Calm 49.6%
Confused 49.5%
Disgusted 49.6%
Surprised 49.5%
Happy 49.5%
Angry 49.7%

AWS Rekognition

Age 11-18
Gender Female, 50.2%
Angry 49.5%
Sad 49.9%
Happy 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.7%
Calm 49.8%

AWS Rekognition

Age 27-44
Gender Male, 50.1%
Confused 49.5%
Surprised 49.5%
Angry 49.7%
Sad 49.8%
Happy 49.5%
Calm 49.7%
Disgusted 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Calm 49.7%
Angry 49.7%
Disgusted 49.6%
Happy 49.5%
Confused 49.6%
Surprised 49.6%
Sad 49.7%

AWS Rekognition

Age 27-44
Gender Female, 50.2%
Angry 49.6%
Calm 50%
Happy 49.7%
Disgusted 49.6%
Surprised 49.5%
Sad 49.6%
Confused 49.6%

AWS Rekognition

Age 38-57
Gender Male, 50.4%
Confused 49.6%
Sad 49.7%
Surprised 49.6%
Calm 49.6%
Happy 49.8%
Disgusted 49.6%
Angry 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Confused 49.5%
Surprised 49.5%
Calm 49.6%
Sad 50.2%
Disgusted 49.6%
Happy 49.5%
Angry 49.6%

AWS Rekognition

Age 19-36
Gender Male, 50.3%
Angry 49.6%
Sad 49.5%
Calm 49.5%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Disgusted 50.2%

AWS Rekognition

Age 26-44
Gender Male, 50.2%
Surprised 49.6%
Angry 49.6%
Sad 49.6%
Calm 49.6%
Disgusted 49.6%
Confused 49.6%
Happy 50%

AWS Rekognition

Age 20-38
Gender Female, 50%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.6%
Disgusted 49.6%
Sad 50.1%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Sad 50%
Calm 49.6%
Confused 49.5%
Angry 49.6%
Happy 49.7%
Disgusted 49.5%
Surprised 49.5%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 66
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft
created on 2018-03-23

a bunch of old photo of a person 60.8%
an old photo of a person 60.7%
old photo of a person 60.6%