Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4588.1-4

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4588.1-4

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.7
Human 98.7
Person 97.8
Person 97.7
Person 97.3
Person 97
Person 96.5
Person 96.3
Person 96.2
Person 95.8
Person 95.6
Person 90.4
Person 80.3
Military Uniform 78.8
Military 78.8
Person 72.5
Person 71.9
Person 70.8
Person 69.7
Person 66.3
Person 64.7
Soldier 60.4
Monitor 59.5
Electronics 59.5
Screen 59.5
Display 59.5
Person 53.3

Clarifai
created on 2023-10-25

movie 99.4
negative 99.2
people 97.9
filmstrip 94.3
group 90
slide 89.1
photograph 88.8
cinematography 86.1
screen 84
exposed 84
industry 80.3
man 80.1
old 80.1
military 78.8
blank 78
adult 77.4
monochrome 76.2
noisy 75.8
art 74.8
security 74.2

Imagga
created on 2022-01-08

barbershop 46.8
negative 41.4
film 39
shop 38.9
mercantile establishment 30.2
building 23.9
architecture 21.1
city 20.8
photographic paper 20.5
old 20.2
place of business 20.1
billboard 16.3
business 15.8
retro 14.7
structure 14.6
black 14.4
vintage 14.1
signboard 13.9
photographic equipment 13.6
cinema 13.3
urban 13.1
grunge 12.8
art 12.4
text 12.2
design 11.8
house 11.8
travel 11.3
bank 11
frame 10.8
movie 10.7
equipment 10.1
symbol 10.1
establishment 10.1
antique 9.5
graphic 9.5
finance 9.3
camera 9.2
texture 9
digital 8.9
group 8.9
case 8.8
us 8.7
collage 8.7
ancient 8.6
paper 8.6
screen 8.6
money 8.5
sky 8.3
entertainment 8.3
sign 8.3
banking 8.3
tourism 8.2
cash 8.2
border 8.1
landmark 8.1
history 8
financial 8
sequencer 8
slide 7.8
decoration 7.8
motion 7.7
bill 7.6
capital 7.6
facade 7.6
window 7.5
historical 7.5
famous 7.4
exterior 7.4
office 7.3
historic 7.3
dirty 7.2
transportation 7.2

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 74.8%
Calm 75.4%
Disgusted 17.2%
Sad 4.8%
Angry 1%
Surprised 0.6%
Fear 0.4%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 69.1%
Sad 28.3%
Confused 0.8%
Angry 0.5%
Surprised 0.5%
Disgusted 0.3%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Calm 91.1%
Sad 4%
Confused 1.9%
Disgusted 1.2%
Angry 0.6%
Surprised 0.6%
Fear 0.5%
Happy 0.1%

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Calm 67.1%
Sad 32.2%
Fear 0.3%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%
Surprised 0%

AWS Rekognition

Age 54-64
Gender Male, 99.8%
Calm 39.4%
Sad 31.5%
Confused 15.6%
Angry 9.7%
Surprised 1.6%
Disgusted 0.8%
Fear 0.8%
Happy 0.7%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Happy 91%
Sad 5.8%
Disgusted 2.2%
Angry 0.4%
Confused 0.3%
Fear 0.1%
Surprised 0.1%
Calm 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Calm 50.4%
Confused 28.1%
Sad 16.3%
Surprised 2%
Disgusted 1.3%
Fear 0.8%
Angry 0.8%
Happy 0.4%

AWS Rekognition

Age 9-17
Gender Male, 90.8%
Calm 87.3%
Angry 3.8%
Sad 3.3%
Surprised 2.1%
Disgusted 1.1%
Confused 0.9%
Happy 0.8%
Fear 0.7%

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Calm 82.5%
Confused 5.5%
Angry 3.5%
Surprised 3.2%
Happy 2.6%
Sad 1.4%
Disgusted 1%
Fear 0.3%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 29.3%
Surprised 23%
Confused 16.7%
Sad 14.2%
Angry 8.4%
Disgusted 5.2%
Happy 2.3%
Fear 1%

AWS Rekognition

Age 33-41
Gender Male, 97.5%
Calm 99.3%
Angry 0.2%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 86%
Sad 10.7%
Surprised 1.5%
Angry 0.7%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Disgusted 46.4%
Calm 32.1%
Sad 11.1%
Angry 4.2%
Surprised 1.8%
Confused 1.7%
Fear 1.7%
Happy 1%

AWS Rekognition

Age 29-39
Gender Male, 93.4%
Happy 39.2%
Calm 36.4%
Sad 9.7%
Confused 3.8%
Surprised 3.6%
Fear 3.1%
Angry 2.3%
Disgusted 1.9%

AWS Rekognition

Age 51-59
Gender Male, 99.6%
Calm 99.7%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 53-61
Gender Male, 98.6%
Sad 50.5%
Calm 39%
Angry 5.8%
Confused 2.8%
Happy 0.8%
Disgusted 0.5%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 10-18
Gender Male, 82%
Angry 92%
Calm 3%
Happy 1.7%
Sad 1.4%
Fear 0.9%
Surprised 0.5%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Calm 63.2%
Sad 23%
Happy 5.6%
Surprised 3.3%
Confused 2.3%
Angry 1.3%
Disgusted 0.8%
Fear 0.5%

AWS Rekognition

Age 13-21
Gender Male, 99.8%
Calm 93.7%
Sad 2.6%
Happy 1.6%
Angry 0.8%
Fear 0.6%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 21-29
Gender Female, 81.6%
Calm 73.1%
Happy 11.2%
Disgusted 5.2%
Sad 4.3%
Fear 3.6%
Angry 1.2%
Surprised 0.7%
Confused 0.7%

AWS Rekognition

Age 19-27
Gender Male, 96.3%
Calm 95.1%
Sad 1.3%
Happy 1.1%
Angry 1%
Disgusted 0.6%
Confused 0.4%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Male, 93.4%
Angry 50.4%
Calm 44.2%
Sad 2.6%
Surprised 0.9%
Fear 0.9%
Happy 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Female, 57.3%
Calm 98.4%
Sad 0.5%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 7-17
Gender Male, 99%
Calm 97.6%
Sad 1%
Angry 0.4%
Happy 0.3%
Disgusted 0.3%
Surprised 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Female, 69.5%
Calm 87.1%
Angry 8.3%
Sad 3.1%
Surprised 0.4%
Fear 0.3%
Happy 0.3%
Confused 0.3%
Disgusted 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Calm 85.3%
Happy 10.7%
Sad 1%
Angry 0.8%
Confused 0.8%
Surprised 0.6%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 10-18
Gender Male, 85.8%
Sad 40.1%
Happy 28.9%
Calm 15.2%
Angry 5.4%
Surprised 3.5%
Disgusted 3.1%
Fear 2.3%
Confused 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Unlikely

Feature analysis

Amazon

Person 98.7%
Monitor 59.5%

Categories

Imagga

interior objects 57.3%
cars vehicles 37.6%
food drinks 1.8%

Text analysis

Amazon

14
15
16
EAST
SUPER
17
4
1 4
1
SUPER XX
XX
LO
HELLO

Google

XX
SUPER XX STN
SUPER
STN