Human Generated Data

Title

Untitled (United Steel workers of America and CIO event, New Jersey)
Date

c. 1945
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2952
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (United Steel workers of America and CIO event, New Jersey)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2952

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Cinema 98.9
Photographic Film 77.5
Person 72.2
Person 70.6
Person 57.6
Person 55.1

Clarifai
created on 2018-05-10

people 98
no person 92.4
adult 92.3
city 90.6
empty 88.1
man 86.7
picture frame 86
wear 85.4
street 85.1
blank 84.7
screen 84.4
retro 82.5
museum 80.2
business 80
stadium 78.9
room 78.4
urban 77.8
indoors 77.7
dirty 77
architecture 76.7

Imagga
created on 2023-10-06

electronic equipment 31.1
freight car 28.9
equipment 25.5
negative 25.1
film 24.9
monitor 24.9
car 24.3
grunge 20.4
old 18.8
texture 18.7
liquid crystal display 18.3
vintage 18.2
digital 17.8
wheeled vehicle 17.6
retro 16.4
border 16.3
graphic 16
night 16
frame 15.8
art 15.6
blackboard 15.6
radio 15.6
damaged 15.3
city 15
design 14.6
computer 14.3
business 14
antique 13.8
pattern 13.7
dirty 13.6
architecture 13.3
black 13.2
structure 12.9
television 12.9
space 12.4
text 12.2
light 12
dark 11.7
movie 11.6
material 11.6
screen 11.2
technology 11.1
vehicle 11
landmark 10.8
photographic 10.8
noise 10.7
collage 10.6
grungy 10.4
finance 10.1
entertainment 10.1
board 10.1
building 10.1
rough 10
paint 10
scratches 9.8
designed 9.8
financial 9.8
frames 9.8
slide 9.8
strip 9.7
your 9.7
edge 9.6
urban 9.6
bridge 9.5
blank 9.4
paper 9.4
wall 9.4
broadcasting 9.3
music 9
display 9
equalizer 8.9
photographic paper 8.9
success 8.8
office 8.8
scratch 8.8
water 8.7
rust 8.7
weathered 8.5
evening 8.4
amplifier 8.3
aged 8.1
bank 8.1
projects 7.9
noisy 7.9
highly 7.9
color 7.8
travel 7.7
sell 7.7
messy 7.7
empty 7.7
modern 7.7
detailed 7.7
mask 7.7
sky 7.7
skyline 7.6
showing 7.5
famous 7.4
element 7.4
camera 7.4
street 7.4
electric organ 7.4
banking 7.4
telecommunication 7.2
device 7.1
interior 7.1

Google
created on 2018-05-10

black 95.6
photograph 95
black and white 91.2
photography 80.1
monochrome photography 75.4
monochrome 70.5
font 62.6
stock photography 50.8
history 50.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 4-10
Gender Female, 68.6%
Calm 32.9%
Happy 22.8%
Confused 11.5%
Sad 11.5%
Surprised 10.3%
Fear 8.4%
Angry 4.5%
Disgusted 3.7%

AWS Rekognition

Age 24-34
Gender Male, 97.4%
Calm 42%
Disgusted 23.5%
Surprised 15%
Sad 7.9%
Confused 6.7%
Fear 6.1%
Happy 3.5%
Angry 3%

AWS Rekognition

Age 19-27
Gender Male, 99.3%
Calm 90%
Surprised 6.4%
Fear 6.2%
Angry 4.6%
Sad 3%
Happy 0.8%
Confused 0.5%
Disgusted 0.5%

AWS Rekognition

Age 4-10
Gender Male, 96.7%
Calm 62.5%
Sad 15.6%
Fear 7.4%
Angry 7.3%
Surprised 6.8%
Disgusted 6.6%
Confused 2.6%
Happy 1.3%

AWS Rekognition

Age 22-30
Gender Male, 58.5%
Calm 46.2%
Sad 18.5%
Disgusted 15%
Confused 8.5%
Surprised 7.6%
Fear 7.5%
Happy 4.2%
Angry 3.3%

AWS Rekognition

Age 18-26
Gender Female, 69.5%
Surprised 28.8%
Angry 18.2%
Happy 16.2%
Disgusted 14.4%
Confused 11.2%
Fear 7.4%
Sad 7%
Calm 6.8%

AWS Rekognition

Age 12-20
Gender Male, 97.2%
Confused 45.2%
Surprised 18%
Angry 15.1%
Calm 8.5%
Happy 8%
Fear 6.7%
Sad 3.8%
Disgusted 3.1%

AWS Rekognition

Age 28-38
Gender Male, 92.7%
Calm 78.1%
Surprised 7%
Fear 6.1%
Sad 5.4%
Happy 5.3%
Angry 4.7%
Disgusted 2.8%
Confused 0.5%

AWS Rekognition

Age 0-3
Gender Male, 83.1%
Calm 88.6%
Surprised 7.8%
Fear 6.2%
Sad 2.9%
Disgusted 2.5%
Happy 1.7%
Angry 1.1%
Confused 0.5%

AWS Rekognition

Age 14-22
Gender Male, 99.5%
Sad 72.2%
Confused 26.8%
Disgusted 12.9%
Surprised 12.5%
Fear 9%
Calm 4.9%
Happy 4.3%
Angry 2%

AWS Rekognition

Age 23-33
Gender Male, 99.1%
Sad 30.3%
Angry 27.8%
Calm 20.9%
Happy 9.7%
Disgusted 9.1%
Fear 8.4%
Surprised 7%
Confused 4.4%

AWS Rekognition

Age 31-41
Gender Male, 97.2%
Calm 50.1%
Sad 27.8%
Angry 12.3%
Fear 8.7%
Surprised 7.5%
Happy 6.8%
Disgusted 1.5%
Confused 0.8%

AWS Rekognition

Age 19-27
Gender Male, 86.5%
Calm 75.2%
Happy 17.1%
Surprised 6.7%
Fear 6.2%
Sad 3.4%
Angry 1.1%
Disgusted 1.1%
Confused 0.6%

AWS Rekognition

Age 16-22
Gender Male, 78%
Happy 88.7%
Calm 7.8%
Surprised 6.7%
Fear 6.4%
Sad 2.3%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 23-33
Gender Male, 93.6%
Happy 45.3%
Angry 20.6%
Calm 18.4%
Surprised 9.2%
Fear 6.4%
Confused 4%
Sad 3.5%
Disgusted 1.8%

AWS Rekognition

Age 20-28
Gender Male, 85%
Calm 96.1%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Disgusted 1.9%
Happy 0.5%
Angry 0.5%
Confused 0.2%

AWS Rekognition

Age 4-10
Gender Male, 96.6%
Happy 74.3%
Angry 9.9%
Surprised 8.5%
Fear 7.3%
Sad 3.8%
Calm 2.8%
Disgusted 1.2%
Confused 0.4%

AWS Rekognition

Age 20-28
Gender Male, 76.2%
Calm 71%
Angry 15.2%
Surprised 7.3%
Happy 6.5%
Fear 6.1%
Sad 2.6%
Disgusted 2%
Confused 1.4%

AWS Rekognition

Age 24-34
Gender Male, 71.2%
Sad 51.4%
Calm 22.9%
Angry 17%
Disgusted 9.7%
Surprised 9.1%
Confused 8.8%
Happy 7.5%
Fear 6.8%

AWS Rekognition

Age 27-37
Gender Male, 81.1%
Calm 81%
Surprised 6.9%
Fear 6.8%
Happy 6.3%
Sad 3.8%
Angry 3.1%
Disgusted 1.5%
Confused 0.6%

AWS Rekognition

Age 6-12
Gender Male, 87.3%
Calm 96.8%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Angry 1.4%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 57.8%
Calm 95.8%
Surprised 6.3%
Fear 6.1%
Sad 2.4%
Happy 1.7%
Angry 0.5%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 12-20
Gender Male, 68.9%
Happy 77.4%
Calm 10.8%
Surprised 7.6%
Fear 6.2%
Sad 3.4%
Disgusted 2.6%
Angry 1.8%
Confused 0.8%

AWS Rekognition

Age 18-24
Gender Male, 99.5%
Calm 89.7%
Angry 8.1%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Happy 0.6%
Confused 0.3%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.5%
Sad 95.5%
Calm 31.9%
Fear 11.4%
Surprised 6.6%
Angry 4.9%
Happy 2.1%
Disgusted 1%
Confused 0.6%

Feature analysis

Amazon

Person 72.2%

Captions

Microsoft
created on 2018-05-10

a store front at day 83.7%
a store inside of a building 83.6%
a black and white photo of a store 68.8%

Text analysis

Amazon

KODAK
33
32
MURRAY
RRAY
MURRA
PHILIP MURRAY
PHILIP
PHILIP MURRA
COME
WELCOME
PHILIP MURR
H
34
MURR
x
35
brne x
ЬГna x
3
brne
ЬГna
ЬГnax

Google

RAY MURRAY PHILIP MURRAY PHILIP MURI PHILIP MURRA 31 brna x 3S 3寸 32
RAY
MURRAY
PHILIP
MURI
MURRA
31
brna
x
3S
3
寸
32