Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4565

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98.4
Person 98.4
Person 97.7
Person 96.3
Monitor 92.8
Display 92.8
Screen 92.8
Electronics 92.8
Text 88.8
Person 87.6
Person 79
Outdoors 77.2
People 68.1
Nature 66.7
Person 62.7
Brick 58.5
LCD Screen 58
Indoors 56.8

Imagga
created on 2022-01-08

television 61.6
grunge 51.9
texture 41
old 38.3
frame 37
vintage 36.4
chest 32.5
antique 32.2
border 29.8
box 28.8
pattern 28.7
dirty 28
telecommunication system 27.8
retro 26.2
damaged 25.7
rough 25.5
art 24.9
grungy 24.7
broadcasting 24.1
design 23.6
material 23.2
black 22.8
container 21.5
graphic 21.2
aged 20.8
wall 19.2
film 18.2
blackboard 18.2
telecommunication 18.2
structure 17.6
textured 17.5
messy 17.4
stain 17.3
weathered 17.1
space 17.1
backdrop 16.5
rust 16.4
decoration 16.1
edge 15.4
empty 14.6
paint 14.5
ancient 13.8
wallpaper 13.8
digital 13.8
designed 13.8
photographic 13.7
noise 13.7
slide 13.7
movie 13.6
element 13.2
blank 12.9
frames 12.7
scratch 12.7
strip 12.6
layer 12.6
paper 12.5
negative 12.5
stained 12.5
mask 12.5
medium 12.4
rusty 12.4
screen 12.2
text 12.2
computer 12.2
layered 11.8
dark 11.7
obsolete 11.5
color 11.1
entertainment 11
noisy 10.8
mess 10.8
burned 10.8
your 10.6
surface 10.6
spot 10.5
dirt 10.5
board 9.9
equipment 9.8
chalkboard 9.8
chalk 9.7
sepia 9.7
collage 9.6
brown 9.6
artistic 9.6
camera 9.4
architecture 9.4
grain 9.2
style 8.9
highly 8.9
scratches 8.9
scratched 8.8
detailed 8.7
building 8.6
concrete 8.6
worn 8.6
old fashioned 8.6
electronic equipment 8.5
detail 8
grime 7.8
stains 7.8
crumpled 7.8
painted 7.6
wood 7.5
photograph 7.4
billboard 7.3
backgrounds 7.3
effect 7.3
modern 7

Google
created on 2022-01-08

Rectangle 80.9
Font 77.5
Multimedia 69.9
Display device 69
Event 64.1
Screenshot 63.9
Room 61
Darkness 57.3
History 55.8
Visual arts 54.3
Art 53.1
Software 52.9
Media 52
Paper product 51.7
Screen 51.6

Microsoft
created on 2022-01-08

screenshot 98.5
text 97.1

Face analysis

Amazon

AWS Rekognition

Age 52-60
Gender Male, 99.8%
Calm 91%
Sad 5.6%
Confused 1%
Disgusted 1%
Angry 0.4%
Happy 0.4%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 18-24
Gender Female, 78.3%
Calm 89.2%
Confused 7.3%
Surprised 0.8%
Fear 0.7%
Disgusted 0.6%
Angry 0.6%
Happy 0.4%
Sad 0.3%

AWS Rekognition

Age 14-22
Gender Male, 90.8%
Sad 32.9%
Calm 21.9%
Confused 12.6%
Disgusted 12%
Angry 9.7%
Fear 6.4%
Surprised 2.8%
Happy 1.6%

AWS Rekognition

Age 14-22
Gender Female, 92.1%
Sad 94.9%
Calm 2.1%
Fear 1.5%
Angry 0.5%
Confused 0.4%
Disgusted 0.2%
Happy 0.2%
Surprised 0.1%

AWS Rekognition

Age 38-46
Gender Female, 92.6%
Calm 64%
Sad 27.2%
Disgusted 3.3%
Angry 1.7%
Happy 1.2%
Fear 1.1%
Surprised 1%
Confused 0.5%

AWS Rekognition

Age 13-21
Gender Female, 84.2%
Calm 93.7%
Sad 2.7%
Happy 1.3%
Surprised 1.1%
Fear 0.6%
Disgusted 0.3%
Angry 0.1%
Confused 0.1%

Feature analysis

Amazon

Person 98.4%
Monitor 92.8%

Captions

Microsoft

a man standing in front of a television 39.9%
a man standing in front of a television screen 37.4%
a screen shot of a man 37.3%

Text analysis

Amazon

33
32
FILM
35
зе
SAFETY. FILM
XX
34
SAFETY.
31
206EN XX
SUBER XX
SUBER
BYS
206EN

Google

XX
2NBEH
33
34
32
31 2NBEH XX 35 33 34 32 2NBEH XX 30
30
31
35