Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4622.1-2

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Interior Design 100
Indoors 100
Person 99.4
Human 99.4
Person 98.5
Person 98.5
Person 97.3
Person 95.6
Person 94.1
Monitor 92.9
Electronics 92.9
Display 92.9
Screen 92.9
Room 91.6
Person 79.7
Theater 71
People 66.1
Cinema 62.9
Person 56.5
Person 52.1

Imagga
created on 2022-01-08

monitor 93.4
electronic equipment 70.1
equipment 49.7
liquid crystal display 35.3
billboard 26.9
signboard 21.2
screen 20.8
film 20.2
border 19.9
vintage 19.8
structure 19.7
computer 19.5
digital 19.4
collage 19.3
frame 18.3
design 18
black 17.4
old 17.4
grunge 17
retro 16.4
text 15.7
movie 15.5
your 15.5
dirty 15.4
graphic 14.6
texture 14.6
business 14.6
art 14.3
city 14.1
space 14
noise 13.7
pattern 13.7
rough 13.7
scratch 13.7
car 13.5
rust 13.5
grungy 13.3
scratches 12.8
photographic 12.7
frames 12.7
slide 12.7
negative 12.7
strip 12.6
edge 12.5
damaged 12.4
hand 12.2
antique 12.1
entertainment 12
finance 11.8
designed 11.8
architecture 11.7
weathered 11.4
display 10.9
noisy 10.8
road 10.8
blackboard 10.6
detailed 10.6
office 10.6
mask 10.5
technology 10.4
television 10.3
camera 10.2
paint 10
highly 9.8
layered 9.8
mess 9.8
night 9.8
messy 9.7
layer 9.7
urban 9.6
dirt 9.5
closeup 9.4
paper 9.4
dollar 9.3
street 9.2
banking 9.2
close 9.1
modern 9.1
landmark 9
material 8.9
financial 8.9
projects 8.9
decoration 8.7
us 8.7
bridge 8.6
media 8.6
bill 8.6
destination 8.4
evening 8.4
element 8.3
global 8.2
symbol 8.1
bank 8.1
success 8
freight car 8
overlay 7.9
blank 7.7
money 7.7
cityscape 7.6
communication 7.6
sign 7.5
electronic 7.5
water 7.3
speed 7.3
building 7.2
color 7.2
currency 7.2

Google
created on 2022-01-08

Rectangle 86.3
Tree 84.3
Font 80.8
Display device 75.8
Multimedia 71.3
Monochrome photography 68.1
Event 67.3
Winter 67.3
Monochrome 66.6
Snow 62.8
Room 62.5
Twig 61.8
Visual arts 61.7
Media 56.2
City 56
Photographic paper 54.4
Freezing 53.1

Microsoft
created on 2022-01-08

screenshot 95.2
text 94.2
television 52.4

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 97.1%
Happy 85.6%
Sad 8.4%
Calm 1.6%
Fear 1.6%
Surprised 0.9%
Disgusted 0.8%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Calm 83.1%
Happy 12%
Sad 1.2%
Disgusted 1.1%
Surprised 1.1%
Angry 0.6%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Calm 98.5%
Sad 0.5%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Male, 97.6%
Calm 70.1%
Sad 16.7%
Confused 7.7%
Happy 1.7%
Angry 1.4%
Disgusted 1.1%
Surprised 0.7%
Fear 0.6%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Calm 71.1%
Happy 9.9%
Sad 9.6%
Confused 5.8%
Disgusted 1.2%
Surprised 0.9%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 16-24
Gender Female, 85.4%
Calm 84.2%
Sad 14.7%
Happy 0.4%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 43-51
Gender Male, 89.3%
Calm 93.8%
Happy 3.5%
Sad 1%
Disgusted 0.6%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 16-24
Gender Male, 89.9%
Calm 52%
Angry 27.7%
Sad 7.3%
Fear 4.8%
Disgusted 2.4%
Happy 2.1%
Surprised 2%
Confused 1.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Monitor 92.9%

Captions

Microsoft

graphical user interface, website 96.1%

Text analysis

Amazon

SUPER
14
13
SUPER XX
XX

Google

T0000 13 13 SUPER XX 14
T0000
13
SUPER
XX
14