Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4626

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4626

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Interior Design 97.4
Indoors 97.4
Person 97.3
Human 97.3
Person 92
Person 90
Screen 79.5
Electronics 79.5
Display 79.3
LCD Screen 75.6
Text 66.6
Person 62.8
Monitor 57.9
Person 55.2

Clarifai
created on 2023-10-25

people 98.1
art 97.9
collage 95.9
movie 95.7
window 95.6
screen 95.6
landscape 95.1
street 94.9
retro 94.8
museum 94.7
painting 93.2
man 92.8
vintage 92.6
picture frame 91.9
analogue 91.6
old 91.4
no person 91.1
one 90.2
monochrome 88.1
city 88

Imagga
created on 2022-01-08

monitor 100
electronic equipment 70.8
equipment 54.9
television 48.4
broadcasting 26.9
liquid crystal display 23.9
screen 22.8
business 20
frame 20
telecommunication 19.5
finance 18.6
computer 17.7
object 17.6
black 17.4
technology 17.1
money 17
dollar 16.7
close 16.5
currency 16.1
design 15.8
display 15.1
vintage 14.9
old 14.6
digital 14.6
paper 14.1
pattern 13.7
medium 13.3
note 12.9
blank 12.9
cash 12.8
financial 12.5
laptop 12.2
hand 12.1
wealth 11.7
space 11.6
hundred 11.6
blackboard 11.2
electronic 11.2
billboard 11.2
texture 11.1
banking 11
film 10.9
border 10.9
bank 10.7
retro 10.6
sign 10.5
modern 10.5
media 10.5
bill 10.5
closeup 10.1
symbol 10.1
global 10
board 9.9
information 9.7
dollars 9.7
collage 9.6
exchange 9.5
grunge 9.4
savings 9.3
communication 9.2
entertainment 9.2
one 9
office 8.8
chalkboard 8.8
telecommunication system 8.8
home 8.8
chalk 8.8
movie 8.7
us 8.7
flat 8.7
navigation 8.7
empty 8.6
nobody 8.5
card 8.5
art 8.5
structure 8.2
rough 8.2
detail 8
text 7.9
funds 7.8
bills 7.8
your 7.7
keyboard 7.5
signboard 7.5
rich 7.4
single 7.4
success 7.2
dirty 7.2
button 7

Google
created on 2022-01-08

Rectangle 85.3
Font 84
Adaptation 79.3
Tree 71.2
Display device 70.8
Event 69.6
Art 69.5
Wood 68.6
Visual arts 65.6
Monochrome 64.8
Room 64
Painting 63
History 62.9
Winter 61.8
Monochrome photography 61.3
Multimedia 60.6
Still life photography 60.5
Conifer 58.7
Twig 57.4
Media 55.5

Microsoft
created on 2022-01-08

text 99.7
screenshot 91.1
indoor 90.2
billboard 85.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 99.6%
Calm 63.3%
Sad 34.7%
Confused 0.8%
Angry 0.4%
Surprised 0.2%
Disgusted 0.2%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Angry 81.4%
Sad 13%
Disgusted 1.6%
Confused 1.3%
Calm 1.3%
Surprised 0.6%
Fear 0.6%
Happy 0.2%

AWS Rekognition

Age 16-24
Gender Male, 63%
Calm 99%
Sad 0.2%
Disgusted 0.2%
Surprised 0.2%
Confused 0.2%
Angry 0.2%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 99.4%
Sad 0.4%
Angry 0.1%
Confused 0.1%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 6-12
Gender Female, 57.6%
Disgusted 35.3%
Sad 17.8%
Fear 16.7%
Calm 11%
Confused 5.8%
Surprised 4.9%
Angry 4.4%
Happy 4.1%

AWS Rekognition

Age 12-20
Gender Male, 96.7%
Calm 67.7%
Confused 16.4%
Sad 5.8%
Angry 2.9%
Fear 2.7%
Disgusted 2.3%
Surprised 1.2%
Happy 1%

AWS Rekognition

Age 19-27
Gender Female, 51.6%
Calm 97.3%
Sad 0.7%
Angry 0.5%
Disgusted 0.5%
Confused 0.4%
Happy 0.2%
Surprised 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Monitor 57.9%

Categories

Captions

Microsoft
created on 2022-01-08

a screen shot of a television 66.9%
a screen shot of a microwave 39.6%
a screen door 39.5%

Text analysis

Amazon

SUPER
EASTMAN
21
II:
RO
CAN
SUPER XX
CAN RO TRANSMISSI
XX
L
TRANSMISSI
QUARS
CO
:1

Google

EASTMAN I1: STRANSMI SUPER X X 21
EASTMAN
I1:
STRANSMI
SUPER
X
21