Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4584.1-4

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4584.1-4

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Person 99.2
Person 99
Person 98.9
Person 98.5
Person 97.7
Person 97.6
Person 95.7
Person 94.7
Person 94.4
Monitor 89.3
Electronics 89.3
Screen 89.3
Display 89.3
Person 88.8
Person 87.3
Person 85.2
Person 80.7
Person 79.6
Person 76.1
Vehicle 73.4
Transportation 73.4
Person 72.2
Person 72.1
Person 70.4
Person 69.7
Person 68.3
Text 66.3
Person 65.6
Person 65.6
Person 63.8
People 63.2
Military Uniform 55.1
Military 55.1

Clarifai
created on 2023-10-25

movie 99.8
negative 99.4
filmstrip 98.6
people 97.4
slide 96.4
exposed 96.3
screen 96.1
cinematography 95.3
video 90.9
retro 90.8
woman 90.5
group 89.9
photograph 89.9
collage 89.4
art 88.7
bobbin 88.1
old 87.8
man 85.3
window 85.2
noisy 84.5

Imagga
created on 2022-01-08

television 100
broadcasting 65.3
monitor 49.9
telecommunication 48.2
film 34.6
negative 32.4
electronic equipment 32
medium 31.4
equipment 30.7
telecommunication system 26.4
business 18.8
city 16.6
photographic paper 15.6
screen 15
architecture 14.8
black 14.4
urban 14
digital 13.8
computer 13.6
technology 13.3
people 12.8
building 12
finance 11.8
office 11.5
old 11.1
art 11.1
entertainment 11
design 10.7
photographic equipment 10.4
light 10
frame 10
strip 9.7
movie 9.7
back 9.2
night 8.9
information 8.8
man 8.7
modern 8.4
communication 8.4
street 8.3
window 8.2
data 8.2
room 8.2
retro 8.2
display 7.9
glass 7.8
media 7.6
hand 7.6
horizontal 7.5
vintage 7.4
network 7.4
transport 7.3
border 7.2
copy space 7.2
interior 7.1
working 7.1
businessman 7.1
travel 7

Google
created on 2022-01-08

Rectangle 87.6
Font 82.8
Photographic film 81.2
Television set 80
Display device 78.7
Building 77.4
Electronic device 75.7
Multimedia 75.5
Art 72.5
Monochrome photography 71
Monochrome 69.5
Event 68.5
Facade 67.9
Visual arts 67.6
Advertising 67.4
Flat panel display 66
Negative 64.8
Room 63.9
Media 60.5
Projection screen 59.6

Microsoft
created on 2022-01-08

screenshot 96.6
text 87.5
vending machine 11.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 99.4%
Happy 99.8%
Calm 0.1%
Disgusted 0%
Surprised 0%
Confused 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 14-22
Gender Male, 88.5%
Calm 71.9%
Disgusted 13.5%
Sad 4.7%
Confused 2.9%
Happy 2.8%
Angry 2.1%
Fear 1.3%
Surprised 0.6%

AWS Rekognition

Age 23-33
Gender Male, 99.5%
Calm 91.6%
Sad 4.5%
Happy 0.9%
Fear 0.8%
Surprised 0.8%
Confused 0.7%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 33-41
Gender Male, 84.3%
Calm 99.5%
Sad 0.3%
Surprised 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 87.6%
Sad 26.9%
Surprised 25.7%
Fear 25.3%
Calm 13.5%
Disgusted 5%
Angry 2.4%
Happy 0.6%
Confused 0.5%

AWS Rekognition

Age 19-27
Gender Male, 99.1%
Calm 32.4%
Angry 30.7%
Sad 25.7%
Confused 5.1%
Disgusted 2.8%
Fear 1.6%
Surprised 0.9%
Happy 0.8%

AWS Rekognition

Age 6-14
Gender Male, 92.5%
Calm 56.7%
Happy 13.9%
Sad 9%
Fear 7.8%
Angry 4.4%
Disgusted 4.4%
Surprised 1.9%
Confused 1.9%

AWS Rekognition

Age 6-14
Gender Male, 98%
Calm 99.2%
Sad 0.3%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%
Fear 0%
Surprised 0%

AWS Rekognition

Age 22-30
Gender Male, 77.8%
Calm 32.8%
Disgusted 21.4%
Happy 18.7%
Sad 11.8%
Angry 4.6%
Fear 4.5%
Confused 4%
Surprised 2.1%

AWS Rekognition

Age 28-38
Gender Male, 87.1%
Calm 66.9%
Fear 14.5%
Sad 6.8%
Disgusted 4.5%
Happy 4.3%
Angry 1.6%
Confused 0.8%
Surprised 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.2%
Monitor 89.3%

Categories

Imagga

cars vehicles 98.1%
interior objects 1.3%

Captions

Microsoft
created on 2022-01-08

graphical user interface, website 99%

Text analysis

Amazon

5
SUPER
4
6
SUPER XX
XX
9
g

Google

SUPER X x
X
x
SUPER