Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4635

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4635

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 99.2
Person 98.2
Interior Design 97.9
Indoors 97.9
Person 95.4
Person 94.2
Person 93.2
Person 91.8
Person 89
Person 85.5
Screen 75
Electronics 75
Person 74.3
Text 66.9
Monitor 65
Display 65
Person 58.9
Person 47.6

Clarifai
created on 2023-10-25

art 97.8
movie 96.5
analogue 95.6
people 93.9
slide 93.6
negative 93
window 91.7
no person 91.5
retro 91.4
old 90.8
picture frame 90.8
dirty 90.7
filmstrip 90.6
vintage 88.7
screen 88.3
wall 87.4
analog 85.3
photograph 85.2
painting 85
woman 84.5

Imagga
created on 2022-01-08

equipment 98.5
sequencer 86.8
apparatus 69.1
electronic equipment 57.5
equalizer 37.5
amplifier 26.2
technology 25.2
computer 20.8
data 19.2
digital 18.6
card 17
business 15.8
information 15.1
connection 14.6
network 13.9
industry 13.7
office 13.7
music 13.5
electronic 13.1
board 12.8
device 12.7
old 12.5
hardware 12.5
retro 12.3
sound 12.2
folder 11.7
close 11.4
electronics 11.4
word 11.3
memory 11.1
paper 11
register 10.9
audio 10.5
control 10.5
finance 10.1
speed 10.1
black 9.6
film 9.6
synthesizer 9.4
grunge 9.4
vintage 9.1
chip 8.9
object 8.8
cinema 8.8
transfer 8.8
radio 8.7
system 8.6
media 8.6
save 8.5
showing 8.4
entertainment 8.3
modem 8.2
dirty 8.1
button 7.9
switch 7.8
circuit 7.8
paperwork 7.8
speaker 7.8
movie 7.7
video 7.7
panel 7.7
tape 7.7
electrical 7.7
texture 7.6
cable 7.6
storage 7.6
tech 7.6
electronic instrument 7.6
electric 7.5
economy 7.4
closeup 7.4
plastic 7.3
metal 7.2
financial 7.1
server 7

Google
created on 2022-01-08

Rectangle 89.7
Circuit component 88.3
Font 82.8
Camera accessory 76
Photographic film 75.8
Electronic device 73.4
Magenta 73.3
Monochrome photography 67.1
Display device 66.8
Facade 66.6
Negative 66.1
Collectable 64.5
Monochrome 64.3
Postage stamp 63.9
Microcontroller 63.6
Stock photography 63.3
Event 62.9
Room 62.6
Building 62.2
Pattern 62

Microsoft
created on 2022-01-08

text 98.5
screenshot 74.9
picture frame 73.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 84%
Happy 9%
Confused 3.2%
Sad 1.9%
Disgusted 0.8%
Fear 0.5%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 94.8%
Sad 2.6%
Confused 1%
Angry 0.5%
Disgusted 0.4%
Surprised 0.3%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 97.9%
Confused 0.8%
Angry 0.3%
Sad 0.3%
Disgusted 0.2%
Happy 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.4%
Calm 48.4%
Angry 30.8%
Sad 10.7%
Confused 7.2%
Disgusted 1.2%
Surprised 0.8%
Happy 0.5%
Fear 0.5%

AWS Rekognition

Age 16-22
Gender Male, 98.4%
Calm 91.8%
Sad 4.2%
Confused 1.9%
Angry 0.9%
Surprised 0.4%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 36-44
Gender Male, 98.5%
Disgusted 46.1%
Happy 23.3%
Sad 12.9%
Calm 6.4%
Angry 5.4%
Fear 3.1%
Confused 1.8%
Surprised 1%

AWS Rekognition

Age 22-30
Gender Male, 97.1%
Calm 99.8%
Surprised 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 4-12
Gender Male, 98.9%
Calm 73.5%
Sad 9.9%
Disgusted 3.9%
Confused 3.5%
Angry 3.2%
Fear 2.7%
Happy 2.2%
Surprised 1.1%

AWS Rekognition

Age 20-28
Gender Male, 99.3%
Calm 95.4%
Angry 1.5%
Fear 0.6%
Happy 0.5%
Confused 0.5%
Sad 0.5%
Disgusted 0.5%
Surprised 0.5%

AWS Rekognition

Age 21-29
Gender Male, 93.7%
Calm 95.5%
Happy 1.1%
Sad 1.1%
Angry 0.6%
Confused 0.5%
Surprised 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 88.6%
Fear 3.5%
Surprised 2.7%
Sad 2.5%
Disgusted 0.9%
Happy 0.8%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 97.8%
Sad 1.5%
Happy 0.3%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 13-21
Gender Male, 79%
Sad 55%
Calm 35.5%
Angry 2.6%
Confused 2.3%
Fear 1.9%
Surprised 1%
Disgusted 0.9%
Happy 0.8%

AWS Rekognition

Age 7-17
Gender Male, 87.9%
Calm 69.4%
Sad 7.6%
Fear 6.6%
Angry 5.3%
Disgusted 4.9%
Happy 3.8%
Confused 1.3%
Surprised 1%

AWS Rekognition

Age 22-30
Gender Male, 98.8%
Calm 72.5%
Sad 11.2%
Angry 9%
Happy 5.2%
Surprised 0.6%
Confused 0.6%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 23-33
Gender Female, 65.9%
Calm 44.3%
Happy 30.1%
Fear 16.2%
Sad 2.8%
Confused 2.6%
Disgusted 1.4%
Surprised 1.3%
Angry 1.3%

AWS Rekognition

Age 18-24
Gender Female, 73.3%
Sad 69.8%
Calm 20.6%
Fear 2.2%
Confused 1.9%
Happy 1.6%
Angry 1.6%
Surprised 1.2%
Disgusted 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.4%

Categories

Imagga

streetview architecture 75.1%
cars vehicles 19.1%
interior objects 2.8%

Text analysis

Amazon

35
DELICATESSEN
LAUWOR
CHOICE
Coca-Cola

Google

35\ 35
35\
35