Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4585

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 99.6
Person 99.5
Person 99.2
Person 98.8
Person 97.4
Automobile 91.6
Vehicle 91.6
Transportation 91.6
Car 91.6
Person 90.4
Person 89.6
Person 88.5
Person 87.4
Car 84.4
Wheel 81
Machine 81
People 72.3
Military 71.1
Military Uniform 69.7
Person 68.7
Person 65.5
Person 63.8
Coat 60.7
Apparel 60.7
Overcoat 60.7
Clothing 60.7
Officer 59.6
Person 56

Imagga
created on 2022-01-08

equipment 52.2
electronic equipment 40.5
device 21.8
technology 20.8
old 20.2
central processing unit 18.5
computer 18.4
grunge 17.9
digital 17.8
vintage 17.4
amplifier 17.1
circuitry 16
business 15.8
retro 15.6
data 15.5
film 15.4
black 14.4
frame 14.1
network 13.9
hardware 13.4
sequencer 13.1
cassette tape 12.9
cassette 12.8
close 12
texture 11.8
border 11.7
art 11.7
board 11.6
apparatus 11.4
memory 11.3
design 11.2
object 11
dirty 10.8
magnetic tape 10.7
movie 10.7
information 10.6
system 10.5
building 10.3
screen 10.3
paper 10.2
memory device 10.1
negative 9.9
pattern 9.6
antique 9.5
electrical device 9.5
tape 9.4
sound 9.4
connection 9.1
server 9
cinema 8.8
slide 8.8
graphic 8.7
text 8.7
video 8.7
cable 8.6
nobody 8.5
electronics 8.5
industry 8.5
card 8.5
finance 8.4
chip 8.4
hand 8.3
entertainment 8.3
sign 8.3
aged 8.1
man 8.1
office 8
scratch 7.8
strip 7.8
collage 7.7
money 7.7
audio 7.6
tech 7.6
horizontal 7.5
circuit board 7.5
closeup 7.4
camera 7.4
container 7.4
speed 7.3
cash 7.3
message 7.3
color 7.2
router 7.1
circuit breaker 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 97.3
screenshot 60.4
open 43.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 98.7%
Calm 81.7%
Sad 12%
Angry 2.6%
Confused 1.8%
Disgusted 0.6%
Fear 0.5%
Happy 0.5%
Surprised 0.4%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Calm 42.7%
Confused 41.8%
Sad 10%
Surprised 3.3%
Angry 1%
Disgusted 0.5%
Happy 0.4%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Disgusted 75.7%
Sad 6%
Calm 5.4%
Angry 4.5%
Confused 3.3%
Happy 2%
Fear 2%
Surprised 1.1%

AWS Rekognition

Age 42-50
Gender Male, 99.1%
Calm 62.9%
Sad 27.5%
Fear 2.8%
Angry 2.2%
Disgusted 1.6%
Happy 1.5%
Confused 1.1%
Surprised 0.4%

AWS Rekognition

Age 13-21
Gender Male, 99.8%
Calm 63.4%
Sad 17.7%
Confused 8.5%
Angry 3.5%
Fear 2.8%
Disgusted 2%
Surprised 1.2%
Happy 0.8%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 87.7%
Sad 9%
Confused 1.3%
Happy 1.3%
Angry 0.2%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 1-7
Gender Male, 99.9%
Calm 95.8%
Sad 2%
Happy 0.9%
Angry 0.5%
Disgusted 0.3%
Surprised 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.6%
Calm 62.3%
Happy 25.4%
Sad 5.4%
Angry 2.4%
Confused 1.3%
Disgusted 1.2%
Surprised 1%
Fear 1%

AWS Rekognition

Age 24-34
Gender Male, 97.6%
Sad 41.4%
Fear 24.1%
Disgusted 10.2%
Calm 9.6%
Angry 8.8%
Happy 3%
Surprised 2.5%
Confused 0.4%

AWS Rekognition

Age 25-35
Gender Male, 91.9%
Calm 60.3%
Disgusted 12.2%
Sad 8.4%
Fear 7.4%
Confused 3.9%
Angry 3.9%
Happy 2.6%
Surprised 1.3%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Calm 86.7%
Surprised 3.2%
Fear 2.9%
Sad 2.1%
Angry 1.7%
Confused 1.4%
Disgusted 1.3%
Happy 0.8%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Calm 60.1%
Sad 28.7%
Disgusted 5.6%
Angry 2%
Surprised 1.2%
Fear 1.1%
Happy 0.9%
Confused 0.5%

AWS Rekognition

Age 23-31
Gender Female, 91.9%
Calm 99.6%
Happy 0.1%
Fear 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0%
Confused 0%
Surprised 0%

AWS Rekognition

Age 9-17
Gender Male, 52%
Calm 62.1%
Sad 13.4%
Disgusted 9.4%
Fear 6.6%
Happy 2.5%
Surprised 2.2%
Angry 2.2%
Confused 1.5%

AWS Rekognition

Age 21-29
Gender Male, 93.3%
Calm 88.5%
Sad 4.6%
Disgusted 2.2%
Angry 1.9%
Confused 1.2%
Surprised 0.8%
Fear 0.5%
Happy 0.4%

AWS Rekognition

Age 7-17
Gender Male, 72%
Happy 59.7%
Calm 27.6%
Angry 6.4%
Sad 2.2%
Disgusted 1.4%
Surprised 1.2%
Fear 0.9%
Confused 0.7%

AWS Rekognition

Age 23-33
Gender Male, 97.6%
Sad 48.8%
Calm 14.4%
Disgusted 12.5%
Confused 9.7%
Fear 6.9%
Angry 3.3%
Surprised 2.8%
Happy 1.7%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 55%
Angry 23.1%
Sad 7.5%
Happy 4.9%
Disgusted 3.6%
Fear 3.6%
Confused 1.5%
Surprised 0.8%

AWS Rekognition

Age 13-21
Gender Male, 98.9%
Sad 82.4%
Calm 7.1%
Confused 3.1%
Fear 2.9%
Angry 1.7%
Happy 1.2%
Surprised 0.9%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.7%
Car 91.6%
Wheel 81%

Captions

Microsoft

a person standing in front of a window 30.5%
a person standing in front of a store window 27.2%

Text analysis

Amazon

SERVICE
8
RADIO SERVICE
RADIO
U.C.YOUNG
DE

Google

YOUNG
SERVICE
RADIO SERVICE BC. YOUNG
BC.
RADIO