Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4579.1-4

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.5
Human 98.5
Screen 97.5
Electronics 97.5
Monitor 97.5
Display 97.5
Person 97
Person 90.5
Person 88.3
Military Uniform 86.8
Military 86.8
Person 84.3
Person 83.9
Person 75.7
Person 71.5
Person 68.9
Soldier 67.6
Person 66.9
People 66.5
Person 64.9
Army 63.7
Armored 63.7
Officer 55.5

Imagga
created on 2022-01-08

sequencer 100
apparatus 87.6
equipment 80
film 53.6
negative 50.6
equalizer 25
electronic equipment 24.3
movie 20.3
frame 20
retro 19.7
photographic paper 19.1
cinema 18.5
camera 18.5
strip 18.4
grunge 17.9
old 17.4
art 17
slide 16.6
business 16.4
border 16.3
texture 16
vintage 15.7
black 15.6
technology 15.6
computer 15.2
digital 14.6
screen 13.8
entertainment 12.9
filmstrip 12.8
photographic equipment 12.8
photography 12.3
text 12.2
data 11.9
design 11.8
tape 11.6
graphic 10.9
photographic 10.8
roll 10.4
blank 10.3
close 10.3
noise 9.8
collage 9.6
industry 9.4
space 9.3
banner 9.2
element 9.1
aged 9
35mm 8.9
information 8.9
scratch 8.8
photograph 8.6
finance 8.4
pattern 8.2
rough 8.2
dirty 8.1
object 8.1
paper 7.8
antique 7.8
empty 7.7
damaged 7.6
electronic 7.5
number 7.5
positive 7.4
security 7.3
music 7.2
wealth 7.2
bank 7.2

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Calm 90.5%
Happy 6.3%
Sad 1%
Confused 0.5%
Disgusted 0.5%
Surprised 0.5%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 45-51
Gender Female, 99.9%
Sad 41.7%
Happy 23.8%
Confused 11.2%
Fear 8.9%
Calm 8%
Surprised 2.4%
Disgusted 2.2%
Angry 1.9%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 96%
Sad 2.9%
Surprised 0.4%
Confused 0.2%
Happy 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 74.1%
Calm 95.7%
Angry 1%
Surprised 0.9%
Sad 0.8%
Happy 0.6%
Confused 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 93.9%
Sad 99.8%
Calm 0.2%
Confused 0%
Angry 0%
Fear 0%
Surprised 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 99.2%
Confused 0.5%
Happy 0.1%
Sad 0.1%
Surprised 0%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 98%
Calm 76.3%
Sad 9.7%
Confused 7.7%
Angry 2.4%
Disgusted 1.5%
Surprised 1.3%
Fear 0.6%
Happy 0.6%

AWS Rekognition

Age 41-49
Gender Female, 99.8%
Calm 93.8%
Angry 3.2%
Disgusted 1.7%
Confused 0.4%
Sad 0.3%
Happy 0.2%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 11-19
Gender Female, 96%
Fear 60.8%
Sad 13.6%
Surprised 8.3%
Calm 5.2%
Happy 4.8%
Confused 2.7%
Angry 2.4%
Disgusted 2.3%

AWS Rekognition

Age 25-35
Gender Male, 92.2%
Calm 91.9%
Happy 2.2%
Surprised 1.4%
Disgusted 1.3%
Sad 1.2%
Angry 1%
Fear 0.7%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Female, 84.8%
Calm 56%
Sad 28.7%
Angry 4.4%
Happy 4.2%
Disgusted 2.9%
Fear 1.5%
Surprised 1.4%
Confused 1.1%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Calm 98.2%
Sad 0.5%
Surprised 0.4%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 98.5%
Calm 74.8%
Sad 13%
Fear 3.8%
Happy 3.5%
Angry 2%
Confused 1.3%
Surprised 0.8%
Disgusted 0.8%

AWS Rekognition

Age 2-10
Gender Male, 87.5%
Calm 94.7%
Happy 2.6%
Surprised 0.9%
Angry 0.7%
Sad 0.5%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 2-8
Gender Male, 71.8%
Calm 81.4%
Sad 8.5%
Happy 6.4%
Confused 1.8%
Angry 0.6%
Disgusted 0.6%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 28-38
Gender Female, 50.5%
Calm 98.9%
Sad 0.9%
Fear 0%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 31-41
Gender Male, 81.1%
Calm 79.9%
Happy 16.7%
Sad 1.3%
Fear 0.7%
Angry 0.4%
Surprised 0.4%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 4-12
Gender Female, 62.6%
Calm 69.1%
Confused 13.8%
Surprised 7.2%
Fear 3.2%
Sad 2.1%
Disgusted 1.9%
Happy 1.5%
Angry 1.2%

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Calm 89.5%
Sad 6.3%
Happy 1.6%
Angry 1.2%
Fear 0.5%
Surprised 0.4%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Male, 96%
Calm 45%
Happy 17.1%
Angry 10.9%
Fear 8.3%
Surprised 7%
Confused 5.8%
Sad 3.7%
Disgusted 2.2%

AWS Rekognition

Age 22-30
Gender Male, 57.2%
Sad 76.3%
Calm 11.8%
Confused 9.3%
Disgusted 0.7%
Happy 0.6%
Angry 0.5%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Female, 99.8%
Sad 36.3%
Angry 18.2%
Calm 12.9%
Disgusted 10.1%
Happy 8.1%
Confused 5.7%
Fear 4.8%
Surprised 4%

AWS Rekognition

Age 23-31
Gender Male, 99.3%
Calm 92.1%
Angry 2.3%
Confused 2.1%
Sad 1.9%
Disgusted 0.5%
Happy 0.4%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 19-27
Gender Male, 97.4%
Calm 89.6%
Surprised 4%
Disgusted 3.5%
Happy 1.3%
Angry 1.1%
Sad 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Male, 95.7%
Sad 47.1%
Happy 25.3%
Calm 16.3%
Disgusted 2.9%
Confused 2.5%
Angry 2.4%
Fear 2%
Surprised 1.6%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 74.1%
Happy 13.4%
Sad 6.6%
Angry 3.4%
Disgusted 0.9%
Surprised 0.6%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.5%
Calm 93.4%
Happy 4.9%
Sad 1.1%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Female, 85.6%
Calm 94.2%
Sad 3.7%
Confused 1.1%
Happy 0.5%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 12-20
Gender Male, 63.9%
Sad 39.4%
Calm 36.6%
Angry 11.9%
Fear 5.5%
Surprised 2.6%
Disgusted 2.5%
Happy 1%
Confused 0.6%

AWS Rekognition

Age 18-24
Gender Female, 53.4%
Calm 95.8%
Sad 2%
Angry 1.3%
Confused 0.5%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Monitor 97.5%

Captions

Microsoft

a group of people standing in front of a train 38.6%
a group of people in front of a train 38.5%
a group of people standing in front of a window 38.4%

Text analysis

Amazon

26
25
28
27
SUPER
SUPER XX
-
XX
TRALY PRU
TRALY PRU an
an
KIN

Google

28 CININA SUPER XX
CININA
XX
SUPER
28