Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4633.1-2

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98.8
Person 98.8
Person 98.7
Person 98.6
Person 98.3
Person 97.9
Person 96.7
Person 95.8
Indoors 95.3
Interior Design 95.3
Person 95
Person 93.3
Person 93.2
Electronics 92.6
Screen 92.6
Display 92.6
Monitor 92.6
Person 92.6
Person 86.6
Person 85.7
Outdoors 70.7
Nature 68.2
Water 67.5
Person 63.9
People 62.3
Person 60.7
Room 58
Steamer 56.4

Imagga
created on 2022-01-08

television 90.5
monitor 83.8
electronic equipment 58.9
broadcasting 58.2
equipment 45.1
telecommunication 44.9
medium 28.9
screen 19.2
digital 18.6
technology 17.8
computer 17.7
film 17.1
hand 15.2
black 15
frame 13.3
display 12.8
global 11.8
design 11.8
art 11.7
collage 11.6
telecommunication system 11.4
close 11.4
electronic 11.2
old 11.1
speed 11
business 10.9
system 10.5
object 10.3
communication 10.1
retro 9.8
car 9.8
your 9.7
media 9.5
tech 9.5
closeup 9.4
information 8.8
office 8.8
movie 8.7
architecture 8.6
modern 8.4
liquid crystal display 8.4
entertainment 8.3
vintage 8.3
transport 8.2
data 8.2
border 8.1
graphic 8
color 7.8
glass 7.8
space 7.7
grunge 7.7
damaged 7.6
finance 7.6
pattern 7.5
man 7.4
street 7.4
road 7.2

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

screenshot 98.4
text 94.6
billboard 91.7
television 80
person 65.2
poster 59
picture frame 50.7
microwave 18.6

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 99.9%
Happy 98.8%
Calm 0.9%
Surprised 0.1%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 29-39
Gender Female, 99.9%
Calm 86%
Sad 10.7%
Fear 1.2%
Confused 1%
Surprised 0.6%
Angry 0.4%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 98.1%
Sad 98.9%
Fear 0.3%
Calm 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 69.3%
Calm 75.9%
Angry 7.5%
Surprised 6.3%
Disgusted 4.2%
Sad 3.5%
Confused 1.9%
Fear 0.5%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Female, 86.7%
Happy 98.6%
Sad 0.5%
Calm 0.4%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 87.4%
Calm 97.4%
Sad 0.8%
Angry 0.5%
Confused 0.3%
Happy 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Female, 60%
Calm 68.7%
Sad 21.3%
Disgusted 3.6%
Happy 1.9%
Angry 1.8%
Confused 1.1%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 10-18
Gender Male, 96.9%
Calm 61.8%
Disgusted 17.9%
Sad 11.5%
Fear 3.3%
Happy 1.8%
Angry 1.8%
Confused 1.2%
Surprised 0.7%

AWS Rekognition

Age 38-46
Gender Female, 97.6%
Calm 71.5%
Sad 20.9%
Fear 2.6%
Happy 1.3%
Surprised 1.2%
Confused 1%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 16-24
Gender Male, 82.7%
Calm 42.9%
Sad 20.3%
Confused 18.4%
Happy 9.6%
Angry 3.5%
Disgusted 2.2%
Surprised 2%
Fear 0.9%

AWS Rekognition

Age 16-22
Gender Male, 99.8%
Calm 75.9%
Sad 20.7%
Angry 1.4%
Confused 0.9%
Happy 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 10-18
Gender Male, 98.8%
Calm 51.9%
Sad 23.5%
Happy 9.3%
Angry 7.3%
Fear 2.5%
Surprised 2%
Confused 1.9%
Disgusted 1.5%

AWS Rekognition

Age 13-21
Gender Male, 83.5%
Calm 90.7%
Happy 7.1%
Sad 0.9%
Fear 0.3%
Angry 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 2-8
Gender Male, 61%
Calm 90.3%
Disgusted 4.1%
Sad 2.5%
Happy 1.1%
Fear 0.8%
Angry 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Male, 86%
Calm 92.5%
Sad 4.3%
Confused 1.5%
Angry 0.8%
Surprised 0.3%
Fear 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 6-16
Gender Male, 74%
Calm 69.1%
Angry 12.3%
Sad 8.1%
Disgusted 3.4%
Fear 2.8%
Confused 1.8%
Surprised 1.5%
Happy 1.1%

AWS Rekognition

Age 16-22
Gender Male, 93.8%
Calm 96.6%
Sad 1.7%
Happy 0.5%
Angry 0.4%
Confused 0.4%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 92.8%
Calm 86.6%
Angry 7.1%
Sad 2%
Disgusted 1.4%
Fear 1%
Happy 0.8%
Surprised 0.7%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Male, 97%
Calm 88.8%
Happy 4%
Confused 2%
Sad 1.8%
Disgusted 1%
Angry 0.9%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 11-19
Gender Male, 92.1%
Calm 86.5%
Sad 6.4%
Angry 3.3%
Confused 1.1%
Happy 1%
Disgusted 0.8%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 22-30
Gender Male, 83.5%
Calm 98.1%
Sad 0.4%
Confused 0.4%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 12-20
Gender Male, 99.8%
Calm 51.3%
Sad 22.8%
Happy 14.6%
Angry 4.8%
Confused 2.7%
Fear 1.9%
Surprised 1%
Disgusted 0.9%

AWS Rekognition

Age 39-47
Gender Male, 95.3%
Calm 99.9%
Sad 0.1%
Happy 0%
Surprised 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Monitor 92.6%

Captions

Microsoft

graphical user interface, website 99.9%

Text analysis

Amazon

33
32
SUPER
EASTMAN
I:
II:
SUPER XX
XX

Google

33 EASTMAN 32 33 SUPER XX
33
XX
32
EASTMAN
SUPER