Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4633.1-2

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4633.1-2

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.8
Human 98.8
Person 98.7
Person 98.6
Person 98.3
Person 97.9
Person 96.7
Person 95.8
Interior Design 95.3
Indoors 95.3
Person 95
Person 93.3
Person 93.2
Monitor 92.6
Electronics 92.6
Screen 92.6
Display 92.6
Person 92.6
Person 86.6
Person 85.7
Outdoors 70.7
Nature 68.2
Water 67.5
Person 63.9
People 62.3
Person 60.7
Room 58
Steamer 56.4

Clarifai
created on 2023-10-25

movie 99.5
screen 98.8
people 98.7
slide 94.4
art 94.1
woman 93.7
man 93.1
negative 92
window 91.4
display 91.1
video 90.8
street 90.4
analogue 88.5
group 87.7
retro 87.4
collage 86.3
technology 85.6
television 84.7
girl 81.3
adult 81

Imagga
created on 2022-01-08

television 90.5
monitor 83.8
electronic equipment 58.9
broadcasting 58.2
equipment 45.1
telecommunication 44.9
medium 28.9
screen 19.2
digital 18.6
technology 17.8
computer 17.7
film 17.1
hand 15.2
black 15
frame 13.3
display 12.8
global 11.8
design 11.8
art 11.7
collage 11.6
telecommunication system 11.4
close 11.4
electronic 11.2
old 11.1
speed 11
business 10.9
system 10.5
object 10.3
communication 10.1
retro 9.8
car 9.8
your 9.7
media 9.5
tech 9.5
closeup 9.4
information 8.8
office 8.8
movie 8.7
architecture 8.6
modern 8.4
liquid crystal display 8.4
entertainment 8.3
vintage 8.3
transport 8.2
data 8.2
border 8.1
graphic 8
color 7.8
glass 7.8
space 7.7
grunge 7.7
damaged 7.6
finance 7.6
pattern 7.5
man 7.4
street 7.4
road 7.2

Google
created on 2022-01-08

Rectangle 84.3
Font 83
Television set 82.8
Art 81.6
Flat panel display 81.5
Projection screen 75.8
Display device 75.3
Multimedia 74.2
Event 72.7
Facade 70.9
Suit 70.6
Visual arts 67.9
Advertising 67.3
Projector accessory 67.2
Crowd 67
Monochrome photography 64.9
Signage 64.8
Monochrome 62.5
Television 62.4
History 62.2

Microsoft
created on 2022-01-08

screenshot 98.4
text 94.6
billboard 91.7
television 80
person 65.2
poster 59
picture frame 50.7
microwave 18.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 99.9%
Happy 98.8%
Calm 0.9%
Surprised 0.1%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 29-39
Gender Female, 99.9%
Calm 86%
Sad 10.7%
Fear 1.2%
Confused 1%
Surprised 0.6%
Angry 0.4%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 98.1%
Sad 98.9%
Fear 0.3%
Calm 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 69.3%
Calm 75.9%
Angry 7.5%
Surprised 6.3%
Disgusted 4.2%
Sad 3.5%
Confused 1.9%
Fear 0.5%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Female, 86.7%
Happy 98.6%
Sad 0.5%
Calm 0.4%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 87.4%
Calm 97.4%
Sad 0.8%
Angry 0.5%
Confused 0.3%
Happy 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Female, 60%
Calm 68.7%
Sad 21.3%
Disgusted 3.6%
Happy 1.9%
Angry 1.8%
Confused 1.1%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 10-18
Gender Male, 96.9%
Calm 61.8%
Disgusted 17.9%
Sad 11.5%
Fear 3.3%
Happy 1.8%
Angry 1.8%
Confused 1.2%
Surprised 0.7%

AWS Rekognition

Age 38-46
Gender Female, 97.6%
Calm 71.5%
Sad 20.9%
Fear 2.6%
Happy 1.3%
Surprised 1.2%
Confused 1%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 16-24
Gender Male, 82.7%
Calm 42.9%
Sad 20.3%
Confused 18.4%
Happy 9.6%
Angry 3.5%
Disgusted 2.2%
Surprised 2%
Fear 0.9%

AWS Rekognition

Age 16-22
Gender Male, 99.8%
Calm 75.9%
Sad 20.7%
Angry 1.4%
Confused 0.9%
Happy 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 10-18
Gender Male, 98.8%
Calm 51.9%
Sad 23.5%
Happy 9.3%
Angry 7.3%
Fear 2.5%
Surprised 2%
Confused 1.9%
Disgusted 1.5%

AWS Rekognition

Age 13-21
Gender Male, 83.5%
Calm 90.7%
Happy 7.1%
Sad 0.9%
Fear 0.3%
Angry 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 2-8
Gender Male, 61%
Calm 90.3%
Disgusted 4.1%
Sad 2.5%
Happy 1.1%
Fear 0.8%
Angry 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Male, 86%
Calm 92.5%
Sad 4.3%
Confused 1.5%
Angry 0.8%
Surprised 0.3%
Fear 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 6-16
Gender Male, 74%
Calm 69.1%
Angry 12.3%
Sad 8.1%
Disgusted 3.4%
Fear 2.8%
Confused 1.8%
Surprised 1.5%
Happy 1.1%

AWS Rekognition

Age 16-22
Gender Male, 93.8%
Calm 96.6%
Sad 1.7%
Happy 0.5%
Angry 0.4%
Confused 0.4%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 92.8%
Calm 86.6%
Angry 7.1%
Sad 2%
Disgusted 1.4%
Fear 1%
Happy 0.8%
Surprised 0.7%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Male, 97%
Calm 88.8%
Happy 4%
Confused 2%
Sad 1.8%
Disgusted 1%
Angry 0.9%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 11-19
Gender Male, 92.1%
Calm 86.5%
Sad 6.4%
Angry 3.3%
Confused 1.1%
Happy 1%
Disgusted 0.8%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 22-30
Gender Male, 83.5%
Calm 98.1%
Sad 0.4%
Confused 0.4%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 12-20
Gender Male, 99.8%
Calm 51.3%
Sad 22.8%
Happy 14.6%
Angry 4.8%
Confused 2.7%
Fear 1.9%
Surprised 1%
Disgusted 0.9%

AWS Rekognition

Age 39-47
Gender Male, 95.3%
Calm 99.9%
Sad 0.1%
Happy 0%
Surprised 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Monitor 92.6%

Captions

Microsoft
created on 2022-01-08

graphical user interface, website 99.9%

Text analysis

Amazon

33
32
SUPER
EASTMAN
I:
II:
SUPER XX
XX

Google

33 EASTMAN 32 33 SUPER XX
32
33
EASTMAN
SUPER
XX