Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4607.1-2

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4607.1-2

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Interior Design 100
Indoors 100
Person 99.3
Human 99.3
Person 99.1
Person 98.9
Person 97.7
Person 97.4
Monitor 95.7
Electronics 95.7
Display 95.7
Screen 95.7
Room 95
Person 94.9
Person 92.7
Person 91
Person 88.1
Theater 85
Person 80.3
Cinema 75.9
Nature 74.6
Person 72.9
Person 72
Person 68.6
Person 65
Person 59.7
Outdoors 56.3
Person 49.4

Clarifai
created on 2023-10-25

movie 99.4
screen 99.3
art 98.1
collage 97.3
people 97.2
slide 96.5
analogue 95.9
retro 94.8
video 94.6
picture frame 91.8
painting 91.4
negative 90.8
photograph 90.2
technology 90
vintage 89.1
analog 88.9
landscape 88.9
old 88.4
window 87.8
display 87.1

Imagga
created on 2022-01-08

monitor 96.5
electronic equipment 73.1
television 61
equipment 51.8
broadcasting 40.4
telecommunication 29.6
medium 19.1
liquid crystal display 18.6
black 18
film 17.9
building 16.4
architecture 16.4
screen 16
old 15.3
design 15.2
entertainment 13.8
collage 13.5
city 13.3
structure 12.6
frame 12.5
vintage 12.4
art 12.4
digital 12.1
movie 11.6
business 11.5
modern 11.2
computer 10.5
urban 10.5
high 10.4
technology 10.4
symbol 10.1
billboard 9.9
retro 9.8
text 9.6
decoration 9.4
nobody 9.3
space 9.3
blackboard 9.1
paint 9
texture 9
landmark 9
history 8.9
sky 8.9
office 8.9
graphic 8.8
your 8.7
window 8.6
glass 8.6
grunge 8.5
house 8.4
pattern 8.2
border 8.1
dirty 8.1
night 8
home 8
interior 8
display 8
frames 7.8
noise 7.8
antique 7.8
negative 7.8
strip 7.8
blank 7.7
construction 7.7
windows 7.7
damaged 7.6
media 7.6
finance 7.6
hand 7.6
communication 7.6
electronic 7.5
closeup 7.4
street 7.4
historic 7.3
color 7.2
tower 7.2

Google
created on 2022-01-08

Rectangle 86.7
Television set 84.2
Gadget 83.1
Flat panel display 82.6
Font 82.5
Display device 78.5
City 75.9
Multimedia 75.8
Electronic device 75.2
Technology 73.3
Monochrome photography 71.6
Monochrome 70.4
Output device 69.5
Room 66.3
Cityscape 65.4
Screenshot 64.7
Led-backlit lcd display 64.4
Media 60.7
Television 60.2
Television program 58.5

Microsoft
created on 2022-01-08

text 98.7
screenshot 98.2
television 63
microwave 16.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 7-17
Gender Female, 65.8%
Calm 78.5%
Sad 18.5%
Surprised 1.7%
Happy 0.4%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 99.5%
Angry 0.3%
Sad 0.1%
Confused 0%
Disgusted 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 10-18
Gender Female, 93.7%
Sad 63.3%
Confused 23.3%
Calm 6.8%
Surprised 1.9%
Disgusted 1.8%
Fear 1.6%
Angry 0.8%
Happy 0.6%

AWS Rekognition

Age 16-22
Gender Male, 99.8%
Calm 49.9%
Sad 45.6%
Angry 1.9%
Fear 1.1%
Confused 0.6%
Happy 0.6%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Female, 58.8%
Calm 97%
Happy 0.9%
Sad 0.8%
Angry 0.6%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 45-51
Gender Male, 81.9%
Calm 92.6%
Happy 3.1%
Sad 1.7%
Disgusted 0.9%
Angry 0.6%
Surprised 0.5%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 16-24
Gender Male, 97.7%
Calm 85%
Sad 8.3%
Angry 2.6%
Confused 2.5%
Fear 0.5%
Disgusted 0.4%
Happy 0.4%
Surprised 0.4%

AWS Rekognition

Age 23-33
Gender Male, 95.6%
Calm 99%
Happy 0.2%
Sad 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 78.8%
Sad 11%
Angry 6.5%
Confused 1.7%
Disgusted 0.9%
Happy 0.4%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Female, 87.6%
Fear 47.3%
Calm 40.3%
Sad 8.1%
Surprised 1.7%
Confused 0.9%
Happy 0.6%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 2-8
Gender Male, 97.3%
Calm 89.2%
Happy 6.4%
Sad 1.7%
Angry 1.2%
Fear 0.6%
Confused 0.5%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 13-21
Gender Male, 99.8%
Calm 98.7%
Sad 0.7%
Angry 0.3%
Happy 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 96.4%
Calm 77.8%
Fear 6.2%
Angry 5.6%
Sad 4.2%
Happy 3.8%
Surprised 1.1%
Disgusted 0.8%
Confused 0.6%

AWS Rekognition

Age 24-34
Gender Male, 97%
Calm 51.4%
Surprised 13.5%
Angry 10.9%
Disgusted 8.9%
Sad 4.9%
Confused 4.6%
Fear 3.5%
Happy 2.3%

AWS Rekognition

Age 4-10
Gender Male, 97.4%
Calm 93.8%
Sad 2.4%
Confused 2%
Happy 0.6%
Fear 0.4%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 14-22
Gender Male, 85.7%
Calm 98.3%
Sad 1%
Confused 0.2%
Happy 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 84.6%
Calm 72.7%
Sad 8.4%
Angry 7.5%
Disgusted 4.6%
Confused 2.8%
Happy 2.3%
Surprised 1.2%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.3%
Monitor 95.7%

Captions

Microsoft
created on 2022-01-08

graphical user interface 75.6%

Text analysis

Amazon

8
ORS
IES
SUPER
7
SUPER XX
ITALIAN
XX

Google

8. IES ORS ITALIAN 7 SUPER XX 8
8.
IES
ORS
ITALIAN
7
SUPER
XX
8