Human Generated Data

Title

Untitled

Date

c. 1935

People

Artist: Eliot Elisofon, American 1911 - 1973

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jean and Julien Levy, P1979.188

Human Generated Data

Title

Untitled

People

Artist: Eliot Elisofon, American 1911 - 1973

Date

c. 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Jean and Julien Levy, P1979.188

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.7
Human 98.7
Person 94.3
Advertisement 91.8
Person 91.5
Poster 90.5
Person 81.4
Collage 74.3
Interior Design 63.3
Indoors 63.3
Art 60.3
Shop 59
Person 57.9
Paper 56.2
Flyer 56.1
Brochure 56.1
Text 55.9
Book 55.7

Clarifai
created on 2023-10-15

people 99.7
monochrome 99
adult 98.2
man 97.8
group 97
art 95.6
one 93.6
vintage 93.5
woman 93.4
portrait 91.9
war 91.2
street 91.2
illustration 90.4
print 89.4
wear 89.2
text 87.8
two 87.4
retro 86.2
bill 84.9
many 80.3

Imagga
created on 2021-12-14

newspaper 37.2
old 31.4
art 29.6
product 28.2
design 27.1
cloud 26.7
vintage 26.6
texture 26.4
grunge 25.5
antique 24.4
paper 24.4
creation 24.2
element 22.3
backdrop 22.3
artwork 22
retro 21.3
fabric 20.9
ancient 20.8
decoration 20.6
creative 20.3
aged 19.9
collection 19.8
cover 19.4
decorative 19.2
advertising 19.2
composition 18.8
decor 18.6
pattern 17.8
continuity 17.8
associated 17.7
association 17.7
drapery 17.7
definition 17.6
brochure 17.5
graphic 17.5
carpet 17.5
advertise 17.5
advertisement 17.4
conceptual 16.8
blank 15.4
memorial 15.4
frame 15.2
business 14.6
dirty 14.5
structure 14
page 13
letter 12.8
finance 12.7
currency 12.6
idea 12.5
grungy 12.3
wall 12.1
border 11.8
brass 10.6
daily 10.6
parchment 10.6
textured 10.5
damaged 10.5
brown 10.3
note 10.1
religion 9.9
exchange 9.6
worn 9.5
stone 9.4
money 9.4
book jacket 9.3
wallpaper 9.2
cash 9.2
sign 9
drawing 9
history 8.9
notes 8.6
bill 8.6
gravestone 8.4
communication 8.4
dollar 8.4
economy 8.3
jacket 8.2
digital 8.1
bank 8.1
material 8
architecture 7.9
book 7.8
empty 7.7
weathered 7.6
sheet 7.5
style 7.4
church 7.4
case 7.4
stamp 7.4
historic 7.3
rough 7.3
sketch 7.3
wealth 7.2

Google
created on 2021-12-14

Photograph 94.2
Building 83.9
Art 83.6
Font 82.1
Rectangle 74.3
Painting 71.2
Visual arts 70.8
Window 70.5
Facade 70.2
Room 68.1
History 67.7
Monochrome 65.1
Stock photography 64.8
Illustration 64.4
House 63.5
Drawing 63.2
Collection 61.4
Paper product 55.4
Paper 55
Artwork 54.6

Microsoft
created on 2021-12-14

text 97
gallery 95.5
drawing 94.6
person 93.7
scene 92.7
room 89.4
indoor 88.6
clothing 84.3
human face 77.5
sketch 72.3
old 68.6
cartoon 67.8
posing 61.1
handwriting 50.9
store 33.5
painting 27.3
painted 19.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 15-27
Gender Female, 99.8%
Happy 97.1%
Calm 1.4%
Confused 0.4%
Surprised 0.3%
Disgusted 0.3%
Angry 0.2%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 16-28
Gender Female, 99.7%
Calm 89.9%
Happy 6.7%
Sad 1.7%
Surprised 0.7%
Angry 0.6%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 14-26
Gender Female, 78%
Calm 78.2%
Sad 6.2%
Confused 5.5%
Happy 3.2%
Angry 3.1%
Disgusted 2.1%
Fear 0.9%
Surprised 0.8%

AWS Rekognition

Age 23-35
Gender Female, 91.3%
Happy 63.3%
Calm 28.7%
Angry 2.2%
Sad 1.4%
Confused 1.4%
Disgusted 1.4%
Surprised 1.1%
Fear 0.5%

AWS Rekognition

Age 20-32
Gender Female, 95%
Calm 62.7%
Happy 32%
Confused 2.8%
Sad 1.1%
Disgusted 0.5%
Surprised 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 21-33
Gender Male, 71.3%
Calm 75.7%
Happy 11%
Angry 3.6%
Disgusted 3%
Sad 2.3%
Surprised 2.2%
Confused 1.3%
Fear 0.9%

AWS Rekognition

Age 34-50
Gender Female, 50.2%
Calm 73%
Sad 17.8%
Happy 2.9%
Confused 2.7%
Surprised 1.6%
Angry 1.1%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 20-32
Gender Female, 91.3%
Calm 50.2%
Happy 25.8%
Confused 12.3%
Sad 4%
Surprised 2.5%
Fear 2%
Angry 1.9%
Disgusted 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Poster 90.5%

Categories

Captions

Microsoft
created on 2021-12-14

a painting of a person 68.8%
a painting hanging on a wall 68.7%
a painting on the wall 68.6%

Text analysis

Amazon

SAVOY
CALENDAR
CALENDAR CO
CO

Google

35AVOY CALENDAR CO TH R
35AVOY
CALENDAR
CO
TH
R