Human Generated Data

Title

Untitled (Philadelphia Pepperpot layouts: spectators at horse race)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12089

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Philadelphia Pepperpot layouts: spectators at horse race)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Poster 98.9
Advertisement 98.9
Person 96.5
Human 96.5
Person 96.3
Person 95.9
Person 91.2
Comics 85.2
Book 85.2
Person 79.1
Person 77.7
Collage 77.3
Text 77.3
Person 68.3
Person 67.7
Paper 66.5
Flyer 63
Brochure 63
Person 58.9
Person 56.5
Page 55.4
Person 47.2

Imagga
created on 2022-01-15

design 33.8
frame 29.7
card 26.4
retro 26.2
paper 25.9
vintage 24.8
floral 23.8
drawing 23.5
element 23.2
decoration 22.8
art 20.2
collection 19.8
insulating material 19.7
template 19.3
pattern 19.2
antique 19.2
grunge 17.9
business 17.6
graphic 17.5
border 17.2
set 17
symbol 16.8
building material 16.6
ornate 16.5
decorative 15.9
menu 15.8
sketch 15.1
style 14.8
banner 14.7
old 14.6
holiday 14.3
sign 14.3
ornament 13.8
blank 13.7
elegant 13.7
money 13.6
bookmark 13.4
creative 13.2
envelope 13.2
greeting 13
stamp 13
leaf 12.5
flower 12.3
representation 11.4
gift 11.2
celebration 11.2
elements 11.1
elegance 10.9
certificate 10.8
silhouette 10.8
decor 10.6
invitation 10.6
modern 10.5
swirl 10.1
bank 10
currency 9.9
creation 9.8
texture 9.7
mail 9.6
letterhead 9.5
label 9.4
finance 9.3
classic 9.3
note 9.2
plant 9.2
new 8.9
icon 8.7
bill 8.6
cover 8.3
berry 8.3
traditional 8.3
letter 8.3
year 8.2
shape 8.2
cartoon 8
product 8
container 8
postage 7.9
web site 7.8
ink 7.7
winter 7.7
wallpaper 7.7
classical 7.7
post 7.6
page 7.4
document 7.4
cash 7.3
ribbon 7.3
office 7.2
season 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99.8
cartoon 97
drawing 85.7
gallery 82.6
comic 78.9
person 72.1
poster 71.7
posing 69.4
sketch 67.5
clothing 56.6
bunch 49.6
picture frame 8.5

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 94.2%
Calm 99.5%
Sad 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 56-64
Gender Male, 99%
Calm 79.8%
Sad 11.5%
Surprised 5.4%
Confused 1.1%
Disgusted 0.8%
Angry 0.6%
Happy 0.6%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 71%
Calm 96.2%
Happy 2.6%
Fear 0.3%
Angry 0.3%
Disgusted 0.2%
Surprised 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 27-37
Gender Female, 88.9%
Happy 46%
Disgusted 16.6%
Sad 12.7%
Calm 9.3%
Confused 7.6%
Angry 5.3%
Surprised 1.7%
Fear 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 98.9%
Person 96.5%

Captions

Microsoft

a group of people posing for a photo 41.2%
a group of men posing for a photo 30.3%
a group of women posing for a photo 28%

Text analysis

Amazon

Races
Tree
ALEN
VAN ALEN
VAN
LAURENS
WILLIAM
FLOWER MR. EMPS WILLIAM
FLOWER
MR. EMPS

Google

Tree Races JELOWE MRKIMEVI M LAURENE ZNALEN
Tree
Races
JELOWE
MRKIMEVI
M
LAURENE
ZNALEN