Human Generated Data

Title

Untitled (Philadelphia Pepperpot Layouts: spectators at horseshow)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12082

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Philadelphia Pepperpot Layouts: spectators at horseshow)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12082

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Poster 99.8
Advertisement 99.8
Person 99.2
Human 99.2
Person 97.8
Person 94.9
Person 92.8
Person 90.7
Collage 90.3
Person 82.8
Person 77.7
Person 73.3
Comics 70.7
Book 70.7
Person 65.4
Person 42.1

Clarifai
created on 2023-10-26

people 99.9
group 99
monochrome 98.2
adult 97.8
woman 97
man 96.3
many 95.4
leader 93.8
art 93.4
war 92.6
painting 91.7
two 91.6
one 91.1
child 90.2
furniture 86.7
portrait 86.6
indoors 86.5
administration 85.4
picture frame 85.4
music 85.3

Imagga
created on 2022-01-15

comic book 65.7
book jacket 53.7
jacket 41.8
wrapping 31.8
print media 26.3
covering 24
vintage 23.1
old 21.6
art 16.9
design 16.9
paper 14.9
retro 14.7
frame 14.5
antique 13.8
grunge 13.6
stamp 13.5
collection 13.5
envelope 13.4
mail 13.4
texture 13.2
postage 12.8
black 12.6
postmark 11.8
letter 11
window 10.8
symbol 10.8
drawing 10.6
blank 10.3
house 10
postal 9.8
office 9.8
graphic 9.5
card 9.3
set 9.3
artwork 9.2
product 9
printed 8.9
icon 8.7
post 8.6
money 8.5
business 8.5
pattern 8.2
decoration 8.2
aged 8.1
philately 7.9
ancient 7.8
cutting 7.7
wall 7.7
communications 7.7
painted 7.6
unique 7.6
silhouette 7.4
style 7.4
book 7.4
brown 7.4
bookmark 7.3
cash 7.3
creation 7.3
global 7.3
sketch 7.3
people 7.2
color 7.2
home 7.2
currency 7.2
insulating material 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99.6
cartoon 97.1
poster 95
book 94.9
person 93.5
posing 92.1
clothing 87.8
man 71.4
gallery 70.7
bunch 64.2
library 62.8
painting 16.4
picture frame 11.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 54.9%
Calm 98.6%
Sad 0.6%
Confused 0.5%
Happy 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Calm 73%
Sad 24.8%
Confused 0.8%
Surprised 0.6%
Disgusted 0.2%
Happy 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 97.4%
Calm 70.7%
Sad 18%
Confused 7.8%
Angry 1.3%
Disgusted 0.7%
Surprised 0.6%
Fear 0.5%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Female, 61.8%
Sad 44.3%
Calm 23%
Confused 15.6%
Surprised 10.2%
Fear 2.8%
Disgusted 1.8%
Angry 1.1%
Happy 1.1%

AWS Rekognition

Age 28-38
Gender Female, 93.9%
Happy 54.1%
Calm 32.3%
Sad 8%
Angry 1.6%
Confused 1.4%
Fear 1.2%
Disgusted 1%
Surprised 0.4%

AWS Rekognition

Age 27-37
Gender Male, 93.9%
Calm 99.9%
Surprised 0%
Confused 0%
Sad 0%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.8%
Person 99.2%

Categories

Captions

Microsoft
created on 2022-01-15

a group of men posing for a photo 44.6%
a group of people posing for a photo 44.5%

Text analysis

Amazon

Races
Tree
ALEN
WILLIAM
VAN ALEN
VAN
BELOW
BELOW MP.4ME5 WILLIAM
MP.4ME5
LAURENC

Google

Tree Races SELOW: MP4MES. WIALIAM EAVREN VAN ALEN
Tree
Races
SELOW:
MP4MES.
WIALIAM
EAVREN
VAN
ALEN