Human Generated Data

Title

Untitled (Philadelphia Pepperpot layouts: horses, dogs and riders)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12086
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Philadelphia Pepperpot layouts: horses, dogs and riders)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12086

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.3
Human 99.3
Person 99.2
Poster 98.7
Advertisement 98.7
Person 98.2
Person 98.2
Person 97.7
Collage 95.5
Person 93.8
Person 92.4
Person 92.3
Person 92.1
Person 91.8
Person 90.2
Person 89.9
Person 89.8
Person 82.1
Flyer 81.1
Brochure 81.1
Paper 81.1
Person 64.5
Book 57.6
Person 48.4

Clarifai
created on 2023-10-26

people 99.6
adult 97.8
group 97.3
man 96.1
art 95.3
monochrome 95.1
woman 94.6
print 92.7
one 91.1
illustration 90.8
war 90.6
picture frame 89.1
painting 87.6
many 86.8
paper 86.6
leader 85.2
portrait 83.6
two 82.6
wear 81.5
commerce 81

Imagga
created on 2022-01-15

book jacket 70.7
jacket 56
wrapping 41.8
newspaper 29.9
covering 29
vintage 25.6
art 25.5
product 24.6
old 24.4
daily 23.8
paper 22.7
antique 21.6
grunge 21.3
drawing 20.4
comic book 20.1
creation 19.6
sketch 19.2
retro 18.8
texture 15.3
frame 15
ancient 14.7
stamp 14.5
letter 13.8
symbol 13.5
cash 12.8
money 12.8
black 12.6
currency 12.6
postage 11.8
blackboard 11.5
mail 11.5
postmark 10.8
postal 10.8
post 10.5
business 10.3
representation 10.3
aged 10
border 9.9
dirty 9.9
history 9.8
renaissance 9.8
blank 9.4
culture 9.4
envelope 9.4
architecture 9.4
church 9.2
artwork 9.2
global 9.1
design 9
religion 9
one 9
bank 9
masterpiece 8.9
fame 8.9
paintings 8.8
icon 8.7
painted 8.6
unique 8.5
travel 8.4
dollar 8.3
economy 8.3
decoration 8.2
brown 8.1
print media 8
painter 8
known 7.9
printed 7.9
delivery 7.8
museum 7.8
sculpture 7.7
cutting 7.7
dollars 7.7
wall 7.7
communications 7.7
damaged 7.6
finance 7.6
house 7.5
city 7.5
famous 7.4
closeup 7.4
banking 7.3
note 7.3
detail 7.2
office 7.2
financial 7.1

Google
created on 2022-01-15

Organism 85.6
Art 80.5
Font 79.4
Monochrome 70
Visual arts 68.9
Monochrome photography 68.7
Room 66.5
Stock photography 62
History 60.2
Illustration 57.8
Pattern 57.3
Printmaking 55.2
Painting 54.4
Collection 53.3
Paper 52.9
Photographic paper 52.1
Wood 50.1

Microsoft
created on 2022-01-15

text 99.9
cartoon 98.1
drawing 95.5
poster 94.7
book 82.1
person 81.4
clothing 80.4
sketch 73.2
blackboard 63.3
posing 60.6
painting 52.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 38-46
Gender Male, 86.3%
Calm 99.5%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%
Sad 0.1%
Surprised 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Happy 38.1%
Calm 30%
Angry 8.6%
Surprised 8.3%
Disgusted 5.4%
Sad 5.2%
Confused 3.5%
Fear 1.1%

AWS Rekognition

Age 39-47
Gender Female, 68.3%
Calm 92.6%
Angry 2.5%
Happy 2.4%
Sad 1%
Disgusted 0.7%
Confused 0.4%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Male, 91.2%
Disgusted 74.6%
Happy 8.7%
Sad 5.3%
Calm 3.7%
Confused 2.7%
Surprised 2.2%
Fear 1.4%
Angry 1.3%

AWS Rekognition

Age 23-33
Gender Male, 95.5%
Sad 62.1%
Calm 33.9%
Fear 1.2%
Confused 0.8%
Angry 0.7%
Disgusted 0.7%
Happy 0.4%
Surprised 0.2%

Feature analysis

Amazon

Person 99.3%
Poster 98.7%

Categories

Imagga

streetview architecture 99.8%

Captions

Microsoft
created on 2022-01-15

an old photo of a blackboard 79.6%
a blackboard near a window 64.8%
a blackboard posing for a photo 64.7%

Text analysis

Amazon

The
The Bryn
Bryn
MRS
WALTER
RHOADES
TRADE
EDWARD
PHILIP
MRS WALTER PEW
STOPS
MR
HER
PEW
WITH
VICTOR
MRS VICTOR MATHER
MR ISAAC CLOTHIER
AND
MATHER
ISAAC
PRIZE
DI
CLOTHIER
WINNER
BLYNN
REEVE
MR.
FIRENZE
NORMAN
OPINIONS
MR. EDWARD ISLEY
WINNER "MAUDE"
MRS. PHILIP STAPLES MRS NORMAN
MRS.BRYCE BLYNN
SHows HER PRIZE
MRS.
DIXON
EWING
OPINIONS WITH MR.4MRS FISTER REEVE
"MAUDE"
MR.4MRS
MRS.BRYCE
ISLEY
Belowg-WALTER RHOADES STOPS To TRADE
FIRENZE FAIRFAX"
STAPLES
MRS.MOREIS DI XON MRS JOSEPH EWING
JOSEPH
SHows
FTC
MK.MONEIS DIXON AND MRS DICH MCNEELEY
CONDERMAN FTC
To
MCNEELEY
FAIRFAX"
CONDERMAN
MRS R-CERT GUSSEIHEIM WITH HER
DICH
FISTER
XON
Belowg-WALTER
R-CERT
MRS.MOREIS
GUSSEIHEIM
MK.MONEIS

Google

The Bryn MRS. A ORRIS DI XON, MRS. JOSEPH EWING MRM ORRIS DIXO AND MRS DICH MENEFLEY MR ISAAC CLTHIER MES VICTOR MATHER SHOWS HER PRIZE WINNER "MAUDE" MRS ROBERT GUG GENHEINM WITH HER FIRENZE FAIR FAX" WINNER AMELRRoaK MR. EDWARD ISEY Below-WALTER RHOADES STOPS To TRADE CPINIONS WITH MRAMRS FSTER RETVE MRS. WALTER PEW TRS. BRYCE BLYNN MRS. PHILIP STAPLES MRS. NARMAM CON DERMA N, ETC
The
Bryn
MRS.
A
ORRIS
DI
XON,
JOSEPH
EWING
MRM
DIXO
AND
MRS
DICH
MENEFLEY
MR
ISAAC
CLTHIER
MES
VICTOR
MATHER
SHOWS
HER
PRIZE
WINNER
"MAUDE"
ROBERT
GUG
GENHEINM
WITH
FIRENZE
FAIR
FAX"
AMELRRoaK
MR.
EDWARD
ISEY
Below-WALTER
RHOADES
STOPS
To
TRADE
CPINIONS
MRAMRS
FSTER
RETVE
WALTER
PEW
TRS.
BRYCE
BLYNN
PHILIP
STAPLES
NARMAM
CON
DERMA
N,
ETC