Human Generated Data

Title

Untitled (Benny Goodman and Swing Orchestra at Earle; line of people waiting outside theater
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4845
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Benny Goodman and Swing Orchestra at Earle; line of people waiting outside theater

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4845

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Car 99.8
Transportation 99.8
Vehicle 99.8
Automobile 99.8
Car 99.8
Car 99.7
Wheel 99.3
Machine 99.3
Wheel 99
Wheel 98.6
Wheel 98.4
Wheel 95.1
Wheel 94
Metropolis 92
Urban 92
Building 92
City 92
Town 92
Person 91.5
Human 91.5
Art 90.5
Nature 90.1
Person 86.5
Landscape 83
Outdoors 83
Person 82.1
Person 81.6
Person 81.2
Person 80.3
Car 78.4
Drawing 78.3
Architecture 76.9
Downtown 76.6
Person 76.5
Painting 72.2
Scenery 67.1
Person 65.8
Person 62.7
Smoke 61
Office Building 59.7
Person 58.9
Sketch 55.6
Person 51.4
Person 49.4

Clarifai
created on 2023-10-26

vehicle 96.7
illustration 93.6
people 92.4
paper 91.9
no person 91.8
architecture 91
retro 90.7
group 89.8
war 87.4
transportation system 87
antique 86.5
home 85.6
one 85.4
print 85.4
desktop 85
adult 84.8
old 83
many 81.7
vintage 80.6
building 79.5

Imagga
created on 2022-01-23

structure 53
memorial 47.9
brass 46.9
old 33.4
paper 29
ancient 26.8
grunge 24.7
vintage 23.2
stone 22
antique 21.8
texture 21.5
money 21.3
currency 20.6
wall 19.5
cash 19.2
aged 18.1
history 17.9
art 17.7
bank 17.2
architecture 17.1
finance 16.9
bill 15.2
business 15.2
billboard 15
dollar 14.9
retro 14.7
historic 14.7
building 14.3
travel 14.1
wealth 13.5
exchange 13.4
temple 12.7
border 12.7
brown 12.5
signboard 12.5
pattern 12.3
culture 12
banking 12
frame 11.7
city 11.6
hundred 11.6
old fashioned 11.4
sketch 10.7
bills 10.7
drawing 10.7
us 10.6
monument 10.3
rough 10
carving 10
gravestone 9.9
sculpture 9.8
financial 9.8
text 9.6
worn 9.5
damaged 9.5
grungy 9.5
rich 9.3
town 9.3
grain 9.2
tourism 9.1
religion 9
franklin 8.9
grime 8.8
crumpled 8.7
dollars 8.7
pay 8.6
design 8.4
savings 8.4
material 8
textured 7.9
dough 7.8
wallpaper 7.7
symbol 7.4
exterior 7.4
note 7.4
dirty 7.2
landmark 7.2
statue 7.1

Google
created on 2022-01-23

Car 94.9
Building 94.1
Window 90
Vehicle 88.3
Motor vehicle 84.4
Art 81.7
Font 77.7
Rectangle 77
Wheel 76.8
Urban design 74.7
Monochrome 73.7
Painting 70.3
Facade 70.3
Drawing 66.5
Monochrome photography 65.6
Visual arts 64.8
Pattern 64.7
History 64.5
Tire 62.8
Automotive lighting 62

Microsoft
created on 2022-01-23

text 99.9
drawing 94.6
vehicle 85.3
car 83.2
land vehicle 83.2
sketch 80.6
white 70.5
old 61.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 18-26
Gender Male, 98.1%
Calm 51%
Happy 13.7%
Angry 11%
Fear 9.1%
Sad 9.1%
Disgusted 2.4%
Surprised 2.2%
Confused 1.4%

AWS Rekognition

Age 12-20
Gender Male, 77.7%
Calm 45.9%
Sad 22.5%
Happy 22.4%
Disgusted 2.7%
Angry 2.6%
Surprised 2.6%
Fear 0.9%
Confused 0.5%

Feature analysis

Amazon

Car
Wheel
Person
Car 99.8%
Car 99.8%
Car 99.7%
Car 78.4%
Wheel 99.3%
Wheel 99%
Wheel 98.6%
Wheel 98.4%
Wheel 95.1%
Wheel 94%
Person 91.5%
Person 86.5%
Person 82.1%
Person 81.6%
Person 81.2%
Person 80.3%
Person 76.5%
Person 65.8%
Person 62.7%
Person 58.9%
Person 51.4%
Person 49.4%

Categories

Imagga

text visuals 96.3%
paintings art 2.2%
streetview architecture 1.1%

Captions

Microsoft
created on 2022-01-23

a vintage photo of a store 65.9%
a vintage photo of a truck 47.4%

Text analysis

Amazon

WEAR
SALE
STAGE
ON STAGE
SWING
PLUS
ON
TOMLIN
PERSON
ERGER
Hat
SWING ORCHESTRA PLUS
HOSIERY
Hat Cleaning
PERSON BE
PINKY
SHOE
ORCHESTRA
FRANKLIN
Cleaning
BE
RENT
CORN
FRANKLIN SHOE REPAIR
STARS
PINKY TOMLIN "SW
REPAIR
UNDER-PRETTIES
BONES
FRANKLEN
MENS WEAR
"SW
ERGER FOR HOSIERY
SHOE REPAIR.
MENS
Johnson CORN
&
REPAIR.
FOR
Johnson
SCEST &
BONE
SCEST
Gath
ADT
en
SPECIALOS
SOREEN

Google

RENT ERGER HOSIERY UNDER - PRETTIES ON STAGE PERSON BE SWING ORCHESTRA PLUS PINK Y TOMLIN "SW CLEN REPAIR. MENS WEAR STARS FRANKLIN SHOE REPAIR BONES SUDIAEEE SALE POP CORN Hat Cleaning
RENT
ERGER
HOSIERY
UNDER
-
PRETTIES
ON
STAGE
PERSON
BE
SWING
ORCHESTRA
PLUS
PINK
Y
TOMLIN
"SW
CLEN
REPAIR.
MENS
WEAR
STARS
FRANKLIN
SHOE
REPAIR
BONES
SUDIAEEE
SALE
POP
CORN
Hat
Cleaning