Human Generated Data

Title

Untitled (couple sitting at restaurant counter, waiter behind counter)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4572
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple sitting at restaurant counter, waiter behind counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.6
Human 98.6
Person 98.3
Person 85.6
Shop 85.4
Cafe 76.5
Restaurant 76.5
Wristwatch 75.5
Bakery 69.3
Cafeteria 60
Lab 57.9

Imagga
created on 2021-12-14

blackboard 100
menu 34.9
fare 28.2
data 26.5
business 24.9
technology 23
board 22.3
digital 21.1
education 20.8
chart 19.1
computer 18.4
information 17.7
finance 16.1
design 15.8
man 15.5
graph 15.4
science 15.1
communication 15.1
market 15.1
hand 14.4
diagram 14.4
financial 14.3
3d 13.9
classroom 13.7
success 13.7
food 13.5
male 13.5
growth 13.2
stock 13.1
college 12.3
black 12
money 11.9
student 11.8
work 11.8
school 11.7
graphic 11.7
scoreboard 11.6
plan 11.3
person 10.9
global 10.9
teacher 10.8
chalk 10.7
businessman 10.6
exam 10.5
university 10.5
display 10.5
word 10.4
network 10.3
glowing 10.2
people 10
equipment 9.8
sign 9.8
human 9.7
world 9.7
management 9.7
figures 9.7
signboard 9.7
study 9.3
idea 8.9
formula 8.9
analysis 8.8
teaching 8.8
screen 8.8
symbol 8.8
text 8.7
economic 8.7
class 8.7
cloud 8.6
profit 8.6
marketing 8.6
system 8.6
industry 8.5
modern 8.4
electronic 8.4
office 8.4
economy 8.3
style 8.2
job 8
conceptual 7.9
chalkboard 7.8
statistics 7.8
mathematics 7.8
render 7.8
drawing 7.7
numbers 7.7
tag 7.7
boss 7.7
trade 7.6
texture 7.6
exchange 7.6
web 7.6
research 7.6
tech 7.6
graphics 7.5
writing 7.5
commerce 7.5
bar 7.4
investment 7.3
currency 7.2

Google
created on 2021-12-14

Product 90.8
Black-and-white 85.7
Font 84.7
Hat 84
Style 83.9
Monochrome 75.8
Monochrome photography 74.6
Blackboard 73.9
Room 69.5
T-shirt 61.8
Advertising 60.4
Menu 57.1
Illustration 53.7
Handwriting 53.5
Machine 50.5

Microsoft
created on 2021-12-14

text 100
clothing 81.1
person 79.3
menu 70.3
shop 10.1

Face analysis

Google

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Wristwatch 75.5%

Captions

Microsoft

calendar 82.9%

Text analysis

Amazon

DRINKS
CREAM
HAMBURGER
ICE
MILK
DELICIOUS
SODAS
THUMB
SANDWICHES
FISH
8
REFRESHING DRINKS & ICE CREAM
COLD
SUNDAES
DELICIOUS SANDWICHES EXCLUSIVELY
FRANKFURTER
ALL
ORANGE
7
2
THE
TOM THUMB
CAKE
ORDER
REFRESHING
MADE
6
PRODUCTS
PINEAPPLE
SERVED
10
TOMATO
4
COLA
&
12
5
CLUB
EXCLUSIVELY
TOM
BREAKFAST
3
119327.
MILK COLD SHAKE MILK
COCA COLA
SHAKE
MEAT
e
TOMATO JUICE
COLD DRINKS 5
PLAIN
COCA
JUICE
ROOT
FRESHLY
2 10 8 7 12 6 I 5 2 4
15
DRINKS 5
ROLL
IO
I
or
TOM THUME
BEER
ICE CREAM SODAS DO
MEAT LOAF
MILK DRINKS Sc
FRANKFURTER S
ICE CREAM 10 & 15
THUME
ALL SANDWICHES FRESHLY MADE e ORDER ROLL - WHITE - or TOMEY
use
HAMBURGER 5
MIRES ROOT BEER
LOAF
-
S
KINGST
DE use THE KINGST
PLAIN THE
TIM
Sc
10 & 15
TIM THUMP
MIRES
THUMP
DO
WHITE
DE
x
...
TOMEY
a
FRIENDS
STRANDERAY-PLACE
EMPIRE a an
ROTTER STRANDERAY-PLACE FRIENDS
M
ROTTER
EMPIRE
INSTITUTE
an

Google

THUMB)
use
EXCLUSIVELY
5
FISH
CAKE
5t.
St
ALL
SANDWOWES
AAD
ORDER
ON
12
REFRESHING
,
10
ROOT
SLICED
EO
DIMENTO
EtAYYuCe
MILK
S
CREAM
ESETTU
1
TOMATO
LETCE
SHAKE
BACONBEOG
IO
EGG
BACON
Ce
PURE
119327.
O
THUMH
HAMBURGER
TO
TOAT
ICE
BER
AMERICAN
BUTTER
JUICE
ECED
E
HOT
DRINKS
15
PRIED
RIEO
ASTYKAKE
The
Mue
CA
WL
WITH
TOM
FINEST
PRODVCTS
ROLL
FRESKLY
THUME
M
10615
ANCOCOLATE
PINEAPPLE
1O
EOo
FATED
HAM
CIVERWURET..
PIANUT
PLAIN
6.
TOMATOELETTUCE
i06
MALTID
SOUPS
BROMO-SELTZER
(or
COFFEE
"HOME-MADE"
REARPAST
COFF
FRANKFURTER
SERVED
CTOM
COLD
SUNDAES
3
4.
CHEESE
MEAT
LOAT
MLK
SODAS
COLA
FARDINE
EARDINE-FOMATO
MALTED
With
het
lMhe
hng
HEINZ
g
DA
LARGE
119327. TOM THUMB) DELICIOUS SANDWICHES OM THUMH we use THE FINEST PRODVCTS EXCLUSIVELY HAMBURGER 5 FISH CAKE 5t. FRANKFURTER St SERVED ON ROLL ALL SANDWOWES FRESKLY AAD TO ORDER ON wE-Re OR TOAT 12 CTOM THUME REFRESHING DRINKS & ICE CREAM M THM ICE CREAM 10615 , COLD DRINKS S 10 SUNDAES 15 VANASTRANSERAV.PEACH BUTTER ANCOCOLATE ORANGE PINEAPPLE S ROOT BER 3 4. AMERICAN CHEESE MEAT LOAT 1O SLICED EOo FATED EO HAM DIMENTO CHEESE CREAM CHESE" CIVERWURET.. TOMATO EtAYYuCe PIANUT BUTTER 10 MILK DRINKS S ICE COLD MLK ICE CREAM SODAS 10 COCA COLA TOMANO JUICE FARDINE PLAIN MILK SHAKE ur SALMON TOMATO ESETTU 1 6. 5. BACON TOMATO ECED E TOMATOELETTUCE EARDINE-FOMATO LETCE HOT DRINKS ICE CREAM MILK SHAKE 15 MALTED MILK PRIED HAM i06 RIEO BACONBEOG IO ICE CREAM MALTID MILK O With EGG 15 ASTYKAKE BACON The Ce het Mue lMhe hng HEINZ SOUPS BROMO-SELTZER 10 (or g COFFEE 5 CA DA LARGE WL 15 WITH PURE CREAM 111. TASTY "HOME-MADE" FISH CAKES 5 119327. REARPAST CRELLERS O COFF
DELICIOUS
SANDWICHES
OM
we
THE
wE-Re
OR
&
THM
VANASTRANSERAV.PEACH
ORANGE
CHESE"
COCA
TOMANO
ur
SALMON
5.
111.
TASTY
CAKES
CRELLERS