Human Generated Data

Title

Untitled (couple sitting at restaurant counter, waiter behind counter)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4572
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple sitting at restaurant counter, waiter behind counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4572

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.6
Human 98.6
Person 98.3
Person 85.6
Shop 85.4
Cafe 76.5
Restaurant 76.5
Wristwatch 75.5
Bakery 69.3
Cafeteria 60
Lab 57.9

Clarifai
created on 2023-10-15

monochrome 99.5
people 99.5
adult 97.8
indoors 96.1
man 93.5
woman 92.6
horizontal 91.2
side view 89.7
two 89.4
sit 88.8
group 83.2
three 82.2
several 82.1
no person 81.1
one 79.1
four 77.8
nostalgia 73.4
vehicle 73
transportation system 72.2
room 72.2

Imagga
created on 2021-12-14

blackboard 100
menu 34.9
fare 28.2
data 26.5
business 24.9
technology 23
board 22.3
digital 21.1
education 20.8
chart 19.1
computer 18.4
information 17.7
finance 16.1
design 15.8
man 15.5
graph 15.4
science 15.1
communication 15.1
market 15.1
hand 14.4
diagram 14.4
financial 14.3
3d 13.9
classroom 13.7
success 13.7
food 13.5
male 13.5
growth 13.2
stock 13.1
college 12.3
black 12
money 11.9
student 11.8
work 11.8
school 11.7
graphic 11.7
scoreboard 11.6
plan 11.3
person 10.9
global 10.9
teacher 10.8
chalk 10.7
businessman 10.6
exam 10.5
university 10.5
display 10.5
word 10.4
network 10.3
glowing 10.2
people 10
equipment 9.8
sign 9.8
human 9.7
world 9.7
management 9.7
figures 9.7
signboard 9.7
study 9.3
idea 8.9
formula 8.9
analysis 8.8
teaching 8.8
screen 8.8
symbol 8.8
text 8.7
economic 8.7
class 8.7
cloud 8.6
profit 8.6
marketing 8.6
system 8.6
industry 8.5
modern 8.4
electronic 8.4
office 8.4
economy 8.3
style 8.2
job 8
conceptual 7.9
chalkboard 7.8
statistics 7.8
mathematics 7.8
render 7.8
drawing 7.7
numbers 7.7
tag 7.7
boss 7.7
trade 7.6
texture 7.6
exchange 7.6
web 7.6
research 7.6
tech 7.6
graphics 7.5
writing 7.5
commerce 7.5
bar 7.4
investment 7.3
currency 7.2

Google
created on 2021-12-14

Product 90.8
Black-and-white 85.7
Font 84.7
Hat 84
Style 83.9
Monochrome 75.8
Monochrome photography 74.6
Blackboard 73.9
Room 69.5
T-shirt 61.8
Advertising 60.4
Menu 57.1
Illustration 53.7
Handwriting 53.5
Machine 50.5

Microsoft
created on 2021-12-14

text 100
clothing 81.1
person 79.3
menu 70.3
shop 10.1

Color Analysis

Face analysis

Google

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Wristwatch 75.5%

Categories

Imagga

text visuals 87.6%
paintings art 9.3%
interior objects 2%

Captions

Microsoft

calendar 82.9%

Text analysis

Amazon

DRINKS
CREAM
HAMBURGER
ICE
MILK
DELICIOUS
SODAS
THUMB
SANDWICHES
FISH
8
REFRESHING DRINKS & ICE CREAM
COLD
SUNDAES
DELICIOUS SANDWICHES EXCLUSIVELY
FRANKFURTER
ALL
ORANGE
7
2
THE
TOM THUMB
CAKE
ORDER
REFRESHING
MADE
6
PRODUCTS
PINEAPPLE
SERVED
10
TOMATO
4
COLA
&
12
5
CLUB
EXCLUSIVELY
TOM
BREAKFAST
3
119327.
MILK COLD SHAKE MILK
COCA COLA
SHAKE
MEAT
e
TOMATO JUICE
COLD DRINKS 5
PLAIN
COCA
JUICE
ROOT
FRESHLY
2 10 8 7 12 6 I 5 2 4
15
DRINKS 5
ROLL
IO
I
or
TOM THUME
BEER
ICE CREAM SODAS DO
MEAT LOAF
MILK DRINKS Sc
FRANKFURTER S
ICE CREAM 10 & 15
THUME
ALL SANDWICHES FRESHLY MADE e ORDER ROLL - WHITE - or TOMEY
use
HAMBURGER 5
MIRES ROOT BEER
LOAF
-
S
KINGST
DE use THE KINGST
PLAIN THE
TIM
Sc
10 & 15
TIM THUMP
MIRES
THUMP
DO
WHITE
DE
x
...
TOMEY
a
FRIENDS
STRANDERAY-PLACE
EMPIRE a an
ROTTER STRANDERAY-PLACE FRIENDS
M
ROTTER
EMPIRE
INSTITUTE
an

Google

119327. TOM THUMB) DELICIOUS SANDWICHES OM THUMH we use THE FINEST PRODVCTS EXCLUSIVELY HAMBURGER 5 FISH CAKE 5t. FRANKFURTER St SERVED ON ROLL ALL SANDWOWES FRESKLY AAD TO ORDER ON wE-Re OR TOAT 12 CTOM THUME REFRESHING DRINKS & ICE CREAM M THM ICE CREAM 10615 , COLD DRINKS S 10 SUNDAES 15 VANASTRANSERAV.PEACH BUTTER ANCOCOLATE ORANGE PINEAPPLE S ROOT BER 3 4. AMERICAN CHEESE MEAT LOAT 1O SLICED EOo FATED EO HAM DIMENTO CHEESE CREAM CHESE" CIVERWURET.. TOMATO EtAYYuCe PIANUT BUTTER 10 MILK DRINKS S ICE COLD MLK ICE CREAM SODAS 10 COCA COLA TOMANO JUICE FARDINE PLAIN MILK SHAKE ur SALMON TOMATO ESETTU 1 6. 5. BACON TOMATO ECED E TOMATOELETTUCE EARDINE-FOMATO LETCE HOT DRINKS ICE CREAM MILK SHAKE 15 MALTED MILK PRIED HAM i06 RIEO BACONBEOG IO ICE CREAM MALTID MILK O With EGG 15 ASTYKAKE BACON The Ce het Mue lMhe hng HEINZ SOUPS BROMO-SELTZER 10 (or g COFFEE 5 CA DA LARGE WL 15 WITH PURE CREAM 111. TASTY "HOME-MADE" FISH CAKES 5 119327. REARPAST CRELLERS O COFF
TOM
DELICIOUS
SANDWICHES
we
EXCLUSIVELY
HAMBURGER
FISH
CAKE
5t.
SERVED
ON
ROLL
ALL
FRESKLY
AAD
TOAT
12
DRINKS
&
CREAM
M
THM
S
10
15
VANASTRANSERAV.PEACH
BER
AMERICAN
1O
SLICED
EOo
FATED
EO
HAM
DIMENTO
CHEESE
CHESE"
CIVERWURET..
TOMATO
EtAYYuCe
PIANUT
BUTTER
MILK
ICE
COLD
SODAS
COLA
TOMANO
JUICE
FARDINE
SHAKE
ur
ESETTU
1
ECED
EARDINE-FOMATO
LETCE
MALTED
PRIED
With
EGG
ASTYKAKE
BACON
The
Ce
Mue
lMhe
SOUPS
(or
g
DA
LARGE
WITH
PURE
TASTY
"HOME-MADE"
119327.
REARPAST
O
COFF
THUMB)
OM
THUMH
use
THE
FINEST
PRODVCTS
5
FRANKFURTER
St
SANDWOWES
TO
ORDER
wE-Re
OR
CTOM
THUME
REFRESHING
10615
,
SUNDAES
ANCOCOLATE
ORANGE
PINEAPPLE
ROOT
3
4.
MEAT
LOAT
MLK
COCA
PLAIN
SALMON
6.
5.
E
TOMATOELETTUCE
HOT
i06
RIEO
BACONBEOG
IO
MALTID
het
hng
HEINZ
BROMO-SELTZER
COFFEE
CA
WL
111.
CAKES
CRELLERS