Human Generated Data

Title

Untitled (women working behind counter of restaurant with Heinz products)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11972
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (women working behind counter of restaurant with Heinz products)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.5
Human 99.5
Person 99.3
Person 99.2
Restaurant 98.8
Person 98.5
Cafeteria 89.7
Cafe 89.5
Apparel 89.1
Clothing 89.1
Food 78.8
Meal 78.8
Hat 76.7
Person 76.4
Shop 60.6
Food Court 60
Furniture 58.8
Chair 58.8
Workshop 57.9
Shorts 55.4
Urban 55.2
Person 47.7

Imagga
created on 2022-01-15

newspaper 89.3
product 67
creation 52
man 32.2
business 31.6
office 31.5
people 30.1
male 29.1
businessman 27.4
room 27.3
computer 24.9
classroom 24.7
work 23.5
person 23.4
shop 21.9
job 19.5
adult 18.2
technology 17.8
men 17.2
indoors 16.7
laptop 16.6
barbershop 16.4
working 15.9
occupation 15.6
daily 15.3
looking 15.2
manager 14.9
sitting 14.6
mercantile establishment 14.6
group 13.7
indoor 13.7
building 13.5
desk 13.5
modern 13.3
corporate 12.9
education 12.1
casual 11.9
horizontal 11.7
class 11.6
worker 11.6
happy 11.3
screen 11.2
teamwork 11.1
executive 11
professional 10.7
center 10.6
success 10.5
old 10.4
senior 10.3
mature 10.2
black 10.2
lifestyle 10.1
businesswoman 10
team 9.9
table 9.7
portrait 9.7
place of business 9.7
together 9.6
monitor 9.6
couple 9.6
meeting 9.4
writing 9.4
smiling 9.4
architecture 9.4
communication 9.2
phone 9.2
back 9.2
hand 9.1
holding 9.1
teacher 9
home 8.8
studying 8.6
chart 8.6
one person 8.5
finance 8.4
house 8.4
board 8.1
handsome 8
financial 8
chair 8
women 7.9
circuit 7.8
engineer 7.8
face 7.8
30s 7.7
project 7.7
industry 7.7
employee 7.6
customer 7.6
two 7.6
college 7.6
businesspeople 7.6
restaurant 7.5
student 7.4
school 7.3
counter 7.2
to 7.1
day 7.1

Google
created on 2022-01-15

Photograph 94.3
Black 89.8
Black-and-white 87.2
Style 84
Chair 82
Table 81.8
Picture frame 75.8
Monochrome 75.4
Font 75.3
Monochrome photography 75.3
Beauty 74.9
Snapshot 74.3
Art 71
Customer 70.9
Room 70.4
Design 68.6
Event 67.8
T-shirt 64.8
Stock photography 64
Job 63.3

Microsoft
created on 2022-01-15

text 99.8
clothing 97.8
person 95.2
man 87.1
people 82
woman 78.5
newspaper 67.9
street 62.5
black and white 53.4
store 47.8
shop 15.2

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 97.2%
Calm 91.9%
Sad 5.1%
Happy 1.5%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Surprised 0.3%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 76.7%

Captions

Microsoft

a group of people sitting in front of a store 75%
a group of people in front of a store 74.9%
a group of people sitting and standing in front of a store 73.4%

Text analysis

Amazon

SOUPS
HEINZ
HEINZ SOUPS
15
CREAM
FLAVORS
Hot
15807
CHOCOLATE
CHICKEN
TOMATO
IDE CREAM FLAVORS
STRAWBERRY
Het
Large
-
CLAM
FASHIONED
COFFEE
Papiers Het
COUNTRY
IDE
Papiers
MUSHROOM
TRANSE
Large Boul
CREAM - MUSHROOM
Lange Baul 15
PECAN
ТЭТ
CHICKEN NOODLE
VEGETARIA
- CREAM und -
STALE CHICKEN
15c
Baul
BEAN
CLAM CHOWSER
CLUB FASHIONED BEAN
CREAM mL
CREAM CHICKEN - NOODS PM
Lange
TRANSE -
PHEAPPLE
CARAM d' TOMATO
Boul
Piping -2 Hot
Parksay
GROUP - -
FEE - CHOWLAN -
PM
A VEGETANI TOMATO - NORE
und
STALE
NOODLE
d'
VEGETARIE
Piping
GROUP
fair
ME
FEE
CARAM
SURTA
NOODS
Parkuray
NORE
Parking
GENUNE SURTA
VEGETANI
Parking THERE
CHOWSER
CLUB
mL
THERE
A
CHOWLAN
-2
GENUNE

Google

HEINZ
SOUPS
PAPPLE
OF
M
5
15807. HEINZ SOUPS HEINZ SOUPS ICE CREAM FLAVORS ALLA STRAE PAPPLE RAE CRAN OF MU oOM couNTRY STYLE CRCE CRRAM OF M PECAN VEGASABLE SMEF ran NS 15 807. •L08 5 HAGON-YT33A2-NAMTZA3
15807.
ICE
ALLA
STRAE
CRAN
couNTRY
CRCE
ran
NS
•L08
CREAM
FLAVORS
RAE
VEGASABLE
SMEF
15
MU
STYLE
PECAN
807.
oOM
CRRAM
HAGON-YT33A2-NAMTZA3