Human Generated Data

Title

Untitled (man eating soup at counter, waitress behind counter)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4575
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man eating soup at counter, waitress behind counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.8
Human 99.8
Person 98.9
Restaurant 73.6
Shop 73.4
Person 73
Food 71.1
Meal 71.1
Cafe 65.8
Advertisement 61.6
Electronics 60.1
Monitor 60.1
Display 60.1
Screen 60.1
Person 60.1
Bar Counter 59.6
Pub 59.6
Shelf 58.7
Indoors 58
Poster 56.5
Cafeteria 56

Imagga
created on 2021-12-14

counter 47.1
dishwasher 38.8
white goods 29.7
people 27.9
home appliance 24.8
man 24.2
person 21.7
technology 21.5
work 20.4
computer 20.1
business 20
adult 19.9
male 19.8
working 19.4
smiling 18.8
desk 18.2
appliance 18
table 17.8
indoors 17.6
office 17.3
happy 16.3
restaurant 16
job 14.1
medical 14.1
occupation 13.7
science 13.3
interior 13.3
businessman 13.2
monitor 13
lifestyle 13
education 13
building 12.8
kitchen 12.6
equipment 12.6
holding 12.4
hand 12.1
shop 12.1
men 12
looking 12
home 12
modern 11.9
professional 11.9
women 11.9
furniture 10.7
class 10.6
cheerful 10.6
portrait 10.3
hospital 10.1
smile 10
student 10
lab 9.7
room 9.7
laboratory 9.6
30s 9.6
studying 9.6
sitting 9.4
doctor 9.4
senior 9.4
attractive 9.1
health 9
school 9
copy 8.8
medicine 8.8
lesson 8.8
child 8.3
cafeteria 8.3
phone 8.3
one 8.2
laptop 8.2
businesswoman 8.2
board 8.1
digital 8.1
worker 8.1
group 8.1
durables 8
test 7.7
customer 7.6
talking 7.6
communication 7.6
writing 7.5
house 7.5
mature 7.4
coffee 7.4
bar 7.4
executive 7.4
back 7.3
patient 7.2
team 7.2
teacher 7.1
blackboard 7.1
together 7

Google
created on 2021-12-14

Black 89.8
Black-and-white 86.8
Style 84.1
Font 80.3
Monochrome photography 77.7
Monochrome 76.4
T-shirt 74.1
Chair 73
Table 72.9
Room 71.1
Event 66.8
Stock photography 65.7
Art 65.4
Visual arts 60.4
Tableware 59.6
Sitting 59.2
Job 59.2
Eyewear 58.5
Games 55.5
Illustration 53.6

Microsoft
created on 2021-12-14

text 100
indoor 99.5
person 99
clothing 90.3
man 74.8
black and white 55.3
store 40.2
shop 11

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Female, 79.4%
Calm 41%
Happy 31%
Sad 9%
Confused 8%
Surprised 5.3%
Fear 3.1%
Angry 2%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a person sitting in front of a store 60.2%
a person sitting at a desk in front of a store 60.1%
a person sitting at a table in front of a store 60%

Text analysis

Amazon

BOWL
HEINZ
HEINZ SOUPS
SOUPS
PLATE
CREAM
STRAWBERRY
in
SPAGHETTI
HAMBURGER
STRAWBERRY ICE CREAM
Now
Now in Season
LARGE
OLD
ICE
OF
Season
STYLE
CREAM OF TOMATO
OLD FASHIONED BEAN
GENUINE
BEANS
Piping
CLAM
CHICKEN
CHICKEN NOODLE
119344
Piping Hot
COUNTRY
NOODLE
PEA
BEAN
BEEF
Hot
TOMATO
CREAM OF PEA
VEGETABLE BEEF
FASHIONED
VEGETABLE
BAKED
CLAM CHOWDER
COUNTRY STYLE CHICKE
CREAM OF MUSHROOM
CHOWDER
SUNSHINE
Bowl
Juice
GENUINE TURTLE
10
LARGE BOWL 15
CHICKE
TURTLE
MUSHROOM
-
CAPTURED
10 Large Bowl 15
15
minutes!
Milk
CHUNGER
SOURS
Public
Large
MAD
Tomato
M2 minutes!
Olive - -
CLASS CHUNGER
MJI7
MJI7 A72A
M2
Numb Public
Ref
- E
A72A
/
KODOLA
CLASS
R
COCON KODOLA
Olive
E
Malter
COCON
GAEGII
REWT
SERVICE
Country
Numb
SERVICE NUMTER
Bome
NUMTER
CHRANCE
State

Google

ICE
in
aco
NOOOL
SPAGHETTI
minstes!
CocaCola
COUNTRY
OF
BEAN
GENUINE
PEA
TOMATE
STRANDERY ICE CREAM Now in Seaun HEINZ SOU CA aco CLAN CH EN CHICK NOOOL TARGE BOWL 15 HAMBURGER SPAGHETTI MAP PLATE HEINZ SOUPS Piping Hot 2 minstes! SHEINZ OVEN BAKED BEANS CocaCola CREAM OF MUSHROOM COUNTRY STYLE CHICKE CREAM OF TOMATO OLD FASHIONED BEAN VEGETABLE BEEF VEGETABLE CLAM CHOWDER GENUINE TURTLE CREAM OF PEA CAPTURED SNSNINE Multed HEINZ CHICKEN NOODLE ZNIEH Large Bowl 10 TOMATE
STRANDERY
CREAM
CA
CLAN
15
HEINZ
SOUPS
BAKED
CAPTURED
NOODLE
SOU
MAP
Hot
OVEN
CHICKE
OLD
FASHIONED
VEGETABLE
CLAM
TURTLE
CHICKEN
CH
EN
PLATE
2
SHEINZ
BEANS
TOMATO
ZNIEH
Now
Seaun
CHICK
TARGE
BOWL
HAMBURGER
Piping
MUSHROOM
STYLE
BEEF
CHOWDER
SNSNINE
Multed
Large
Bowl
10