Human Generated Data

Title

Untitled (couple seated at counter of Heinz Company Restaurant, PA)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11769
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated at counter of Heinz Company Restaurant, PA)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11769

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.5
Human 99.5
Person 99.4
Indoors 83.2
Person 82.1
Shelf 68.8
Apparel 67.7
Hat 67.7
Clothing 67.7
Sink 57.2

Clarifai
created on 2023-10-26

people 98.8
furniture 97.2
room 97
adult 96.1
indoors 95.8
monochrome 95.7
man 95.4
chair 94.5
scientist 94.3
woman 94.2
desk 92.6
group 92.1
two 88.4
seat 88.3
one 85.9
sit 85.7
science 84.5
education 83.2
technology 83.1
hospital 82

Imagga
created on 2022-01-15

table 44.8
office 39.1
desk 38.4
interior 32.7
room 30.1
computer 29.7
work 28.3
business 28
indoors 26.4
furniture 25.4
man 24.2
people 23.4
working 23
home 22.3
professional 19.8
modern 19.6
counter 19
person 18.8
laptop 18.1
restaurant 18.1
adult 17.7
technology 16.3
happy 16.3
meeting 16
smiling 15.9
house 15.9
chair 15.7
male 15.6
kitchen 15.1
communication 15.1
education 14.7
worker 14.2
job 14.2
monitor 14.1
businessman 14.1
corporate 13.8
lifestyle 13.7
shop 13.5
sitting 12.9
occupation 12.8
businesswoman 12.7
equipment 12.6
salon 12.1
case 12.1
executive 12
inside 12
indoor 11.9
smile 11.4
keyboard 11.4
design 11.3
floor 11.2
screen 10.8
building 10.6
workplace 10.5
group 10.5
businesspeople 10.4
men 10.3
center 10.1
light 10
television 10
suit 9.9
furnishing 9.9
decor 9.7
comfortable 9.6
elegance 9.2
confident 9.1
success 8.9
women 8.7
structure 8.7
notebook 8.6
glass 8.6
hospital 8.4
hand 8.4
coffee 8.3
luxury 7.7
college 7.6
presentation 7.4
style 7.4
teamwork 7.4
classroom 7.4
phone 7.4
food 7.3
barbershop 7.3
student 7.2
decoration 7.2
teacher 7.2
school 7.2
team 7.2
handsome 7.1
information 7.1
appliance 7.1
seat 7

Google
created on 2022-01-15

Hat 90.5
Black-and-white 84.4
Style 83.9
Art 75.3
Eyewear 74.3
Monochrome photography 74.1
Automotive design 73.9
Monochrome 73.7
Fashion design 69.9
Font 67.8
Cooking 67.2
Room 65
Visual arts 64.9
Stock photography 63.5
Rectangle 62.7
Glass 61.6
Still life photography 60.8
Machine 59.3
Display case 57.9
Picture frame 55.3

Microsoft
created on 2022-01-15

text 99
wall 98.9
indoor 96.7
black and white 94.9
person 62.7
white 62
computer 58.7
table 30.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 11-19
Gender Male, 97.2%
Calm 66.4%
Sad 28.1%
Angry 2.9%
Disgusted 1.3%
Happy 0.4%
Confused 0.4%
Surprised 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.5%
Hat 67.7%

Text analysis

Amazon

HEINZ
OLD
CLAM
TURTLE
NOODLE
PS
CHICKEN NOODLE
PEA
CREAM
CHICKEN
OLD FASHIONED BEAN
119351.
SOL PS
FASHIONED
TWO
SOL
BEAN
TOMATO
VEGETABLE
GENUINE
OF
CLAM CHOWDER
CHOWDER
MUSHROOM
CORN CHOWDER
BEEF
CH
CORN
CREAM CH
OMATO
CREAM OF MUSHROOM
NAMTSAT
ETCHUP
PLAY

Google

11935
TWO
G
CORN
CHOWDER
CHICKEN
NOODLE
CREAM
OF
MUSHROCM
OLD
BEAN
VEGETABLE
BEEF
GENUINE
CLAM
MEIN?
MA
119
351.
11935 1. HEINZ SOLPS TWO G VEGETONLE CORN CHOWDER CHICKEN NOODLE CREAM OF TOMATO CREAM OF MUSHROCM OLD FASHIONED BEAN VEGETABLE BEEF GENUINE TURTLE CLAM CHOWDER CREAM OF PEA MEIN? MA 119 351.
1.
HEINZ
SOLPS
VEGETONLE
TOMATO
FASHIONED
TURTLE
PEA