Human Generated Data

Title

Untitled (men and women eating breakfast in restaurant)
Date

1947
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7344
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women eating breakfast in restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Restaurant 99.8
Chair 99.1
Furniture 99.1
Human 99
Person 99
Person 98.9
Person 97.8
Person 97.7
Cafeteria 97
Person 95.3
Person 88.8
Person 88.7
Person 86.7
Food 73.7
Meal 73.7
Food Court 71.9
Helmet 70.1
Apparel 70.1
Clothing 70.1
Cafe 63.6
Person 62.6
Room 62.1
Indoors 62.1
Person 61.6
Dining Table 56.9
Table 56.9

Imagga
created on 2022-01-15

office 29.9
people 29.5
steel drum 27.7
room 27.6
business 27.3
man 26.2
table 24.3
percussion instrument 22.8
newspaper 22.5
restaurant 21.9
male 21.3
chair 20.9
wagon 19.7
businessman 18.5
musical instrument 18.3
work 18.1
men 17.2
person 16.9
adult 16.5
group 16.1
classroom 16.1
computer 16
product 15.9
wheeled vehicle 14.8
corporate 14.6
daily 14.2
interior 14.1
indoors 14
building 13.4
desk 13.4
businesswoman 12.7
creation 12.3
meeting 12.2
laptop 11.8
team 11.6
job 11.5
working 11.5
modern 11.2
sitting 11.2
cafeteria 11.1
casual 11
stall 10.6
success 10.5
outdoors 10.4
shop 10.2
bar 10.2
dinner 10.1
worker 10.1
indoor 10
happy 10
travel 9.8
urban 9.6
businesspeople 9.5
women 9.5
lifestyle 9.4
architecture 9.4
manager 9.3
teamwork 9.3
container 9.2
executive 9.2
horizontal 9.2
occupation 9.2
meal 8.9
smiling 8.7
day 8.6
industry 8.5
adults 8.5
city 8.3
inside 8.3
suit 8.1
looking 8
professional 7.8
education 7.8
clothing 7.8
dining 7.6
communication 7.6
hall 7.5
equipment 7.5
leisure 7.5
company 7.4
coffee 7.4
back 7.3
20s 7.3
board 7.2
employee 7.1
center 7

Google
created on 2022-01-15

Table 86.8
Chair 86
Black-and-white 83.1
Font 74.2
Suit 73.6
Monochrome photography 71.8
Event 71.4
Monochrome 69.7
Sitting 65.6
Room 63.4
Rectangle 61.1
Job 56.8
Shade 56.2
Cafeteria 56
Coffee table 54.6
Customer 53.2
History 51.7
Recreation 51.5
Photo caption 50.2
Metal 50

Microsoft
created on 2022-01-15

text 99.7
clothing 93
person 92
table 85.9
man 81
window 80
black and white 70.2
people 55.6
several 10.6

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 97.5%
Happy 95.8%
Sad 2.4%
Calm 0.8%
Surprised 0.4%
Angry 0.2%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Female, 99.2%
Calm 99.5%
Sad 0.2%
Happy 0.2%
Angry 0%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 76.3%
Calm 99.5%
Sad 0.3%
Happy 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 97.2%
Calm 82.6%
Happy 7.3%
Sad 3.2%
Disgusted 2.1%
Surprised 1.9%
Fear 1.1%
Angry 1%
Confused 0.9%

AWS Rekognition

Age 27-37
Gender Female, 97.4%
Calm 98.2%
Happy 0.7%
Sad 0.6%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.1%
Person 99%
Helmet 70.1%

Captions

Microsoft

a group of people standing in front of a window 68.1%
a group of people in front of a window 68%
a group of people sitting in front of a window 57.9%

Text analysis

Amazon

SIESTA
LOUNGE
LIARS LOUNGE
LIARS
KEY,
the
Relax
Relax at the
ON
at
BAR
STEINMETZ,
SHORTEST
SERVING
23247A.
LONGEST
J.J.
WORLDS SHORTEST
The
WORLDS
J.J. STEINMETZ, SIESTA KEY, SARASOTA, FLAS
SARASOTA,
18
Behold
&
1
SERVING & LONGEST TONA
FLAS
10
.
Behold The Foturnan
1 -
Preparation
-
the .
Mightly Archis Preparation
I
CIA
Mightly
Archis
TONA
Foturnan
intends

Google

-Behald
LONEST
SIESTA
FLA:
VLEU
at
ENGN
2324
23247 A. -Behald The Fahen Midls le elax at the BAR ENGN LONEST DOK LIARS LOUNGE 10 2324 7A.J.J. STEINMETZ, SIESTA KEY, SARASOTA, FLA: -- VLEU
23247
Fahen
Midls
KEY,
SARASOTA,
The
the
BAR
DOK
LIARS
STEINMETZ,
--
A.
le
elax
LOUNGE
10
7A.J.J.