Human Generated Data

Title

Untitled (men and women eating breakfast in restaurant)
Date

1947
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7343
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women eating breakfast in restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Chair 99.9
Furniture 99.9
Person 99
Human 99
Restaurant 98.6
Person 98.5
Person 98.5
Person 97.8
Person 95.5
Cafeteria 92.9
Person 92
Person 73.6
Person 72.1
Person 71.8
Room 68.7
Indoors 68.7
Table 63.7
Meal 60.3
Food 60.3
Dining Table 58.2
Cafe 57.7
Workshop 57.7
People 56.6
Food Court 55.9

Imagga
created on 2022-01-15

restaurant 92.9
cafeteria 84.2
building 59.7
structure 38.6
table 37.4
room 32.1
chair 31.9
office 22.2
interior 22.1
people 20.1
meeting 19.8
hall 18.9
business 17.6
man 16.8
modern 16.1
group 16.1
dinner 16
indoors 15.8
tables 15.7
male 15.6
businessman 15
work 14.9
classroom 14.3
chairs 13.7
team 13.4
drink 13.4
bar 12.9
men 12.9
businesswoman 12.7
conference 12.7
lunch 12.5
glass 12.4
person 12.4
food 12.1
manager 12.1
teamwork 12
empty 12
corporate 12
furniture 11.9
happy 11.9
women 11.9
laptop 11.8
wood 11.7
desk 11.5
dining 11.4
together 11.4
meal 11.4
success 11.3
seat 11.2
event 11.1
design 10.7
job 10.6
executive 10.3
presentation 10.2
center 10.2
coffee 10.2
library 10.1
eat 10.1
house 10
setting 9.6
lifestyle 9.4
worker 9.4
floor 9.3
wine 9.2
inside 9.2
suit 9
stool 8.9
stall 8.8
decor 8.8
catering 8.8
couple 8.7
wagon 8.7
education 8.7
party 8.6
hotel 8.6
architecture 8.6
sitting 8.6
luxury 8.6
ethnic 8.6
talking 8.6
nobody 8.5
place 8.4
service 8.3
outdoors 8.2
home 8
working 7.9
scene 7.8
space 7.8
leader 7.7
boss 7.6
plan 7.6
banquet 7.5
adult 7.4
style 7.4
counter 7.4
water 7.3
successful 7.3
indoor 7.3
new 7.3
smiling 7.2
shop 7.2
computer 7.2

Google
created on 2022-01-15

Furniture 93.7
Table 89.7
Chair 85.9
Black-and-white 84.6
Style 83.9
Monochrome photography 72.7
Event 72.5
Monochrome 72.1
Font 71.3
Shade 68.3
Suit 67.8
Sitting 65.6
Room 64.6
Cafeteria 58.5
Coffee table 51.6
Recreation 51.5
Metal 51.2
Job 50.5

Microsoft
created on 2022-01-15

text 99.8
table 93.8
window 89.4
clothing 89.1
person 88.5
man 75
several 14.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Female, 97.4%
Calm 99.2%
Sad 0.5%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 50.8%
Happy 64.8%
Calm 24.7%
Surprised 7%
Confused 1.9%
Disgusted 0.7%
Angry 0.3%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Female, 60.8%
Calm 87%
Happy 11.6%
Sad 0.4%
Disgusted 0.3%
Fear 0.2%
Confused 0.2%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 40-48
Gender Female, 76.5%
Happy 97.8%
Calm 1%
Surprised 0.3%
Sad 0.2%
Fear 0.2%
Angry 0.2%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 52-60
Gender Female, 61.2%
Calm 98.3%
Happy 0.6%
Sad 0.6%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.9%
Person 99%

Captions

Microsoft

a group of people standing next to a window 61.7%
a group of people standing in front of a window 60.7%
a group of people sitting at a table in front of a window 51.3%

Text analysis

Amazon

SIESTA
LIARS
J.
23247
SARASOTA,
Relax
LIARS LOUNGE
the
Relax at the
LOUNGE
at
BAR
ON
KEY,
The
STEINMETZ,
SHORTEST
DRINK
J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLAS
-
WORLDS SHORTEST
Preparations
WORLDS
18
IO
Behald The Ficherman
FLAS
1
Behald
SERVING RE LONGEST DRINK
in - - Early -
Mighta Are lle Preparations
LONGEST
Ficherman
SERVING RE
Mighta
.
LITEZ
Early
YТOX
in
Are lle
مصرية
looks

Google

The
at
the
Mts
ke
rpt
LIARS
WN
SENOT
Behald The fahurman Pelax at the UORLDS SHORTEST BAR Mts ke rpt LIARS LOUNGE WN SENOT N 23247 J. J. STEINMETZ, SIESTA KEY, SARASOTA,FLA: KODVK-VEEA
Behald
fahurman
Pelax
UORLDS
SHORTEST
BAR
LOUNGE
N
23247
J.
STEINMETZ,
SIESTA
KEY,
SARASOTA,FLA:
KODVK-VEEA