Human Generated Data

Title

Untitled (waitress serving soup to couple at Heinz Company restaurant)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10537

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress serving soup to couple at Heinz Company restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.8
Human 99.8
Person 99.5
Person 99.4
Restaurant 99.2
Cafe 92.1
Person 89.5
Cafeteria 88
Meal 79.9
Food 79.9
Interior Design 77.8
Indoors 77.8
Food Court 70
Sitting 57.5
Room 55.6
Person 48.2

Imagga
created on 2022-01-09

shop 48.9
barbershop 41.5
mercantile establishment 36.4
room 29.1
interior 27.4
place of business 25
modern 24.5
chair 22.8
table 22.2
man 22.2
office 20.8
restaurant 18.6
people 18.4
furniture 17.6
business 17.6
home 17.5
indoor 17.3
salon 17
house 16.7
indoors 16.7
counter 16.5
center 16
building 15.8
design 14.1
architecture 14.1
floor 13.9
inside 13.8
male 13.5
person 13.3
lamp 13.3
wood 13.3
decor 13.3
desk 13
luxury 12.9
light 12.7
establishment 12.5
lifestyle 12.3
computer 12
glass 11.7
structure 11.4
adult 11.1
relaxation 10.9
class 10.6
businessman 10.6
window 10.5
education 10.4
women 10.3
work 10.2
nobody 10.1
bakery 9.9
apartment 9.6
sofa 9.6
living 9.5
color 9.4
empty 9.4
smiling 9.4
happy 9.4
classroom 9.4
equipment 9.3
relax 9.3
smile 9.3
kitchen 9.1
group 8.9
urban 8.7
decoration 8.7
comfortable 8.6
corporate 8.6
men 8.6
wall 8.5
blackboard 8.5
travel 8.4
portrait 8.4
communication 8.4
city 8.3
teacher 8.2
board 8.1
school 8.1
success 8
job 8
3d 7.7
sitting 7.7
employee 7.7
mirror 7.6
finance 7.6
elegance 7.6
horizontal 7.5
style 7.4
laptop 7.4
bar 7.4
financial 7.1
day 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 99.9
person 94.9
indoor 93
clothing 91.7
black and white 86.4
man 81.6

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 88.4%
Calm 91.6%
Happy 6.2%
Surprised 1.2%
Disgusted 0.3%
Confused 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 97.9%
Calm 78.3%
Sad 5.9%
Confused 4.9%
Disgusted 3.5%
Happy 3.3%
Surprised 3%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 23-31
Gender Male, 59.9%
Fear 46.3%
Sad 26.7%
Calm 9.7%
Happy 4.7%
Disgusted 4.3%
Confused 3.7%
Surprised 3.2%
Angry 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a person standing in front of a refrigerator 56.4%
a man and a woman standing in front of a refrigerator 30.8%
a person standing in front of a refrigerator 30.7%

Text analysis

Amazon

FREE
Fruit
Chocolate
SHAKE
ORANGE
MILK
ICE
ICE CREAM
ORANGE LIM
CREAM
MALTED
LIM
10
made
HEINZ
made with
with
119358
Nelsons
JUICE
ONION
-
esh Fruit
mode
CHICKEN
mode with ACE CREAM
SOLPS
/
esh
199358
- a
V.
a
ACE
TONTLE
DISTER
KING
BOOTH

Google

ORANGE
SHAKE
CREAM
dale
AE
HEINE
Chocolate
O
CAN
LIM
MALTED
resh
Fruit
OPS
FREE
uvth
U9358
-----
19358 Chocolate ORANGE JUCE ORANGE LIM O FREE MALTED MILK Nolsons SHAKE O made uvth resh Fruit ICE CREAM dale th AE CAN HEINE OPS U9358 -----
19358
JUCE
MILK
Nolsons
made
ICE
th