Human Generated Data

Title

Untitled (waitress serving soup to couple at Heinz Company restaurant)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10537
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress serving soup to couple at Heinz Company restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10537

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.8
Human 99.8
Person 99.5
Person 99.4
Restaurant 99.2
Cafe 92.1
Person 89.5
Cafeteria 88
Food 79.9
Meal 79.9
Interior Design 77.8
Indoors 77.8
Food Court 70
Sitting 57.5
Room 55.6
Person 48.2

Clarifai
created on 2023-10-26

people 99.9
adult 98.7
woman 98.3
sit 97.3
monochrome 97
child 96.8
man 96.7
group 96.4
group together 95.9
two 94.5
furniture 93.1
several 92.4
three 90.8
four 89.6
street 89.4
recreation 89.1
indoors 85.5
many 83.4
administration 82
five 80.5

Imagga
created on 2022-01-09

shop 48.9
barbershop 41.5
mercantile establishment 36.4
room 29.1
interior 27.4
place of business 25
modern 24.5
chair 22.8
table 22.2
man 22.2
office 20.8
restaurant 18.6
people 18.4
furniture 17.6
business 17.6
home 17.5
indoor 17.3
salon 17
house 16.7
indoors 16.7
counter 16.5
center 16
building 15.8
design 14.1
architecture 14.1
floor 13.9
inside 13.8
male 13.5
person 13.3
lamp 13.3
wood 13.3
decor 13.3
desk 13
luxury 12.9
light 12.7
establishment 12.5
lifestyle 12.3
computer 12
glass 11.7
structure 11.4
adult 11.1
relaxation 10.9
class 10.6
businessman 10.6
window 10.5
education 10.4
women 10.3
work 10.2
nobody 10.1
bakery 9.9
apartment 9.6
sofa 9.6
living 9.5
color 9.4
empty 9.4
smiling 9.4
happy 9.4
classroom 9.4
equipment 9.3
relax 9.3
smile 9.3
kitchen 9.1
group 8.9
urban 8.7
decoration 8.7
comfortable 8.6
corporate 8.6
men 8.6
wall 8.5
blackboard 8.5
travel 8.4
portrait 8.4
communication 8.4
city 8.3
teacher 8.2
board 8.1
school 8.1
success 8
job 8
3d 7.7
sitting 7.7
employee 7.7
mirror 7.6
finance 7.6
elegance 7.6
horizontal 7.5
style 7.4
laptop 7.4
bar 7.4
financial 7.1
day 7.1

Google
created on 2022-01-09

Black-and-white 83.2
Font 75.5
Monochrome photography 72.9
Monochrome 71.3
Event 69.5
Room 68.2
History 67.2
Stock photography 63.5
Vintage clothing 62.4
Illustration 59.9
Chair 58.4
Art 55.7
Photo caption 55.5
Photographic paper 55.4
Suit 53.5
Cooking 52.9
Job 52.8
Advertising 50.4

Microsoft
created on 2022-01-09

text 99.9
person 94.9
indoor 93
clothing 91.7
black and white 86.4
man 81.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 88.4%
Calm 91.6%
Happy 6.2%
Surprised 1.2%
Disgusted 0.3%
Confused 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 97.9%
Calm 78.3%
Sad 5.9%
Confused 4.9%
Disgusted 3.5%
Happy 3.3%
Surprised 3%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 23-31
Gender Male, 59.9%
Fear 46.3%
Sad 26.7%
Calm 9.7%
Happy 4.7%
Disgusted 4.3%
Confused 3.7%
Surprised 3.2%
Angry 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Text analysis

Amazon

FREE
Fruit
Chocolate
SHAKE
ORANGE
MILK
ICE
ICE CREAM
ORANGE LIM
CREAM
MALTED
LIM
10
made
HEINZ
made with
with
119358
Nelsons
JUICE
ONION
-
esh Fruit
mode
CHICKEN
mode with ACE CREAM
SOLPS
/
esh
199358
- a
V.
a
ACE
TONTLE
DISTER
KING
BOOTH

Google

19358
JUCE
ORANGE
O
MALTED
MILK
Nolsons
SHAKE
made
uvth
Fruit
ICE
dale
CAN
HEINE
OPS
U9358
-----
19358 Chocolate ORANGE JUCE ORANGE LIM O FREE MALTED MILK Nolsons SHAKE O made uvth resh Fruit ICE CREAM dale th AE CAN HEINE OPS U9358 -----
Chocolate
LIM
FREE
resh
CREAM
th
AE