Human Generated Data

Title

Untitled (waitress serving woman sitting at counter)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4901

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress serving woman sitting at counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.8
Person 99.5
Person 98.9
Restaurant 89.8
Building 82.7
Cafeteria 76.6
Lab 75.9
Apparel 74.9
Clothing 74.9
Shop 71.7
Factory 70.1
Cafe 66.5
Meal 63.7
Food 63.7
Worker 63.7
Person 61.9
Workshop 56.6

Imagga
created on 2022-01-23

shop 74.3
barbershop 68.7
mercantile establishment 51.2
restaurant 34.3
place of business 34
man 28.9
people 27.3
building 21.2
counter 20.4
male 18.4
person 18.2
indoors 17.6
happy 17.5
establishment 16.9
adult 15.7
smiling 15.2
work 14.9
business 14
occupation 13.7
men 13.7
structure 13.2
lifestyle 13
bartender 12.2
sitting 12
technology 11.1
horizontal 10.9
office 10.8
working 10.6
professional 10.4
salon 10.1
modern 9.8
couple 9.6
women 9.5
teamwork 9.3
city 9.1
old 9
worker 9
job 8.8
interior 8.8
medical 8.8
looking 8.8
table 8.8
room 8.7
light 8.7
love 8.7
casual 8.5
black 8.4
clinic 8.2
cheerful 8.1
team 8.1
computer 8
patient 8
smile 7.8
architecture 7.8
education 7.8
portrait 7.8
chemistry 7.7
pretty 7.7
attractive 7.7
fashion 7.5
doctor 7.5
holding 7.4
inside 7.4
equipment 7.4
group 7.2
student 7.2
color 7.2
night 7.1
to 7.1
businessman 7.1
happiness 7
medicine 7

Google
created on 2022-01-23

Shirt 94
Black-and-white 85.4
Style 83.9
T-shirt 78.9
Customer 74.7
Snapshot 74.3
Monochrome photography 74.2
Monochrome 73.9
Retail 71.1
Room 67.4
Cooking 66.5
Shelf 65.9
Machine 65.5
Service 65.2
Selling 60.1
Factory 58.9
Job 58.7
Eyewear 56.3
Street 55.5
Font 52.9

Microsoft
created on 2022-01-23

text 99.9
clothing 95.2
person 95
man 91.6
outdoor 85.6
bottle 81.5
standing 76.1
soft drink 66.9
newspaper 65
store 45.5
posing 42.2

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 73.9%
Calm 75.7%
Happy 16.4%
Sad 2.2%
Surprised 2%
Confused 1.3%
Disgusted 0.9%
Angry 0.8%
Fear 0.8%

AWS Rekognition

Age 40-48
Gender Male, 83.3%
Sad 75%
Confused 15.3%
Happy 3.7%
Calm 2.8%
Disgusted 1.3%
Surprised 0.7%
Fear 0.6%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a man standing in front of a store 84.8%
a man that is standing in front of a store 77%
a man and a woman standing in front of a store 57.5%

Text analysis

Amazon

25
Pineapple
Pecan
Sundae
18143
Juice
Chocolate
SOUPS
10
HEINZ
Chilled
CREAM
PEACH
SHARPLESS
Coca-Cola
NESTLE:
in CREAM
NESTLES NESTLE:
NESTLES
VEGETABLE
PECAN
CHERRY
-
OF
U
in
BOWLASA
110
OF FIA
CHEAR
FIA
COSTABLE

Google

1814: Coca-Cola 10 Chocolute Pecan Sundae 25 Chilled Pmeapple O Juice HEINZ SOUPS NESLE 18143, 18143
Coca-Cola
Pmeapple
SOUPS
Pecan
Juice
HEINZ
18143,
1814:
Chocolute
Sundae
Chilled
NESLE
18143
10
25
O