Human Generated Data

Title

Untitled (waitress serving woman sitting at counter)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4901
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress serving woman sitting at counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4901

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.8
Person 99.5
Person 98.9
Restaurant 89.8
Building 82.7
Cafeteria 76.6
Lab 75.9
Clothing 74.9
Apparel 74.9
Shop 71.7
Factory 70.1
Cafe 66.5
Meal 63.7
Food 63.7
Worker 63.7
Person 61.9
Workshop 56.6

Clarifai
created on 2023-10-26

people 99.8
monochrome 99.7
adult 99
woman 96.2
man 96
coverage 90.3
group together 89.3
group 89.2
many 83.9
indoors 82.4
newspaper 82.2
stock 80.4
administration 80.2
several 79.8
commerce 79.2
street 79
two 78.6
department store 75.5
child 73.9
transportation system 70.9

Imagga
created on 2022-01-23

shop 74.3
barbershop 68.7
mercantile establishment 51.2
restaurant 34.3
place of business 34
man 28.9
people 27.3
building 21.2
counter 20.4
male 18.4
person 18.2
indoors 17.6
happy 17.5
establishment 16.9
adult 15.7
smiling 15.2
work 14.9
business 14
occupation 13.7
men 13.7
structure 13.2
lifestyle 13
bartender 12.2
sitting 12
technology 11.1
horizontal 10.9
office 10.8
working 10.6
professional 10.4
salon 10.1
modern 9.8
couple 9.6
women 9.5
teamwork 9.3
city 9.1
old 9
worker 9
job 8.8
interior 8.8
medical 8.8
looking 8.8
table 8.8
room 8.7
light 8.7
love 8.7
casual 8.5
black 8.4
clinic 8.2
cheerful 8.1
team 8.1
computer 8
patient 8
smile 7.8
architecture 7.8
education 7.8
portrait 7.8
chemistry 7.7
pretty 7.7
attractive 7.7
fashion 7.5
doctor 7.5
holding 7.4
inside 7.4
equipment 7.4
group 7.2
student 7.2
color 7.2
night 7.1
to 7.1
businessman 7.1
happiness 7
medicine 7

Google
created on 2022-01-23

Shirt 94
Black-and-white 85.4
Style 83.9
T-shirt 78.9
Customer 74.7
Snapshot 74.3
Monochrome photography 74.2
Monochrome 73.9
Retail 71.1
Room 67.4
Cooking 66.5
Shelf 65.9
Machine 65.5
Service 65.2
Selling 60.1
Factory 58.9
Job 58.7
Eyewear 56.3
Street 55.5
Font 52.9

Microsoft
created on 2022-01-23

text 99.9
clothing 95.2
person 95
man 91.6
outdoor 85.6
bottle 81.5
standing 76.1
soft drink 66.9
newspaper 65
store 45.5
posing 42.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 73.9%
Calm 75.7%
Happy 16.4%
Sad 2.2%
Surprised 2%
Confused 1.3%
Disgusted 0.9%
Angry 0.8%
Fear 0.8%

AWS Rekognition

Age 40-48
Gender Male, 83.3%
Sad 75%
Confused 15.3%
Happy 3.7%
Calm 2.8%
Disgusted 1.3%
Surprised 0.7%
Fear 0.6%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Categories

Imagga

paintings art 82.8%
interior objects 12.7%
text visuals 2.3%
people portraits 1.3%

Text analysis

Amazon

25
Pineapple
Pecan
Sundae
18143
Juice
Chocolate
SOUPS
10
HEINZ
Chilled
CREAM
PEACH
SHARPLESS
Coca-Cola
NESTLE:
in CREAM
NESTLES NESTLE:
NESTLES
VEGETABLE
PECAN
CHERRY
-
OF
U
in
BOWLASA
110
OF FIA
CHEAR
FIA
COSTABLE

Google

1814: Coca-Cola 10 Chocolute Pecan Sundae 25 Chilled Pmeapple O Juice HEINZ SOUPS NESLE 18143, 18143
1814:
Coca-Cola
10
Chocolute
Pecan
Sundae
25
Chilled
Pmeapple
O
Juice
HEINZ
SOUPS
NESLE
18143,
18143