Human Generated Data

Title

Untitled (waitress holding Heinz products behind diner counter)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4890
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress holding Heinz products behind diner counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.8
Person 99.6
Person 99.6
Person 97.7
Person 88.7
Restaurant 84.6
Interior Design 84.5
Indoors 84.5
Chair 82.1
Furniture 82.1
Room 81.5
Shop 78.4
Bakery 71.7
Meal 71
Food 71
Workshop 67.9
Cafeteria 63.7
Cafe 58

Imagga
created on 2022-01-23

man 41
people 37.4
male 35.5
office 32.3
person 30.5
businessman 29.1
room 28.8
business 28.6
meeting 27.3
clinic 27.3
table 27
adult 26.7
professional 26.6
work 25.9
team 25.1
working 23.9
indoors 23.7
businesswoman 23.6
shop 23.6
men 23.2
group 22.6
happy 22.6
teamwork 21.3
computer 20.8
restaurant 20.7
colleagues 20.4
smiling 20.3
desk 20.1
businesspeople 19
sitting 18.9
job 18.6
salon 18.2
women 18.2
hospital 16.9
worker 16.7
occupation 16.5
patient 16.3
counter 16.2
nurse 16.2
smile 15.7
corporate 15.5
suit 15.3
executive 15
mercantile establishment 14.8
casual 14.4
communication 14.3
interior 14.2
together 14
education 13.9
lifestyle 13.7
laptop 13.7
40s 13.6
discussion 13.6
classroom 13.6
modern 13.3
talking 13.3
medical 13.2
cheerful 13
portrait 12.9
indoor 12.8
doctor 12.2
couple 12.2
manager 12.1
mature 12.1
technology 11.9
conference 11.7
success 11.3
chair 11.2
barbershop 11.2
day 11
hall 10.6
four 10.5
home 10.4
employee 10.1
20s 10.1
color 10
place of business 9.8
mid adult 9.6
adults 9.5
presentation 9.3
horizontal 9.2
building 9.1
health 9
discussing 8.8
teacher 8.8
30s 8.7
senior 8.4
attractive 8.4
board 8.1
light 8
looking 8
coworkers 7.9
workers 7.8
bakery 7.7
life 7.7
ethnic 7.6
inside 7.4
equipment 7.4
waiter 7.2
to 7.1
medicine 7

Google
created on 2022-01-23

Outerwear 95.1
Shirt 94.9
Photograph 94.3
Black 89.7
Black-and-white 84.9
Style 83.8
T-shirt 79
Font 77.6
Monochrome photography 75.4
Snapshot 74.3
Monochrome 74.1
Cooking 73
Art 72.2
Service 71.2
Chair 70.3
Table 69.7
Machine 68
Job 67.8
Room 64.6
Stock photography 64.4

Microsoft
created on 2022-01-23

text 99.6
indoor 98.4
person 95.2
kitchen 94.9
clothing 91.5
fast food 73.6
food 70
table 67.8
woman 58.7
black and white 53.4
preparing 42

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 98.1%
Calm 87.4%
Surprised 9.7%
Confused 0.9%
Angry 0.7%
Happy 0.6%
Disgusted 0.4%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 34-42
Gender Female, 89.1%
Happy 98.4%
Calm 1.4%
Surprised 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 50-58
Gender Female, 96.7%
Calm 98.1%
Happy 1%
Angry 0.3%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 94.1%
Calm 46.7%
Sad 21.1%
Confused 19.1%
Angry 4.4%
Surprised 3.7%
Happy 2.6%
Disgusted 1.5%
Fear 0.8%

AWS Rekognition

Age 30-40
Gender Female, 52%
Happy 87.4%
Calm 4.3%
Confused 2.7%
Sad 2.5%
Surprised 1%
Angry 0.9%
Disgusted 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 82.1%

Captions

Microsoft

a group of people standing in a kitchen 85.3%
a group of people in a kitchen 85.2%
a group of people standing in the kitchen 83.8%

Text analysis

Amazon

SOUPS
HEINZ
RELISH
RELISH COFFEE
COFFEE
BEANS
HEINZ BAKED BEANS
BAKED
FRANKFURTERS
CREAM
-
25c
H 16002 .
COUNTIY -
H16002
CENTINE CREAM TERTIE
ORSAN
COUNTIY
BOOKLE
CENTINE
MUSICA BOOKLE
CHUCHEN
BK
TERTIE
MUSICA
wowan

Google

HI6002. HEINZ SOUPS D FA A ate RAKED BEANS FRANKFURTERS RELISH COFFEE HT6002.
HI6002.
HEINZ
SOUPS
D
FA
A
ate
RAKED
BEANS
FRANKFURTERS
RELISH
COFFEE
HT6002.