Human Generated Data

Title

Untitled (two couples having Campbell's soup at formal dinner party/soup being served by maid)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5282
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two couples having Campbell's soup at formal dinner party/soup being served by maid)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.5
Human 99.5
Person 99.4
Person 99.2
Person 98.9
Accessory 98
Accessories 98
Tie 98
Tablecloth 95.1
Food 93.8
Meal 93.8
People 92.7
Furniture 88.2
Table 88.2
Dining Table 88.2
Clothing 85.4
Apparel 85.4
Face 81.7
Dish 80.8
Photo 72.4
Portrait 72.4
Photography 72.4
Sleeve 70.6
Dining Room 65.3
Room 65.3
Indoors 65.3
Chair 63.5
Long Sleeve 60.5
Home Decor 60.3
Crowd 60.3
Linen 60.3
Supper 59.6
Dinner 59.6
Family 57.7
Senior Citizen 55.6

Imagga
created on 2022-01-22

man 39.7
male 35.5
people 31.8
sitting 30.9
couple 29.6
smiling 28.2
senior 28.1
person 28
adult 27.4
indoors 27.2
home 27.1
table 25.4
happy 25.1
together 24.5
meeting 24.5
women 23.7
men 23.2
businessman 23
kin 22.7
colleagues 22.3
business 21.9
talking 21.9
room 20.9
grandfather 18.9
mature 18.6
businesswoman 18.2
businesspeople 18
executive 17.8
40s 17.5
cheerful 17.1
office 17
30s 16.4
team 16.1
lifestyle 15.9
drink 15.9
meal 15.4
group 15.3
enjoying 15.2
worker 14.9
day 14.9
20s 14.7
teamwork 13.9
portrait 13.6
friends 13.2
food 13.1
grandma 12.9
patient 12.7
eating 12.6
mid adult 12.5
elderly 12.4
holding 12.4
smile 12.1
restaurant 12
laptop 11.9
modern 11.9
dinner 11.9
four people 11.8
professional 11.8
casual clothing 11.7
two people 11.7
working 11.5
drinking 11.5
desk 11.3
work 11.3
nurse 11
casual 11
happiness 11
coworkers 10.8
family 10.7
having 10.7
computer 10.5
adults 10.4
corporate 10.3
camera 10.2
wine 10.2
waiter 9.9
associates 9.8
discussing 9.8
to 9.7
discussion 9.7
retired 9.7
four 9.6
hospital 9.5
color 9.5
indoor 9.1
lunch 9.1
old 9.1
suit 9
mother 8.9
job 8.8
interior 8.8
medical 8.8
looking 8.8
conference 8.8
60s 8.8
middle aged 8.8
older 8.7
teacher 8.7
retirement 8.6
daughter 8.6
husband 8.6
ethnic 8.6
friendship 8.4
communication 8.4
presentation 8.4
life 8.1
kitchen 8
clothing 7.9
senior adult 7.9
70s 7.9
bright 7.9
chatting 7.8
employee 7.8
50s 7.8
groom 7.7
daytime 7.7
chair 7.7
twenties 7.6
two 7.6
doctor 7.5
relaxed 7.5
manager 7.5
inside 7.4
relaxing 7.3
handsome 7.1
face 7.1

Google
created on 2022-01-22

Shirt 94
Coat 92.8
Table 86.1
Black-and-white 85
Suit 84.4
Chair 83.8
Style 83.8
Hat 80.8
Adaptation 79.3
Plant 74.7
Monochrome 74.7
Vintage clothing 73.5
Window 73.3
Monochrome photography 72.7
Event 72.4
Room 67.3
History 66.5
Art 64.4
Stock photography 64.1
Conversation 62.5

Microsoft
created on 2022-01-22

person 99.5
window 98.9
clothing 96.6
text 96
man 95.8
indoor 87.8
human face 64.5
table 53.2
old 47.4

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 51.5%
Calm 82.2%
Sad 11.9%
Surprised 3.8%
Angry 0.7%
Disgusted 0.6%
Confused 0.4%
Happy 0.3%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Female, 89.7%
Happy 94.7%
Calm 1.9%
Sad 1.1%
Confused 0.7%
Disgusted 0.6%
Surprised 0.4%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Female, 96.4%
Calm 98.4%
Happy 0.6%
Surprised 0.5%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 98%
Chair 63.5%

Captions

Microsoft

a group of people standing in front of a window 87.9%
a group of people standing around a table 87.8%
a group of people sitting at a table 87.7%

Text analysis

Amazon

OCKENDER
2PPC
OCKENDER UVCL
UVCL