Human Generated Data

Title

Untitled (two couples having Campbell's soup at formal dinner party/soup being served by maid)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5283
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two couples having Campbell's soup at formal dinner party/soup being served by maid)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 99.5
Person 99.3
Person 99
Food 97.9
Meal 97.9
Furniture 94
People 92.9
Person 90.8
Dinner 89.3
Supper 89.3
Dish 89.2
Room 84.4
Indoors 84.4
Table 84.1
Dining Table 84.1
Chair 83.1
Restaurant 78.3
Dining Room 77
Family 67.7
Photography 63.4
Face 63.4
Photo 63.4
Portrait 63.4

Imagga
created on 2022-01-22

barbershop 83
shop 66.6
mercantile establishment 50.6
man 43
people 39.6
male 36.2
person 33.9
place of business 33.7
nurse 30.6
adult 28.3
indoors 26.4
working 24.8
patient 24.6
businessman 23.8
professional 23.7
hospital 23.4
men 23.2
office 22.6
sitting 22.3
business 21.3
medical 21.2
smiling 21
room 20.9
team 19.7
happy 18.8
hairdresser 18.5
women 18.2
businesswoman 18.2
businesspeople 18
doctor 17.9
home 17.6
table 17.3
work 17.3
talking 17.1
meeting 17
establishment 16.8
colleagues 16.5
computer 16
worker 15.7
cheerful 15.4
portrait 14.9
group 14.5
coat 14
teamwork 13.9
occupation 13.8
indoor 13.7
interior 13.3
desk 13.2
couple 13.1
smile 12.8
health 12.5
medicine 12.3
together 12.3
senior 12.2
lab 11.7
laboratory 11.6
holding 11.6
two 11
happiness 11
laptop 10.9
clinic 10.9
lifestyle 10.8
face 10.7
lab coat 10.6
salon 10.5
mature 10.2
casual 10.2
20s 10.1
suit 9.9
job 9.7
two people 9.7
technology 9.7
looking 9.6
four 9.6
corporate 9.5
day 9.4
specialist 9.3
communication 9.2
hand 9.1
care 9.1
color 8.9
restaurant 8.9
scientist 8.8
discussion 8.8
middle aged 8.8
mid adult 8.7
education 8.7
30s 8.7
chair 8.7
profession 8.6
keyboard 8.5
student 8.4
attractive 8.4
old 8.4
family 8
associates 7.9
coworkers 7.9
40s 7.8
check 7.7
chemical 7.7
using 7.7
illness 7.6
research 7.6
biology 7.6
horizontal 7.5
camera 7.4
executive 7.4
inside 7.4
confident 7.3
life 7.2
to 7.1
pretty 7

Google
created on 2022-01-22

Black 89.5
Coat 87.8
Chair 86.2
Black-and-white 84.2
Style 83.8
Table 80.9
Monochrome 78.7
Monochrome photography 78
Classic 74.4
Vintage clothing 74.2
Suit 73.6
Room 71.3
Serveware 69.9
Event 68.5
History 66.3
Art 66
Cooking 65.1
Stock photography 64.8
Sitting 63.7
Tableware 63.5

Microsoft
created on 2022-01-22

text 97.9
person 95.4
table 94.1
clothing 91.1
man 81.4
furniture 75.1
house 63.9
woman 59.1
clock 54.6

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 91.1%
Calm 99%
Sad 0.3%
Surprised 0.3%
Happy 0.2%
Angry 0.1%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Female, 99.3%
Happy 92.7%
Calm 6%
Sad 0.8%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Female, 63.2%
Sad 79.8%
Calm 9.4%
Happy 4.8%
Confused 2.4%
Surprised 1.2%
Angry 1%
Disgusted 0.8%
Fear 0.5%

AWS Rekognition

Age 34-42
Gender Female, 66.6%
Happy 99%
Surprised 0.4%
Calm 0.3%
Sad 0.2%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Female, 81.4%
Calm 93.2%
Sad 3.4%
Fear 1.4%
Surprised 0.6%
Angry 0.5%
Confused 0.4%
Happy 0.3%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Chair 83.1%

Captions

Microsoft

a group of people sitting at a table 76.1%
a group of people sitting around a table 75.2%
a group of people sitting on a table 64.2%

Text analysis

Amazon

693
5 693
5
ELA
DELEMICS ELA 2020
2020
DELEMICS

Google

5693
5693