Human Generated Data

Title

Untitled (two couples having Campbell's soup at formal dinner party/soup being served by maid)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5284
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two couples having Campbell's soup at formal dinner party/soup being served by maid)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.5
Person 99.5
Person 99.4
Person 99.2
Person 99.1
Person 98.8
People 93.2
Furniture 92.6
Chair 92.6
Room 80.8
Indoors 80.8
Dining Table 80.6
Table 80.6
Meal 80.5
Food 80.5
Family 74.7
Photo 67.9
Photography 67.9
Face 65.9
Portrait 65.9
Dining Room 65.8
Tablecloth 65.3
Dish 60.8
Linen 56.7
Home Decor 56.7

Imagga
created on 2022-01-22

man 43
male 35.5
people 35.1
adult 33.5
nurse 32.5
person 32
office 28.7
sitting 28.3
business 27.9
businessman 26.5
meeting 26.4
couple 26.1
table 25.5
men 24.9
colleagues 24.3
indoors 23.7
group 23.4
team 23.3
smiling 23.2
room 22.9
together 22.8
businesswoman 22.7
home 21.5
women 21.4
businesspeople 20.9
happy 20.7
professional 20
working 19.4
teamwork 18.5
computer 17.7
worker 17.7
senior 16.9
lifestyle 16.6
work 16.5
kin 16.3
smile 15.7
laptop 15.6
talking 15.2
mature 14.9
indoor 14.6
30s 14.4
casual 14.4
cheerful 13.8
executive 13.8
corporate 13.7
teacher 13.5
desk 13.5
patient 13.2
coworkers 12.8
life 12.5
adults 12.3
portrait 12.3
day 11.8
40s 11.7
mid adult 11.6
associates 10.8
dinner 10.8
classroom 10.7
job 10.6
four 10.5
hospital 10.5
technology 10.4
restaurant 10.3
happiness 10.2
two 10.2
20s 10.1
communication 10.1
drink 10
employee 9.8
collaboration 9.8
discussing 9.8
family 9.8
casual clothing 9.8
conference 9.8
workplace 9.5
color 9.5
friends 9.4
presentation 9.3
horizontal 9.2
successful 9.2
modern 9.1
holding 9.1
interior 8.8
discussion 8.8
two people 8.8
staff 8.7
daytime 8.7
busy 8.7
education 8.7
specialist 8.6
ethnic 8.6
face 8.5
mother 8.2
clothing 8.1
looking 8
boardroom 7.9
four people 7.9
explaining 7.9
bright 7.9
meal 7.8
cooperation 7.7
elderly 7.7
sofa 7.7
enjoying 7.6
females 7.6
career 7.6
house 7.5
clothes 7.5
friendship 7.5
company 7.4
care 7.4
new 7.3
confident 7.3
suit 7.2
father 7.2
educator 7.2
food 7.2
to 7.1
medical 7.1

Google
created on 2022-01-22

Photograph 94.2
Black 89.7
Black-and-white 84.5
Style 83.9
Chair 78.2
Monochrome 76.6
Monochrome photography 76.2
Vintage clothing 74.7
Table 74.4
Snapshot 74.3
Classic 71.3
Room 71.3
Event 67.9
Art 66
Illustration 65.1
History 63.7
Stock photography 63.7
Picture frame 63.4
Cooking 62.1
Sitting 60.7

Microsoft
created on 2022-01-22

text 98.9
person 98.6
table 95
indoor 85.7
clothing 82.7
people 78.4
man 77.7
furniture 68.4
old 63.7
house 52.5

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Female, 97.8%
Calm 98.7%
Happy 0.5%
Surprised 0.4%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0%
Angry 0%

AWS Rekognition

Age 39-47
Gender Female, 95.7%
Happy 92.4%
Calm 2.9%
Sad 1.8%
Surprised 1.1%
Angry 0.6%
Fear 0.5%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Female, 95.9%
Angry 51.1%
Happy 27%
Calm 11.9%
Surprised 4.4%
Fear 1.9%
Confused 1.5%
Sad 1.1%
Disgusted 1%

AWS Rekognition

Age 26-36
Gender Male, 81.6%
Calm 98.3%
Sad 0.6%
Surprised 0.4%
Angry 0.3%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 92.6%

Captions

Microsoft

a group of people sitting at a table 90.4%
an old photo of a group of people sitting at a table 90.3%
a group of people sitting around a table 90%

Text analysis

Amazon

703
5 703
5
ULLEHDLE

Google

5703
5703