Human Generated Data

Title

Untitled (Liddon Pennock seating Alice Pennock for lunch in dining room, maid in background)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5301
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Liddon Pennock seating Alice Pennock for lunch in dining room, maid in background)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.5
Human 99.5
Chair 99.4
Furniture 99.4
Person 97.9
Person 97.5
Clothing 79.1
Apparel 79.1
Blossom 70.7
Plant 70.7
Flower 70.7
Helmet 70.2
Portrait 59.5
Photography 59.5
Face 59.5
Photo 59.5
Priest 58.6

Imagga
created on 2022-01-22

lab coat 39.2
barbershop 38
man 37
coat 36.2
people 35.7
shop 34.1
person 32.7
male 30.5
couple 27
professional 26.3
mercantile establishment 25.5
adult 24
smiling 21
happy 20.1
worker 19.2
medical 18.5
doctor 17.9
two 17.8
business 17.6
indoors 17.6
clothing 17.1
smile 17.1
place of business 17
office 16.9
work 16.5
happiness 16.5
men 16.3
garment 16.2
clinic 15.6
colleagues 15.5
lifestyle 15.2
home 15.2
casual 14.4
portrait 14.2
women 14.2
job 14.2
businessman 14.1
day 14.1
senior 14.1
life 13.9
hospital 13.2
mature 13
cheerful 13
group 12.9
sitting 12.9
nurse 12.7
attractive 12.6
team 12.5
health 12.5
bride 12.5
desk 12.3
waiter 12.3
patient 12.2
corporate 12
occupation 11.9
associates 11.8
working 11.5
together 11.4
businesspeople 11.4
computer 11.2
love 11
room 11
teacher 10.9
groom 10.8
laboratory 10.6
medicine 10.6
elderly 10.5
old 10.5
adults 10.4
employee 10.4
black 10.2
indoor 10
color 10
coworkers 9.8
lab 9.7
mid adult 9.7
30s 9.6
seller 9.6
bright 9.3
teamwork 9.3
face 9.2
wedding 9.2
modern 9.1
businesswoman 9.1
care 9.1
dining-room attendant 9
human 9
family 8.9
interior 8.8
ceremony 8.7
bouquet 8.7
busy 8.7
establishment 8.5
meeting 8.5
camera 8.3
science 8
student 7.9
scientist 7.8
hands 7.8
businessmen 7.8
loving 7.6
uniform 7.6
talking 7.6
wife 7.6
career 7.6
horizontal 7.5
holding 7.4
technology 7.4
focus 7.4
treatment 7.4
20s 7.3
salon 7.3
executive 7.3
hairdresser 7.3
dress 7.2
suit 7.2
looking 7.2

Google
created on 2022-01-22

Black 89.7
Plant 88.4
Hat 87.2
Black-and-white 86.1
Style 84
Monochrome photography 76.6
Monochrome 76.6
Door 76.5
Cooking 72.6
Event 70.8
Vintage clothing 70.1
Room 69.8
Chair 65.9
Service 64.1
Houseplant 63.2
Uniform 62.3
Illustration 55
History 53.5
Photography 51.8
Still life photography 50.7

Microsoft
created on 2022-01-22

text 98.6
person 92.4
clothing 92.2
funeral 84
candle 82.6
wedding dress 78.3
woman 72.6
white 71.1
flower 62.4
bride 54.4
posing 52.7
old 49.1

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Female, 84.4%
Calm 99.4%
Sad 0.6%
Angry 0%
Happy 0%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 98.1%
Calm 89.1%
Surprised 7.1%
Sad 1.8%
Happy 0.8%
Confused 0.6%
Disgusted 0.4%
Angry 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 99.4%
Helmet 70.2%

Captions

Microsoft

a person standing in front of a building 79.7%
an old photo of a person 79.6%
a man and a woman standing in front of a building 62.4%

Text analysis

Amazon

5911

Google

5911
5911