Human Generated Data

Title

Untitled (Liddon Pennock seating Alice Pennock for lunch in dining room, maid in background)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5300
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Liddon Pennock seating Alice Pennock for lunch in dining room, maid in background)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.6
Human 99.6
Person 99
Person 98
Chair 97.1
Furniture 97.1
Clothing 91.6
Apparel 91.6
Meal 89.1
Food 89.1
Plant 86.3
Table 82.1
Flower 80.2
Blossom 80.2
Indoors 80.2
Room 79.3
Dining Table 75
Dish 73.6
People 73
Face 71.5
Flower Arrangement 68.2
Female 66.4
Home Decor 65.7
Portrait 65.3
Photography 65.3
Photo 65.3
Flower Bouquet 57.8
Restaurant 56.1
Chair 51.2

Imagga
created on 2022-01-22

man 36.3
person 35.8
people 31.2
male 31.2
lab coat 26.3
adult 26.2
coat 26
couple 24.4
nurse 21.4
shop 20.4
indoors 20.2
happy 20.1
barbershop 19.2
smiling 18.8
senior 18.7
business 18.2
sitting 18
casual 17.8
patient 17.4
day 17.3
men 17.2
medical 16.8
businessman 16.8
professional 16.7
colleagues 16.5
clothing 15.5
mercantile establishment 15.5
home 15.2
30s 14.4
waiter 14.4
happiness 14.1
doctor 14.1
worker 13.7
businesspeople 13.3
together 13.1
white 13.1
cheerful 13
smile 12.8
indoor 12.8
businesswoman 12.7
office 12.2
mature 12.1
clinic 11.9
20s 11.9
two 11.9
associates 11.8
life 11.7
employee 11.6
seller 11.6
mid adult 11.6
lifestyle 11.6
job 11.5
adults 11.4
old 11.2
color 11.1
health 11.1
room 11.1
women 11.1
portrait 11
coworkers 10.8
dining-room attendant 10.8
bright 10.7
face 10.7
hospital 10.5
group 10.5
garment 10.4
place of business 10.3
love 10.3
work 10.2
team 9.9
attractive 9.8
40s 9.7
working 9.7
elderly 9.6
talking 9.5
groom 9.1
computer 8.8
busy 8.7
bride 8.6
corporate 8.6
meeting 8.5
clothes 8.4
black 8.4
holding 8.3
occupation 8.2
care 8.2
suit 8.1
family 8
looking 8
forties 7.8
standing 7.8
businessmen 7.8
student 7.7
daytime 7.7
bouquet 7.7
husband 7.6
illness 7.6
wife 7.6
desk 7.6
case 7.5
horizontal 7.5
human 7.5
teamwork 7.4
camera 7.4
wedding 7.4
dress 7.2
medicine 7
fan 7

Google
created on 2022-01-22

Photograph 94.1
Black-and-white 85.8
Hat 85.1
Style 84
Door 83.1
Plant 80.1
Window 78.8
Cooking 77.4
Monochrome photography 75.9
Monochrome 75.6
Nurse 75.4
Health care provider 74.7
Snapshot 74.3
Vintage clothing 71.8
Room 69.3
Event 67.5
Service 67
Nurse uniform 66.7
Science 65
Illustration 57.3

Microsoft
created on 2022-01-22

text 99.4
person 92
clothing 90.1
outdoor 85.1
funeral 83.4
candle 65.3
flower 53.7

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Female, 53.4%
Surprised 82.8%
Happy 9.6%
Confused 2.3%
Fear 1.6%
Calm 1.5%
Disgusted 1.1%
Sad 0.8%
Angry 0.4%

AWS Rekognition

Age 21-29
Gender Male, 75.5%
Calm 61.1%
Sad 21.5%
Happy 11.7%
Disgusted 3.1%
Angry 0.8%
Surprised 0.7%
Confused 0.5%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Chair 97.1%

Captions

Microsoft

an old photo of a man 73.2%
a man standing in front of a building 61.3%
old photo of a man 61.2%

Text analysis

Amazon

5916
%
2016 %
2016

Google

5916
5916