Human Generated Data

Title

Untitled (dinner party, Pennsylvania)
Date

1937, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.261
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (dinner party, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 99
Person 98.9
Restaurant 98.6
Person 98.5
Person 97
Tie 96.8
Accessories 96.8
Accessory 96.8
Furniture 96.2
Meal 96
Food 96
Person 94.6
Clothing 94.5
Overcoat 94.5
Coat 94.5
Apparel 94.5
Suit 92.2
Table 78.4
Room 76
Indoors 76
Tie 72.6
Tie 71
Cafeteria 70.7
Pub 69.3
Dining Table 69.2
Reception 69.1
Tie 67
Tuxedo 65.8
Reception Room 63.3
Waiting Room 63.3
Bar Counter 61.2
People 60.8
Buffet 59.9
Dish 57.8
Waiter 56.9
Food Court 56

Imagga
created on 2022-01-08

groom 42.4
meeting 39.6
business 38.9
businessman 38.9
man 38.3
male 35.5
people 35.2
businesswoman 34.6
executive 33
office 32.4
waiter 31.5
happy 31.4
adult 28.9
team 28.7
person 28.5
group 28.2
table 27.7
businesspeople 27.5
men 27.5
together 27.2
couple 27
corporate 26.7
sitting 26.6
teamwork 26
smiling 23.9
worker 22.9
colleagues 22.4
suit 21.4
dining-room attendant 21.3
employee 21.2
work 21.2
dinner 19.6
professional 19.5
indoors 19.3
communication 19.3
restaurant 18.6
drink 16.7
conference 16.6
smile 16.4
success 16.1
working 15.9
lifestyle 15.9
wine 15.7
cheerful 15.5
manager 14.9
coworkers 14.7
discussion 14.6
30s 14.4
portrait 14.2
women 14.2
home 13.6
meal 13.4
talking 13.3
job 13.3
lunch 13.3
senior 13.1
company 13
baron 12.9
happiness 12.5
desk 12.3
alcohol 12
food 12
20s 11.9
holding 11.6
partnership 11.5
staff 11.5
presentation 11.2
mature 11.2
love 11.1
room 11
day 11
laptop 10.9
discussing 10.8
40s 10.7
corporation 10.6
boss 10.5
celebration 10.4
glass 10.1
successful 10.1
confident 10
associates 9.8
businessmen 9.8
workplace 9.5
archive 9.5
secretary 9.4
friendship 9.4
coffee 9.3
beverage 9.1
entrepreneur 9
kin 8.9
handsome 8.9
dining room 8.9
60s 8.8
conversation 8.8
busy 8.7
planning 8.7
four 8.6
drinking 8.6
daughter 8.6
formal 8.6
ethnic 8.6
adults 8.5
females 8.5
career 8.5
casual 8.5
friends 8.5
eating 8.4
attractive 8.4
hall 8.4
hand 8.4
indoor 8.2
building 8.1
romantic 8
family 8
elementary age 7.9
boardroom 7.9
businesswomen 7.9
standing 7.8
partners 7.8
having 7.8
cooperation 7.7
partner 7.7
mid adult 7.7
leader 7.7
modern 7.7
looking camera 7.7
enjoying 7.6
fun 7.5
friendly 7.3
new 7.3
aged 7.2
computer 7.2
looking 7.2
face 7.1
interior 7.1

Google
created on 2022-01-08

Picture frame 95.7
Table 95.6
Photograph 94.2
Coat 92.4
Tableware 91.1
Food 88.3
Chair 87.8
Interior design 85.4
Black-and-white 84.1
Suit 84
Style 83.9
Stemware 82.9
Tablecloth 81.9
Curtain 77.7
Wine glass 76.1
Classic 75.7
Formal wear 75.7
Event 74.7
Monochrome photography 73.8
Houseplant 71.8

Microsoft
created on 2022-01-08

person 99.8
standing 92.5
tableware 90.7
man 90.4
clothing 88.4
wine glass 84.5
table 83.9
candle 78.1
suit 75
wedding dress 66
text 63.7
wedding 62.3
wedding cake 61.3
posing 56
wine 54.7
woman 53.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Female, 59.5%
Happy 98.8%
Calm 0.3%
Fear 0.2%
Surprised 0.2%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 61.9%
Surprised 12.4%
Sad 8.2%
Disgusted 6.4%
Happy 4.3%
Confused 2.4%
Angry 2.3%
Fear 2.1%

AWS Rekognition

Age 33-41
Gender Female, 100%
Happy 98.3%
Surprised 0.4%
Fear 0.3%
Angry 0.3%
Confused 0.3%
Disgusted 0.2%
Calm 0.2%
Sad 0.1%

AWS Rekognition

Age 14-22
Gender Female, 100%
Sad 100%
Calm 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 43-51
Gender Female, 99.8%
Happy 98.2%
Angry 0.9%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%
Sad 0.1%
Calm 0.1%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 77.3%
Angry 15.3%
Sad 3.1%
Surprised 1.5%
Fear 0.9%
Confused 0.8%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 77.3%
Sad 11.7%
Disgusted 3.4%
Angry 2.8%
Confused 1.9%
Happy 1.1%
Surprised 1%
Fear 0.8%

AWS Rekognition

Age 43-51
Gender Female, 71%
Calm 99.9%
Surprised 0.1%
Sad 0%
Disgusted 0%
Fear 0%
Angry 0%
Happy 0%
Confused 0%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 96.8%
Suit 92.2%
Dining Table 69.2%

Captions

Microsoft

a person standing in front of a group of people posing for a photo 91%
a group of people standing in front of a window 90.9%
a group of people standing in front of a window posing for the camera 90.8%