Human Generated Data

Title

Untitled (group gathered around dinner table)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6923

Human Generated Data

Title

Untitled (group gathered around dinner table)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.8
Person 99.8
Chair 99.7
Furniture 99.7
Person 99.6
Person 99.5
Person 99.5
Person 99.3
Restaurant 98.2
Person 95.2
Bar Counter 91.9
Pub 91.9
Food 88.9
Meal 88.9
Table 88.4
Food Court 86.1
Dish 74.3
Alcohol 68.3
Beer 68.3
Beverage 68.3
Drink 68.3
Beer 65.3
Bottle 62.4
Dining Table 59.8
Cafeteria 59
Glass 58.8
Crowd 55.6
Dinner 55.6
Supper 55.6

Imagga
created on 2022-01-23

man 42.3
people 39.6
classroom 37.7
male 37.6
person 32.6
room 30.9
adult 29.8
group 25
meeting 24.5
business 24.3
happy 23.8
table 23.6
home 23.1
together 22.8
businesswoman 22.7
sitting 22.3
men 22.3
businessman 22.1
teacher 21.9
team 21.5
couple 20.9
smiling 20.2
indoors 19.3
30s 19.2
kin 18.4
talking 18.1
businesspeople 18
office 17.9
family 17.8
colleagues 17.5
working 16.8
student 16
smile 15.7
20s 15.6
casual 15.2
nurse 15.1
women 15
teamwork 14.8
40s 14.6
lifestyle 14.4
desk 14.4
child 14.2
education 13.8
cheerful 13.8
four 13.4
work 13.3
clothing 13.3
professional 12.9
discussing 12.8
discussion 12.7
drink 12.5
children 11.8
portrait 11.6
class 11.6
boy 11.3
friendship 11.2
mature 11.2
restaurant 11
dinner 11
grandfather 10.9
interior 10.6
females 10.4
friends 10.3
executive 10.3
school 10.3
happiness 10.2
food 10
horizontal 10
suit 9.9
boardroom 9.9
mother 9.8
meal 9.7
having 9.7
corporate 9.4
presentation 9.3
coffee 9.3
eating 9.2
communication 9.2
successful 9.1
sibling 9
four people 8.9
forties 8.8
worker 8.8
middle aged 8.8
daughter 8.6
adults 8.5
learning 8.4
study 8.4
holding 8.2
book 8.2
indoor 8.2
looking 8
love 7.9
explaining 7.9
coworkers 7.9
day 7.8
brunette 7.8
uniform 7.8
brown hair 7.8
face 7.8
black 7.8
color 7.8
thirties 7.8
educator 7.7
drinking 7.6
reading 7.6
college 7.6
enjoying 7.6
alcohol 7.5
senior 7.5
manager 7.4
inside 7.4
computer 7.2
kid 7.1

Google
created on 2022-01-23

Table 94
Tableware 93.4
Bottle 90.3
Drinkware 88.5
Chair 85.6
Stemware 85.1
Sharing 84.4
Adaptation 79.2
Food 78.1
Vintage clothing 74.3
Event 73.5
Monochrome photography 70.3
Monochrome 69.8
Art 66
Room 65.5
Suit 64.9
Photo caption 64.5
Stock photography 63.5
Conversation 63
Wine glass 62.7

Microsoft
created on 2022-01-23

person 100
text 98.3
sitting 96.9
man 91.7
group 91
indoor 90.1
clothing 89.7
table 89.6
bottle 88.6
human face 86.2
tableware 83.4
window 80.5
people 80.3
black 76.5
drink 68.4
old 63.2
wine glass 58.1
woman 53.7
dinner 48.9
meal 17.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 60.1%
Sad 37.5%
Confused 0.7%
Angry 0.7%
Fear 0.4%
Disgusted 0.4%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 91%
Sad 3.2%
Disgusted 1.5%
Angry 1.4%
Confused 1.2%
Happy 0.7%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 25-35
Gender Female, 100%
Calm 97.4%
Sad 2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 98.7%
Calm 98.7%
Sad 1%
Angry 0.1%
Fear 0.1%
Surprised 0%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 59-67
Gender Male, 77.5%
Calm 91.8%
Happy 4.7%
Angry 0.8%
Fear 0.7%
Confused 0.7%
Surprised 0.5%
Sad 0.5%
Disgusted 0.3%

AWS Rekognition

Age 23-33
Gender Male, 98.4%
Fear 51.2%
Sad 29.6%
Calm 12.4%
Angry 3.7%
Disgusted 1.4%
Surprised 0.7%
Happy 0.6%
Confused 0.4%

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 99.7%
Beer 68.3%
Dining Table 59.8%

Captions

Microsoft

a group of people sitting at a table 99%
a group of people sitting around a table 98.9%
a group of people sitting at a dinner table 98.8%

Text analysis

Amazon

Early