Human Generated Data

Title

Untitled (guests eating at dinner party)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16894

Human Generated Data

Title

Untitled (guests eating at dinner party)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.4
Person 99.4
Person 98.6
Person 98.4
Person 97.8
Person 97.3
Restaurant 96.5
Furniture 95.9
Chair 95.9
Indoors 95.1
Room 95.1
Person 92
Table 88.3
Dining Room 86.4
Chair 85.1
Dining Table 83.1
Chair 79.5
Meal 78.2
Food 78.2
Glass 72.2
Apparel 65.6
Overcoat 65.6
Coat 65.6
Clothing 65.6
Suit 65.6
Tabletop 64.1
People 62
Crowd 61.1
Photography 60.8
Face 60.8
Portrait 60.8
Photo 60.8
Dating 60.3
Cafeteria 59
Tablecloth 58.6
Cafe 58.4
Sitting 57.6
Pub 56.6
Worker 56.2
Chair 51.3

Imagga
created on 2022-02-26

salon 47.6
table 29.6
people 29.5
indoors 25.5
room 25.1
man 24.9
person 24.5
male 24.1
home 23.9
interior 22.1
adult 22
couple 21.8
restaurant 20.5
drink 20
chair 19
happy 18.2
sitting 18
modern 17.5
together 17.5
senior 16.9
classroom 15.8
work 15.8
wine 15.7
indoor 15.5
dinner 15.5
teacher 15.3
women 15
glass 14.8
men 14.6
smiling 14.5
wedding 13.8
love 13.4
meal 13.2
two 12.7
meeting 12.2
mature 12.1
happiness 11.7
kitchen 11.7
class 11.6
family 11.6
decor 11.5
dining 11.4
cheerful 11.4
group 11.3
party 11.2
service 11.1
portrait 11
house 10.9
lifestyle 10.8
holding 10.7
romantic 10.7
desk 10.6
marriage 10.4
celebration 10.4
food 10.4
office 10.3
hall 10.3
professional 10.1
smile 10
handsome 9.8
businessman 9.7
computer 9.6
design 9.6
elegant 9.4
learning 9.4
glasses 9.3
alcohol 9.2
laptop 9.1
business 9.1
team 9
worker 8.9
looking 8.8
teaching 8.8
bouquet 8.7
education 8.7
drinking 8.6
formal 8.6
businesspeople 8.5
hand 8.3
counter 8.2
dress 8.1
romance 8
kin 7.9
educator 7.8
flowers 7.8
barbershop 7.7
old 7.7
elderly 7.7
student 7.6
talking 7.6
enjoying 7.6
relationship 7.5
groom 7.5
place 7.4
teamwork 7.4
care 7.4
event 7.4
lunch 7.3
shop 7.3
suit 7.2
to 7.1
job 7.1

Google
created on 2022-02-26

Hairstyle 95.1
Chair 87.9
Table 87.4
Style 83.8
Black-and-white 83.7
Interaction 83.1
Suit 76.3
Tableware 74.1
Monochrome photography 74.1
Event 73.9
Monochrome 71.9
Fun 69.9
Sitting 69.4
Art 65.5
Room 65.2
Conversation 60.2
Rehearsal dinner 60
Vintage clothing 57.2
Still life photography 55.1
Meal 53

Microsoft
created on 2022-02-26

person 99.9
indoor 96.3
table 86.7
window 84.3
clothing 77.2
bottle 75.2
people 74.3
text 69.9
group 67.3
preparing 63
black and white 60.4
man 57.7
meal 35.1
family 24.7

Face analysis

Amazon

AWS Rekognition

Age 53-61
Gender Female, 54.7%
Calm 91%
Happy 2%
Confused 1.7%
Fear 1.5%
Surprised 1.2%
Sad 1.1%
Disgusted 0.7%
Angry 0.7%

AWS Rekognition

Age 50-58
Gender Male, 98.4%
Calm 100%
Happy 0%
Surprised 0%
Sad 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Calm 99.8%
Happy 0.1%
Surprised 0%
Sad 0%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Calm 92.6%
Happy 2.1%
Surprised 1.9%
Confused 1.3%
Sad 0.8%
Disgusted 0.6%
Angry 0.4%
Fear 0.3%

Feature analysis

Amazon

Person 99.4%
Chair 95.9%

Captions

Microsoft

a group of people preparing food in a kitchen 95.1%
a group of people in a kitchen preparing food 94.5%
a group of people preparing food on a table 94%

Text analysis

Amazon

14

Google

T3RA
MJI7-- Y T3RA 2-- XAGOX
2--
Y
XAGOX
MJI7--