Human Generated Data

Title

Untitled (cocktail party in living room)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16890

Human Generated Data

Title

Untitled (cocktail party in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Person 99.6
Human 99.6
Person 99.6
Person 99.4
Person 99.3
Chair 99.3
Furniture 99.3
Person 99
Person 98.8
Person 98.6
Person 97.5
Robe 94.3
Fashion 94.3
Gown 94.2
Person 94.1
Wedding 93
Person 92.4
Wedding Gown 81.5
Indoors 80.4
Bride 78.8
Table 75.1
Dress 74.4
Person 68.2
Room 66.7
People 66.5
Photography 66.3
Photo 66.3
Female 66.3
Portrait 66
Face 66
Person 65.2
Dining Table 62.1
Bridegroom 59.1
Suit 59
Overcoat 59
Coat 59
Person 54.7

Imagga
created on 2022-02-26

teacher 49.3
educator 38.1
people 32.3
professional 32.3
person 31.1
adult 30.7
room 26.5
male 25.5
man 24.8
couple 20
businessman 18.5
classroom 18.3
men 18
business 17.6
happy 16.3
women 15
indoors 14.9
life 14.8
office 14.5
home 14.4
group 13.7
brass 13.3
smiling 12.3
together 12.3
table 12.1
old 11.8
catholic 11.8
happiness 11.7
businesspeople 11.4
sitting 11.2
teamwork 11.1
two 11
indoor 10.9
team 10.7
wind instrument 10.5
meeting 10.4
nurse 10.3
worker 10.3
love 10.2
clothing 10.1
smile 10
colleagues 9.7
musical instrument 9.5
corporate 9.4
desk 9.4
senior 9.4
modern 9.1
businesswoman 9.1
cheerful 8.9
color 8.9
family 8.9
interior 8.8
job 8.8
husband 8.6
adults 8.5
casual 8.5
student 8.4
portrait 8.4
mature 8.4
human 8.2
kin 8.1
work 7.8
40s 7.8
cornet 7.6
ethnic 7.6
wife 7.6
executive 7.6
horizontal 7.5
house 7.5
20s 7.3
new 7.3
success 7.2
lifestyle 7.2
religion 7.2

Google
created on 2022-02-26

Photograph 94.3
Furniture 94.2
Black 89.5
Chair 88
Table 87.5
Black-and-white 86
Interior design 85
Style 84.2
Decoration 79.5
Monochrome 78.9
Monochrome photography 78.4
Snapshot 74.3
Event 74.3
Art 73.7
Room 72.7
Vintage clothing 71.5
Classic 71
Suit 69.7
Stock photography 68
Window 64.6

Microsoft
created on 2022-02-26

wedding dress 96
text 94.7
person 94.5
dress 94.3
bride 90.8
clothing 89.9
indoor 86.2
woman 85.4
wedding 71.7

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 60%
Calm 59.1%
Sad 36.3%
Disgusted 0.9%
Angry 0.9%
Confused 0.9%
Surprised 0.8%
Happy 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.6%
Chair 99.3%

Captions

Microsoft

a group of people in a room 93.6%
a group of people standing in a room 91.9%
a group of people standing in front of a store 68.8%

Text analysis

Amazon

36
KODAK--2E11--1

Google

36
36