Human Generated Data

Title

Untitled (cocktail party in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16890

Human Generated Data

Title

Untitled (cocktail party in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Person 99.6
Human 99.6
Person 99.6
Person 99.4
Person 99.3
Chair 99.3
Furniture 99.3
Person 99
Person 98.8
Person 98.6
Person 97.5
Robe 94.3
Fashion 94.3
Gown 94.2
Person 94.1
Wedding 93
Person 92.4
Wedding Gown 81.5
Indoors 80.4
Bride 78.8
Table 75.1
Dress 74.4
Person 68.2
Room 66.7
People 66.5
Photography 66.3
Photo 66.3
Female 66.3
Portrait 66
Face 66
Person 65.2
Dining Table 62.1
Bridegroom 59.1
Suit 59
Overcoat 59
Coat 59
Person 54.7

Imagga
created on 2022-02-26

teacher 49.3
educator 38.1
people 32.3
professional 32.3
person 31.1
adult 30.7
room 26.5
male 25.5
man 24.8
couple 20
businessman 18.5
classroom 18.3
men 18
business 17.6
happy 16.3
women 15
indoors 14.9
life 14.8
office 14.5
home 14.4
group 13.7
brass 13.3
smiling 12.3
together 12.3
table 12.1
old 11.8
catholic 11.8
happiness 11.7
businesspeople 11.4
sitting 11.2
teamwork 11.1
two 11
indoor 10.9
team 10.7
wind instrument 10.5
meeting 10.4
nurse 10.3
worker 10.3
love 10.2
clothing 10.1
smile 10
colleagues 9.7
musical instrument 9.5
corporate 9.4
desk 9.4
senior 9.4
modern 9.1
businesswoman 9.1
cheerful 8.9
color 8.9
family 8.9
interior 8.8
job 8.8
husband 8.6
adults 8.5
casual 8.5
student 8.4
portrait 8.4
mature 8.4
human 8.2
kin 8.1
work 7.8
40s 7.8
cornet 7.6
ethnic 7.6
wife 7.6
executive 7.6
horizontal 7.5
house 7.5
20s 7.3
new 7.3
success 7.2
lifestyle 7.2
religion 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

wedding dress 96
text 94.7
person 94.5
dress 94.3
bride 90.8
clothing 89.9
indoor 86.2
woman 85.4
wedding 71.7

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 60%
Calm 59.1%
Sad 36.3%
Disgusted 0.9%
Angry 0.9%
Confused 0.9%
Surprised 0.8%
Happy 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.6%
Chair 99.3%

Captions

Microsoft

a group of people in a room 93.6%
a group of people standing in a room 91.9%
a group of people standing in front of a store 68.8%

Text analysis

Amazon

36
KODAK--2E11--1

Google

36
36