Human Generated Data

Title

Untitled (cocktail party in living room)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16890

Human Generated Data

Title

Untitled (cocktail party in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16890

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Person 99.6
Human 99.6
Person 99.6
Person 99.4
Person 99.3
Chair 99.3
Furniture 99.3
Person 99
Person 98.8
Person 98.6
Person 97.5
Robe 94.3
Fashion 94.3
Gown 94.2
Person 94.1
Wedding 93
Person 92.4
Wedding Gown 81.5
Indoors 80.4
Bride 78.8
Table 75.1
Dress 74.4
Person 68.2
Room 66.7
People 66.5
Photography 66.3
Photo 66.3
Female 66.3
Portrait 66
Face 66
Person 65.2
Dining Table 62.1
Bridegroom 59.1
Suit 59
Coat 59
Overcoat 59
Person 54.7

Clarifai
created on 2023-10-29

people 99.9
group 99.1
many 98.7
woman 97.1
group together 96.7
adult 96.5
man 95.9
furniture 94.7
wear 92.1
child 90.7
veil 89.8
wedding 85.7
crowd 84.6
several 83.7
chair 82.8
room 82.6
recreation 82.1
seat 81.9
dancing 81.5
music 81.5

Imagga
created on 2022-02-26

teacher 49.3
educator 38.1
people 32.3
professional 32.3
person 31.1
adult 30.7
room 26.5
male 25.5
man 24.8
couple 20
businessman 18.5
classroom 18.3
men 18
business 17.6
happy 16.3
women 15
indoors 14.9
life 14.8
office 14.5
home 14.4
group 13.7
brass 13.3
smiling 12.3
together 12.3
table 12.1
old 11.8
catholic 11.8
happiness 11.7
businesspeople 11.4
sitting 11.2
teamwork 11.1
two 11
indoor 10.9
team 10.7
wind instrument 10.5
meeting 10.4
nurse 10.3
worker 10.3
love 10.2
clothing 10.1
smile 10
colleagues 9.7
musical instrument 9.5
corporate 9.4
desk 9.4
senior 9.4
modern 9.1
businesswoman 9.1
cheerful 8.9
color 8.9
family 8.9
job 8.8
interior 8.8
husband 8.6
adults 8.5
casual 8.5
student 8.4
portrait 8.4
mature 8.4
human 8.2
kin 8.1
work 7.8
40s 7.8
cornet 7.6
ethnic 7.6
wife 7.6
executive 7.6
horizontal 7.5
house 7.5
20s 7.3
new 7.3
success 7.2
lifestyle 7.2
religion 7.2

Google
created on 2022-02-26

Photograph 94.3
Furniture 94.2
Black 89.5
Chair 88
Table 87.5
Black-and-white 86
Interior design 85
Style 84.2
Decoration 79.5
Monochrome 78.9
Monochrome photography 78.4
Snapshot 74.3
Event 74.3
Art 73.7
Room 72.7
Vintage clothing 71.5
Classic 71
Suit 69.7
Stock photography 68
Window 64.6

Microsoft
created on 2022-02-26

wedding dress 96
text 94.7
person 94.5
dress 94.3
bride 90.8
clothing 89.9
indoor 86.2
woman 85.4
wedding 71.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 60%
Calm 59.1%
Sad 36.3%
Disgusted 0.9%
Angry 0.9%
Confused 0.9%
Surprised 0.8%
Happy 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person
Chair
Person 99.6%
Person 99.6%
Person 99.4%
Person 99.3%
Person 99%
Person 98.8%
Person 98.6%
Person 97.5%
Person 94.1%
Person 92.4%
Person 68.2%
Person 65.2%
Person 54.7%
Chair 99.3%

Categories

Imagga

interior objects 41.9%
streetview architecture 38.6%
paintings art 14.9%
text visuals 3.3%

Text analysis

Amazon

36
KODAK--2E11--1

Google

36
36