Human Generated Data

Title

Untitled (people at party in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17193

Human Generated Data

Title

Untitled (people at party in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.2
Person 99.2
Person 98.9
Person 98.5
Person 98
Person 96
Person 94
Accessory 88.8
Tie 88.8
Accessories 88.8
Person 85.5
Person 85.1
Indoors 81.4
Interior Design 81.4
Apparel 80.8
Clothing 80.8
Room 69.2
Living Room 69.2
Furniture 66.5
Art 61.6
Flooring 59.8
Shelf 56.3
Floor 55.4
Person 44.8

Imagga
created on 2022-02-26

barbershop 52.4
shop 49.6
counter 45.7
interior 41.6
mercantile establishment 35.8
room 34.2
salon 30.4
table 27.1
chair 24.9
restaurant 24.8
modern 23.8
place of business 23.8
indoors 22.8
home 22.3
kitchen 21.5
house 19.2
furniture 19.1
inside 18.4
decor 17.7
design 16.9
people 16.7
indoor 16.4
man 14.8
smiling 14.5
male 14.2
work 14.1
glass 14
luxury 13.7
dinner 13.6
dining 13.3
contemporary 13.2
elegant 12.8
food 12.7
office 12.1
service 12
light 12
person 11.9
style 11.9
establishment 11.9
architecture 11.7
wood 11.7
hotel 11.5
men 11.2
floor 11.2
drink 10.9
decoration 10.9
lifestyle 10.8
stove 10.8
window 10.5
sitting 10.3
happy 10
medical 9.7
adult 9.6
women 9.5
party 9.5
cabinet 9.2
business 9.1
professional 8.6
smile 8.5
barroom 8.5
worker 8.3
holding 8.3
meal 8.2
working 8
building 7.9
oven 7.8
sink 7.8
couple 7.8
comfortable 7.6
desk 7.6
eat 7.5
horizontal 7.5
hall 7.5
bar 7.4
wedding 7.4
equipment 7.3
together 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

indoor 96.4
text 94.2
kitchen 92.9
furniture 91.7
clothing 80.6
person 80.5
chair 61
preparing 40.1
table 29.9

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 54.1%
Calm 97.3%
Sad 2%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 88.8%

Captions

Microsoft

a man cooking in a kitchen 80.7%
a man standing in a kitchen 80.6%
a man that is standing in the kitchen 80.5%