Human Generated Data

Title

Untitled (man and woman in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17526

Human Generated Data

Title

Untitled (man and woman in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 97.9
Human 97.9
Person 97.4
Clinic 93.6
Indoors 91.7
Room 91.7
Interior Design 91.1
Hospital 72
Person 70.5
Living Room 65.8
Monitor 65.4
Electronics 65.4
Display 65.4
Screen 65.4
People 60.5
Furniture 59.4
Operating Theatre 56.9

Imagga
created on 2022-02-26

interior 69.9
barbershop 68.7
room 66.8
shop 58.2
furniture 49.8
table 49.3
chair 48.7
house 46
home 43.9
mercantile establishment 43.5
restaurant 37.3
decor 35.4
modern 34.4
floor 33.5
design 31.5
kitchen 29.9
place of business 29
inside 27.6
indoor 27.4
wood 25.9
luxury 24.9
cafeteria 24.4
window 24
dining 23.8
indoors 22.9
building 22.5
apartment 22.1
chairs 21.6
decoration 21
style 20
architecture 19.5
light 19.4
residential 19.2
counter 18.9
lamp 18.1
living 18
contemporary 17.9
comfortable 17.2
wall 16.4
sofa 16.3
structure 15.8
glass 15.6
dinner 15.2
seat 14.9
cabinet 14.6
establishment 14.4
empty 13.8
hotel 13.4
food 13.3
plant 12.7
domestic 12.7
elegance 12.6
3d 12.4
wooden 12.3
elegant 12
bedroom 12
cabinets 11.9
stool 11.9
relaxation 11.7
salon 11.1
nobody 10.9
decorate 10.5
space 10.1
stylish 10
rug 9.9
stove 9.8
oven 9.8
expensive 9.6
desk 9.4
office 9.3
cook 9.2
dining room 8.9
drawer 8.9
refrigerator 8.9
tables 8.9
residence 8.8
urban 8.7
couch 8.7
lighting 8.7
mirror 8.6
lifestyles 8.5
eat 8.4
drink 8.4
door 8.3
classroom 8.1
upscale 7.9
sink 7.8
living room 7.8
render 7.8
carpet 7.8
vase 7.7
estate 7.6
bed 7.6
place 7.5
service 7.4
bar 7.4
hall 7.2
fireplace 7

Google
created on 2022-02-26

Black 89.8
Building 86.8
Picture frame 86.3
Black-and-white 85.5
Grey 84.1
Style 83.8
Window 81.9
Rectangle 79.2
Living room 78.9
Chair 78.3
Art 76.7
Tints and shades 76.5
Monochrome 74.7
Snapshot 74.3
Monochrome photography 73.6
Table 69.1
Couch 68.3
Classic 66.6
Stock photography 64.6
Room 64

Microsoft
created on 2022-02-26

text 97.5
wall 97.2
furniture 96.8
house 93.9
indoor 92.8
table 87.2
chair 81.1
bed 64.9
several 12.6

Face analysis

Amazon

Google

AWS Rekognition

Age 7-17
Gender Female, 98%
Surprised 57.5%
Calm 23.9%
Sad 8.9%
Fear 3.2%
Confused 2.2%
Disgusted 1.8%
Happy 1.8%
Angry 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%

Captions

Microsoft

a group of people in a room 89.4%
a group of people standing in a room 84.4%
a group of people sitting at a desk 72.6%

Text analysis

Amazon

M

Google

YT37A
a-XAOO
A-- YT37A a-XAOO
A--