Human Generated Data

Title

Untitled (people opening packages is newsroom)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16663

Human Generated Data

Title

Untitled (people opening packages is newsroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-18

Person 98.5
Human 98.5
Clinic 98.2
Person 97.9
Chair 97.1
Furniture 97.1
Person 94.7
Room 94.2
Indoors 94.2
Person 88.8
Person 88.8
Hospital 81.3
Operating Theatre 79.2
Doctor 57.4
Surgery 57.4
Chair 57.3

Imagga
created on 2022-02-18

interior 80.6
furniture 71.8
room 67.5
table 63.4
house 53.5
home 53
modern 52.6
kitchen 48.4
decor 41.6
design 37.7
apartment 37.4
floor 37.2
indoor 35.6
luxury 34.3
wood 34.2
chair 33.7
dining 27.6
3d 27.1
inside 26.7
window 25.9
desk 25.6
contemporary 25.4
architecture 25
cabinet 24.8
counter 23.3
decoration 23.2
lamp 23
indoors 22.9
sofa 22.2
style 21.5
living 20.9
wall 20.1
glass 19.5
domestic 19
light 18.7
nobody 18.7
oven 18.7
furnishing 18.7
residential 17.3
comfortable 17.2
estate 17.1
vase 16.5
expensive 16.3
tile 16.1
stove 16
sink 15.9
plant 15.7
elegance 15.1
steel 15
wooden 15
render 14.7
empty 14.6
new 14.6
seat 14.5
food 14
antique 13.9
cabinets 13.9
faucet 13.8
cook 13.7
clean 13.4
refrigerator 12.8
antiquity 12.7
luxurious 12.7
appliance 12.3
lifestyle 12.3
cooking 12.2
dinner 11.8
residence 11.8
living room 11.8
microwave 11.5
rendering 11.5
metal 11.3
marble 11.2
space 10.9
stylish 10.9
building 10.8
chairs 10.8
flower 10.8
restaurant 10.7
decorating 10.7
door 10.5
area 10.4
case 10.4
corner 10.4
appliances 9.9
hall 9.6
real 9.5
shelf 9.5
elegant 9.4
relaxation 9.2
structure 9.1
cupboard 8.9
rug 8.9
stainless 8.7
couch 8.7
day 8.6
decorate 8.6
bedroom 8.4
drink 8.4
parquet 8.2
galley 8.1
sunlight 8
drawer 7.9
stool 7.9
office 7.9
ceiling 7.9
bright 7.9
hardwood 7.9
mansion 7.8
interiors 7.8
carpet 7.8
pillow 7.8
ceramic 7.8
lighting 7.7
construction 7.7
hotel 7.6
relax 7.6
rest 7.4
lights 7.4
island 7.3
fireplace 7.2

Google
created on 2022-02-18

Cabinetry 92.8
Interior design 85.3
Black-and-white 83.1
Chair 81.7
Art 76.9
Monochrome photography 73.2
Monochrome 71.6
Room 69.8
Machine 68.8
Event 68.6
Plant 68.2
Drawer 66.8
Window 66.8
Stock photography 62
Ceiling 58.2
Houseplant 55.9
Service 55.4
Major appliance 54.8
Visual arts 54.8
Rectangle 54.7

Microsoft
created on 2022-02-18

window 99.2
indoor 98.1
table 96.8
furniture 91.9
text 89.5
house 75
vase 63.4
old 42.8
cluttered 10.7

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 79.6%
Calm 89%
Happy 7.2%
Sad 2.4%
Confused 0.6%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.2%
Calm 95.8%
Sad 2.3%
Confused 0.8%
Happy 0.3%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 41-49
Gender Female, 98.2%
Calm 68.1%
Happy 19.8%
Sad 10%
Fear 0.6%
Confused 0.5%
Angry 0.5%
Disgusted 0.3%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Male, 89.6%
Calm 99.8%
Sad 0.1%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 52-60
Gender Female, 67.9%
Calm 90.6%
Happy 4.7%
Angry 2.1%
Surprised 0.7%
Disgusted 0.7%
Fear 0.5%
Sad 0.3%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 98.5%
Chair 97.1%

Captions

Microsoft

a person standing in front of a window 73.5%
a person standing next to a window 65.4%
an old photo of a person in a room 65.3%

Text analysis

Amazon

LE
ass
KODOK-