Human Generated Data

Title

Untitled (four children on bed)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17063

Human Generated Data

Title

Untitled (four children on bed)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.2
Human 99.2
Tablecloth 97.3
Person 96.5
Person 95
Furniture 94.5
Bed 92.3
Person 91.1
Indoors 86.9
Person 85.8
People 84.2
Face 83.5
Room 81.5
Clothing 73.4
Apparel 73.4
Table 71.6
Home Decor 68
Portrait 67
Photography 67
Photo 67
Suit 59.7
Coat 59.7
Overcoat 59.7
Living Room 58.9
Couch 57.8
Curtain 55.1
Meal 55.1
Food 55.1

Imagga
created on 2022-02-26

room 100
bedroom 76
interior 73.4
furniture 62.9
house 59.3
home 55.4
decor 49.5
lamp 44.9
sofa 44.9
living 43.6
apartment 42.2
floor 41.8
table 41.8
window 41.5
luxury 39.5
modern 39.3
comfortable 36.3
bed 34.7
architecture 34.4
wood 32.5
design 32.1
pillow 31
residential 30.6
chair 25.8
3d 24
decoration 23.9
hotel 23.9
light 23.4
style 23
relax 22.7
fireplace 22.6
relaxation 21.8
carpet 21.4
indoors 21.1
wall 20.3
estate 19.9
residence 19.8
sleep 19.5
inside 19.3
couch 19.3
comfort 19.3
domestic 16.3
cozy 15.7
living room 15.7
seat 15.6
rug 14.8
indoor 14.6
lifestyle 14.5
rest 14.2
contemporary 14.1
vase 13.5
structure 13.3
motel 12.8
furnishings 12.8
clean 12.5
real 12.3
door 12
warm 11.9
mattress 11.9
chairs 11.8
lighting 11.8
decorative 11.7
space 11.6
rendering 11.4
elegant 11.1
elegance 10.9
suite 10.8
ceiling 10.8
mansion 10.8
armchair 10.6
lifestyles 10.4
empty 10.3
curtain 10.3
classic 10.2
parquet 10.2
panel 10
lodging 9.9
guest 9.9
minimalism 9.9
bedding 9.9
vacation 9.8
hardwood 9.8
wooden 9.7
glass 9.6
decorate 9.5
cover 9.3
ottoman 9.1
fashion 9
family 8.9
loft 8.9
frame 8.9
accommodation 8.9
pillows 8.9
dwelling 8.8
luxurious 8.8
textile 8.5
sheet 8.5
plant 8.2
kitchen 8.1
studio couch 8
quilt 8
spacious 7.9
upscale 7.9
curtains 7.9
sleeping 7.8
render 7.8
nobody 7.8
decorating 7.8
designer 7.7
expensive 7.7
leather 7.6
new 7.3
relaxing 7.3
building 7.3
furnishing 7.3
travel 7

Google
created on 2022-02-26

Black 89.6
Interior design 85.3
Black-and-white 84.7
Style 83.9
Couch 82.3
Plant 82.1
Tints and shades 77.2
Art 75.3
Snapshot 74.3
Chair 74
Monochrome photography 73.5
Building 72.2
Monochrome 71.6
Rectangle 71.1
Living room 69.2
Room 68.3
Curtain 68
Classic 67.4
Vintage clothing 66.9
Linens 65.2

Microsoft
created on 2022-02-26

house 86.8
black and white 75.7
text 61.2
curtain 53.6
old 52.4
room 49.2

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 97.8%
Happy 65.8%
Sad 19.1%
Surprised 6.1%
Calm 3.7%
Disgusted 1.5%
Angry 1.4%
Fear 1.4%
Confused 1%

AWS Rekognition

Age 24-34
Gender Male, 88.4%
Happy 90.3%
Sad 7.5%
Calm 0.7%
Angry 0.4%
Surprised 0.4%
Fear 0.3%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 30-40
Gender Male, 99.2%
Happy 92.1%
Calm 4.1%
Angry 0.9%
Sad 0.8%
Surprised 0.7%
Disgusted 0.6%
Fear 0.5%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Bed 92.3%

Captions

Microsoft

a group of people sitting in front of a building 77.3%
a group of people in a room 77.2%
a group of people standing in front of a building 76.3%

Text analysis

Amazon

21
2
I

Google

21 www
21
www