Human Generated Data

Title

Untitled (boy playing in fireplace)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17395

Human Generated Data

Title

Untitled (boy playing in fireplace)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 97.8
Human 97.8
Brick 96.2
Blonde 87.3
Kid 87.3
Girl 87.3
Teen 87.3
Child 87.3
Female 87.3
Woman 87.3
Indoors 78.9
Room 78.9
Face 73.5
Portrait 63.3
Photography 63.3
Photo 63.3
Sink 57.4

Imagga
created on 2022-02-26

room 52.5
interior 38
bathroom 33.2
house 30.9
home 29.6
modern 25.2
architecture 24.3
window 23.7
furniture 22.5
chair 21
luxury 20.6
floor 20.4
decor 19.4
tub 17.3
vessel 17.3
apartment 17.2
design 16.9
table 16.8
kitchen 16.8
style 14.8
building 14.8
glass 14.8
bathtub 14
sink 13.1
inside 12.9
indoor 12.8
man 12.8
clean 12.5
estate 12.3
living 12.3
indoors 12.3
decoration 12.3
tile 12.2
counter 11.9
wood 11.7
wall 11.6
residential 11.5
office 11.5
bath 11.4
toilet 11.3
contemporary 11.3
sitting 11.2
people 11.2
relax 10.9
cabinet 10.8
residence 10.8
seat 10.8
door 10.7
barbershop 10.7
lamp 10.6
new 10.5
real 10.4
elegant 10.3
male 9.9
faucet 9.8
hotel 9.5
shop 9.5
lifestyle 9.4
light 9.4
appliance 8.9
person 8.8
empty 8.6
mirror 8.6
outside 8.6
3d 8.5
elegance 8.4
relaxation 8.4
happy 8.1
stylish 8.1
domestic 8.1
basin 8.1
oven 8
carpet 7.8
nobody 7.8
travel 7.7
men 7.7
old 7.7
sofa 7.6
washbasin 7.4
water 7.3
adult 7.2
family 7.1
steel 7.1
life 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

building 99.5
black and white 94.7
clothing 94.1
man 91.4
person 90.1
window 81.3
human face 78
brick 70.9
sink 67.6
white 61.7
bathroom 54.7
monochrome 51.4
fireplace 26.2

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Calm 61.1%
Surprised 22.9%
Happy 7.7%
Fear 2.9%
Disgusted 2.1%
Sad 1.9%
Angry 0.8%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Sink 57.4%

Captions

Microsoft

a man standing in front of a brick building 93.5%
a man sitting in front of a brick building 90.4%
a man standing in front of a window in a brick building 90.3%

Text analysis

Amazon

19

Google

19
19