Human Generated Data

Title

Untitled (man and boy)
Date

1970s
People

Artist: Susan Meiselas, American born 1948
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1854
Copyright

© Susan Meiselas / Magnum

Human Generated Data

Title

Untitled (man and boy)

People

Artist: Susan Meiselas, American born 1948

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Furniture 99.9
Couch 99.4
Human 98.6
Person 98.6
Living Room 97.5
Room 97.5
Indoors 97.5
Chair 97
Bedroom 95.5
Interior Design 90.5
Person 89.4
Clothing 84.5
Apparel 84.5
Bed 81.2
Shoe 69.3
Footwear 69.3
Cushion 64.5
Sitting 59.2
Shelf 58.1

Imagga
created on 2022-01-22

room 100
bedroom 94.4
armchair 60.9
interior 57.5
home 56.7
furniture 43.7
house 40.1
bed 38.1
sofa 32
pillow 30.1
couch 30
hotel 27.7
living 27.5
luxury 27.5
modern 27.4
lamp 25.6
rest 24.6
covered couch 24.1
relax 23.6
chair 23.5
indoors 22.9
table 21.9
wood 21.7
decor 21.2
sleep 20.4
apartment 20.1
light 20.1
floor 19.5
litter 19.4
comfort 19.3
design 19.1
decoration 18.8
suite 17.8
cozy 17.7
window 17.4
comfortable 17.2
motel 16.8
family 16
mattress 15.8
architecture 15.6
studio couch 15.5
relaxation 15.1
clean 15
seat 15
style 14.8
conveyance 14.6
travel 14.1
guest 13.8
sitting 13.8
indoor 13.7
wall 13.7
carpet 13.6
night 13.3
lifestyle 13
inside 12.9
accommodation 12.8
furnishings 12.8
living room 12.7
sleeping 12.7
love 12.6
happy 12.5
convertible 12.4
estate 12.4
adult 12.3
lodging 11.9
pillows 11.8
residential 11.5
man 11.4
grandfather 11.2
casual 11
happiness 11
slumber 10.9
inn 10.9
cushion 10.8
couple 10.5
warm 10.1
relaxing 10
male 9.9
luxurious 9.7
business 9.7
tour 9.7
decorate 9.5
smiling 9.4
sheet 9.4
cover 9.3
person 9.1
domestic 9
vacation 9
cheerful 8.9
people 8.9
budget 8.8
wooden 8.8
together 8.8
glass 8.6
real 8.5
attractive 8.4
color 8.3
fun 8.2
fireplace 8.1
rug 7.9
linen 7.9
chairs 7.8
queen 7.8
lounge 7.8
designer 7.7
elegant 7.7
mirror 7.6
brown 7.4
looking 7.2
portrait 7.1
life 7

Google
created on 2022-01-22

Shoe 95.8
Photograph 94.2
White 92.2
Window 89.8
Black 89.6
Comfort 87.1
Black-and-white 86.9
Standing 86.4
Style 84.1
Floor 82
Curtain 81.7
Sneakers 79.5
Flooring 79.1
Tints and shades 77.1
Monochrome 74.9
Snapshot 74.3
Monochrome photography 73.9
Baby 73.5
Sitting 69
Knee 68.9

Microsoft
created on 2022-01-22

indoor 99.9
wall 99.6
sitting 98.5
sofa 98
floor 96.5
black and white 88.2
couch 87.7
living 87.1
bed 85.9
room 76.4
person 75
bedroom 62
chair 59.6
baby 54.4
house 50.3
furniture 23.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 70.5%
Happy 100%
Surprised 0%
Calm 0%
Confused 0%
Angry 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 34-42
Gender Male, 100%
Happy 47.7%
Calm 18.6%
Sad 12.4%
Confused 8.3%
Disgusted 3.4%
Angry 3.3%
Fear 3.2%
Surprised 3.1%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Chair 97%
Shoe 69.3%

Captions

Microsoft

a man and a woman sitting on a bed 75.8%
a person sitting on a bed 75.7%
a person sitting in a living room 75.6%