Human Generated Data

Title

George and Tom, Key West, Florida
Date

1987
People

Artist: Sage Sohier, American born 1954
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1109
Copyright

© Sage Sohier

Human Generated Data

Title

George and Tom, Key West, Florida

People

Artist: Sage Sohier, American born 1954

Date

1987

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 100
Bed 99.1
Bedroom 97.7
Indoors 97.7
Room 97.7
Dog 84.8
Pet 84.8
Canine 84.8
Animal 84.8
Mammal 84.8
Person 78.1
Human 78.1
Person 68
Couch 64.4
Pillow 56.5
Cushion 56.5
Skin 55.4
Person 52.1

Imagga
created on 2022-01-09

sketch 50.8
drawing 39.4
representation 31.3
man 14.8
person 13.9
quilt 13.3
people 12.8
home 12.7
covering 12.5
winter 11.9
book jacket 11.9
adult 11.6
male 11.3
bedclothes 10.7
snow 10
furniture 9.6
black 9.6
bed 9.5
men 9.4
jacket 9.2
laptop 9.2
business 9.1
one 9
room 8.6
cold 8.6
sport 8.2
technology 8.2
cloth covering 8
wrapping 8
indoors 7.9
modern 7.7
shoes 7.7
bag 7.6
happy 7.5
human 7.5
seat 7.5
style 7.4
indoor 7.3
smiling 7.2
equipment 7.2
colorful 7.2
bright 7.1
pillow 7.1

Google
created on 2022-01-09

Dog 92.1
Picture frame 87.2
Dog breed 87.1
Comfort 86.6
Carnivore 86.1
Working animal 84.8
Monochrome photography 71.2
Companion dog 70.6
Monochrome 69.4
Room 67.2
Stock photography 65.6
Event 64.6
Sporting Group 61.4
Art 61.3
Canidae 60.3
Guard dog 58.2
Sitting 56.3
Photographic paper 54.1
Elbow 53.8
Photo caption 53.8

Microsoft
created on 2022-01-09

drawing 99.3
sketch 99
bed 97.6
text 97
cartoon 96.8
indoor 95.1
dog 91.2
black and white 76.1
laying 72
art 66.3
painting 57.5
illustration 53
bedroom 36.1

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 71.6%
Surprised 99.2%
Angry 0.4%
Happy 0.2%
Calm 0.1%
Disgusted 0%
Fear 0%
Confused 0%
Sad 0%

AWS Rekognition

Age 56-64
Gender Male, 99.9%
Calm 90.3%
Sad 6%
Happy 1.7%
Surprised 0.7%
Angry 0.6%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Bed 99.1%
Dog 84.8%
Person 78.1%

Captions

Microsoft

a dog lying on a bed 53.8%
a person lying on a bed 53.7%
a person lying in bed reading a book 46.5%