Human Generated Data

Title

Untitled (family of five with three dogs at fireplace)
Date

c. 1970
People

Artist: Ken Whitmire Associates, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1371

Human Generated Data

Title

Untitled (family of five with three dogs at fireplace)

People

Artist: Ken Whitmire Associates, American

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Person 99.4
Person 99
Clothing 98.9
Apparel 98.9
Person 98.6
People 97.9
Family 96.4
Female 96
Person 95.5
Dog 95.4
Mammal 95.4
Canine 95.4
Animal 95.4
Pet 95.4
Tie 93.5
Accessories 93.5
Accessory 93.5
Dog 93.3
Woman 86.6
Evening Dress 77.6
Gown 77.6
Fashion 77.6
Robe 77.6
Dress 77.4
Portrait 66.8
Photography 66.8
Face 66.8
Photo 66.8
Girl 64.4
Painting 61.7
Art 61.7
Sitting 61.6
Couch 57.1
Furniture 57.1
Sari 56.8
Silk 56.8

Imagga
created on 2022-01-22

room 48.2
home 46.2
interior 45.1
house 34.4
bed 32.7
groom 31.8
bedroom 31.5
sofa 30
furniture 29.7
comfortable 29.6
indoors 26.3
pillow 24.4
luxury 23.1
apartment 23
sitting 22.3
comfort 22.2
lifestyle 20.9
kin 19.6
adult 19.4
inside 19.3
modern 18.9
person 18.6
decor 18.6
relaxation 18.4
couple 18.3
women 18.2
living 18
people 17.8
happy 17.5
table 17.3
lamp 17.2
hotel 17.2
happiness 16.4
style 16.3
man 16.1
wood 15.8
floor 15.8
chair 15.6
window 15.6
indoor 15.5
design 15.4
smiling 15.2
couch 14.5
family 14.2
light 14
rest 13.9
mother 13.5
relax 13.5
decoration 13.3
husband 12.9
smile 12.8
fashion 12.8
living room 12.7
fun 12.7
sleep 12.6
love 12.6
together 12.3
male 12
domestic 11.9
cozy 11.8
leisure 11.6
attractive 11.2
pillows 10.8
color 10.6
cheerful 10.6
residential 10.5
new 10.5
enjoyment 10.3
elegance 10.1
residence 9.9
furnishings 9.8
vacation 9.8
luxurious 9.7
estate 9.5
wall 9.4
architecture 9.4
casual 9.3
holding 9.1
portrait 9.1
dress 9
father 8.8
looking 8.8
carpet 8.7
full length 8.7
two 8.5
outfit 8.4
grandfather 8.3
relaxing 8.2
sensuality 8.2
life 8.1
parent 8
mattress 7.9
clothing 7.9
men 7.7
adults 7.6
togetherness 7.5
seat 7.2
holiday 7.2
romance 7.1
fireplace 7.1
face 7.1
curtain 7

Google
created on 2022-01-22

Smile 97.4
Dog 96
Photograph 94.3
Carnivore 87.5
Dog breed 86.7
Happy 86
Companion dog 81
Formal wear 75.8
Snapshot 74.3
Event 73.8
Tie 70.2
Toy dog 68.6
Fur 67.3
Sporting Group 65.3
Vintage clothing 64.6
Suit 63.7
Canidae 62.6
Pattern 58.9
Fashion design 57.4
Ceremony 56.6

Microsoft
created on 2022-01-22

person 97.6
smile 90.5
clothing 88.3
dog 88
woman 82.9
dress 80.8
carnivore 59.4
posing 35.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Female, 99.9%
Happy 96%
Surprised 1.3%
Calm 1%
Fear 0.8%
Angry 0.2%
Confused 0.2%
Sad 0.2%
Disgusted 0.2%

AWS Rekognition

Age 38-46
Gender Female, 86.9%
Happy 93.5%
Fear 4%
Surprised 1.2%
Angry 0.5%
Confused 0.3%
Calm 0.2%
Disgusted 0.2%
Sad 0.1%

AWS Rekognition

Age 39-47
Gender Male, 100%
Happy 89.8%
Confused 4.6%
Surprised 1.6%
Angry 1.4%
Fear 1%
Disgusted 0.7%
Sad 0.6%
Calm 0.3%

AWS Rekognition

Age 25-35
Gender Female, 100%
Happy 97.5%
Surprised 1%
Angry 0.4%
Calm 0.3%
Confused 0.3%
Fear 0.3%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 24-34
Gender Female, 99.9%
Happy 99.6%
Confused 0.1%
Calm 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%
Sad 0%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Dog 95.4%
Tie 93.5%
Painting 61.7%

Captions

Microsoft

a group of people posing for a picture with a dog 92.2%
a group of people sitting around a dog 82.3%
a group of people sitting posing for the camera 82.2%

Text analysis

Amazon

Ken
Ken whitmine
whitmine

Google

Ken Whreene
Ken
Whreene