Human Generated Data

Title

Untitled (Dachsund dog and infant)
Date

before 1982
People

Artist: Bob Ely, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.620

Human Generated Data

Title

Untitled (Dachsund dog and infant)

People

Artist: Bob Ely, American 20th century

Date

before 1982

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 95.3
Person 95.3
Person 95.1
Animal 92.6
Mammal 92.6
Dog 92.6
Canine 92.6
Pet 92.6
Hound 74.7
Flooring 66.5
Apparel 65.1
Clothing 65.1
Floor 64.3
Hardwood 57.9
Wood 57.9
Strap 55.9

Imagga
created on 2022-02-26

dog 58.5
canine 28.1
fur 27.8
pet 26.6
domestic 25.3
brown 20.6
hunting dog 19.8
cute 19.4
domestic animal 17.9
retriever 17.6
cat 16.5
animals 14.8
eyes 13.8
hair 13.5
face 12.8
head 12.6
pets 12.5
puppy 12.3
hound 11.9
terrier 11.8
close 10.8
black 10.8
wildlife 10.7
whiskers 10.7
male 10.6
portrait 10.3
lying 10.3
bunny 10.3
sporting dog 10.2
man 10.1
kitten 10.1
bulldog 9.8
feline 9.7
nose 9.5
adult 9.1
fun 9
eye 8.9
people 8.9
color 8.9
little 8.8
wild 8.7
furry 8.7
kitty 8.6
life 8.6
friend 8.6
smile 8.5
floor 8.4
outdoors 8.2
water 8
purebred 7.8
breed 7.7
sitting 7.7
device 7.5
adorable 7.4
funny 7.3
smiling 7.2
home 7.2
rodent 7.1
person 7.1

Google
created on 2022-02-26

Gesture 85.3
Working animal 83.4
Happy 80.5
Smile 77.6
Dog breed 73.7
Art 70.4
Curtain 69.8
Companion dog 69.7
Event 67.4
Visual arts 67
Sitting 66
Stock photography 65.2
Fun 64.7
Terrestrial animal 62.6
Fur 59.5
Room 59.3
Guard dog 56.7
Photo caption 54.6
Animal training 52.8

Microsoft
created on 2022-02-26

indoor 96.4
person 95
baby 94.1
floor 93.2
toddler 92.8
text 92.4
dog 79.4
carnivore 73.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 99.6%
Calm 90.5%
Sad 3.4%
Angry 2%
Surprised 1.3%
Disgusted 1%
Fear 0.9%
Happy 0.5%
Confused 0.4%

Microsoft Cognitive Services

Age 0
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.3%
Dog 92.6%

Captions

Microsoft

a person holding a dog 73.3%
a person holding a dog 70.8%
a person holding a dog 70.7%

Text analysis

Amazon

4

Google

4
4