Human Generated Data

Title

Untitled (boy watching dogs play outside)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17389

Human Generated Data

Title

Untitled (boy watching dogs play outside)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Animal 98.2
Dog 98.2
Canine 98.2
Pet 98.2
Mammal 98.2
Coyote 95.5
Dog 89.9
Clothing 88.8
Shorts 88.8
Apparel 88.8
Wolf 76.8
Red Wolf 70.7
People 62.8
Wildlife 57.9

Imagga
created on 2022-02-26

dog 47.3
wallaby 45.7
leash 43.2
kangaroo 40.8
restraint 34.8
device 30.2
pet 25.7
canine 21.1
shepherd dog 18.7
outdoors 18.7
outdoor 18.3
summer 18
grass 16.6
cute 15.8
happy 15.7
wild 14.8
wildlife 14.3
park 14
animals 13.9
outside 13.7
male 13.6
child 13.3
man 12.8
fun 12.7
sprinkler 12.7
forest 12.2
friendship 12.2
playing 11.8
dogs 11.8
sport 11.5
person 11.2
people 11.2
brown 11
smiling 10.9
pets 10.6
autumn 10.5
friend 10.5
sand 10.5
portrait 10.4
adult 10.3
fur 10.2
mechanical device 10.2
field 10
joy 10
activity 9.9
farm 9.8
little 9.7
action 9.3
head 9.2
leisure 9.1
calf 9.1
pretty 9.1
fall 9.1
game 8.9
happiness 8.6
play 8.6
smile 8.6
attractive 8.4
countryside 8.2
retriever 8.2
vacation 8.2
cheerful 8.1
active 8.1
water 8
lifestyle 7.9
boy 7.8
puppy 7.8
run 7.7
jump 7.7
domestic animal 7.6
golf 7.6
two 7.6
mechanism 7.6
young mammal 7.6
club 7.5
one 7.5
children 7.3
sun 7.2
domestic 7.2
hunting dog 7.2
sunset 7.2
women 7.1
trees 7.1
together 7

Google
created on 2022-02-26

Dog 94
White 92.2
Black 89.9
Carnivore 88.7
Black-and-white 86.9
Style 84.1
Dog breed 81.1
Plant 78.8
Grass 78.2
Tree 77.7
Companion dog 77.4
Monochrome 77.3
Monochrome photography 76.8
Working animal 72.2
Leash 71.9
Tail 71.3
Sporting Group 69.1
Canidae 64.7
Stock photography 64
Toddler 63.5

Microsoft
created on 2022-02-26

grass 99.6
outdoor 99.4
person 94.1
dog 93.5
black and white 84.1
carnivore 67.2
mammal 62.9
text 59
clothing 58.3
animal 50.7

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 94%
Calm 88.5%
Sad 6.6%
Confused 3.1%
Fear 0.7%
Happy 0.6%
Surprised 0.2%
Disgusted 0.2%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Dog 98.2%

Captions

Microsoft

a person petting a dog 74.6%
a person petting a dog on a leash 74.5%
a person petting a dog on a leash 74.4%

Text analysis

Amazon

NAGON
SCP