Human Generated Data

Title

Untitled (little boy and dog)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17338

Human Generated Data

Title

Untitled (little boy and dog)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 98.6
Person 98.6
Dog 94.2
Canine 94.2
Pet 94.2
Puppy 94.2
Animal 94.2
Mammal 94.2
Apparel 91.7
Clothing 91.7
Face 88.3
Hound 78.3
Female 70.3
Floor 67.9
Photography 67.2
Photo 67.2
Pants 64.3
Portrait 63.8
Terrier 59.3
Smile 57.9
Girl 57.2
Overcoat 56.9
Coat 56.9
Suit 56.9
Costume 56.6
Couch 56.3
Furniture 56.3
Door 55.4
Outdoors 55.1

Imagga
created on 2022-02-26

dog 35.7
trainer 23.2
head 20.1
portrait 20
hunting dog 19
hound 18.9
pet 18.4
canine 17.8
face 17.7
old 17.4
statue 17
brown 16.2
sculpture 15.2
animals 13.9
wild 13.1
cute 12.9
art 12.3
wildlife 11.6
pooch 11.5
happy 11.3
close 10.8
purebred 10.7
nose 10.5
looking 10.4
culture 10.2
black 10.2
domestic 10.1
man 10.1
person 9.9
hair 9.5
expression 9.4
senior 9.4
puppy 9.1
bloodhound 8.9
grandma 8.7
couple 8.7
antique 8.6
friend 8.6
monument 8.4
people 8.4
bull 8.3
life 8.1
domestic animal 8
detail 8
eye 8
water 8
mammal 7.9
love 7.9
doggy 7.8
eyes 7.7
breed 7.7
safari 7.7
closeup 7.4
adorable 7.4
dress 7.2
religion 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 92.7
dog 90.4
human face 87.9
toddler 81.3
person 78.8
black 72.9
black and white 69.7
baby 68
clothing 65.8

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 99.6%
Happy 31.2%
Calm 25.9%
Surprised 18.2%
Sad 8.6%
Confused 5.4%
Fear 5%
Disgusted 3.6%
Angry 2.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a dog that is standing in front of a building 83.3%
a dog standing in front of a building 83.2%
a dog sitting in front of a building 74.6%

Text analysis

Amazon

14
G

Google

MJI7- -YT3R2- -XAa
MJI7-
-XAa
-YT3R2-