Human Generated Data

Title

Boothbay, Maine

Date

1980

People

Artist: Charles Melcher, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1428

Human Generated Data

Title

Boothbay, Maine

People

Artist: Charles Melcher, American 20th century

Date

1980

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Animal 97.1
Dog 97.1
Canine 97.1
Mammal 97.1
Pet 97.1
Plant 96
Vegetation 96
Outdoors 90.6
Grass 86.5
Nature 79.8
Bush 78.3
Husky 77.5
Female 70.4
Child 69.6
Kid 69.6
Forest 66.2
Woodland 66.2
Land 66.2
Tree 66.2
Face 65.8
Apparel 64.8
Clothing 64.8
Photography 61.7
Photo 61.7
Portrait 61.7
Person 60.6
Yard 59.8
Girl 58.3
Shorts 57.6
Zoo 56.3

Imagga
created on 2022-01-22

dog 100
malamute 100
sled dog 100
canine 58.5
domestic animal 40.6
pet 34.9
retriever 26.9
cute 26.5
portrait 23.3
grass 22.9
puppy 19.6
animals 16.7
golden retriever 16.5
happy 16.3
summer 16.1
fur 15.8
outdoors 15.7
forest 15.7
domestic 15.4
happiness 14.9
park 14.8
breed 14.5
fun 14.2
field 14.2
face 14.2
outdoor 13.8
smiling 13.7
pets 13.4
friend 13.3
country 13.2
look 12.3
smile 12.1
male 12.1
golden 12
outside 12
winter 11.9
countryside 11.9
dogs 11.8
people 11.7
child 11.7
pretty 11.2
eyes 11.2
head 10.9
joy 10.9
meadow 10.8
kid 10.6
rural 10.6
autumn 10.5
boy 10.4
brown 10.3
hair 10.3
love 10.3
adorable 10.2
person 10
farm 9.8
family 9.8
little 9.7
adult 9.7
sporting dog 9.1
attractive 9.1
snow 8.9
pedigree 8.8
hay 8.8
man 8.7
sunny 8.6
nose 8.6
playful 8.5
friendship 8.4
rest 8.3
cheerful 8.1
cold 7.7
fence 7.7
youth 7.7
leisure 7.5
one 7.5
landscape 7.4
natural 7.4
playing 7.3
children 7.3
looking 7.2
childhood 7.2
handsome 7.1
trees 7.1
spring 7.1
together 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

outdoor 100
grass 100
tree 99.8
sky 99.5
dog 98
carnivore 96.1
animal 83.3
little 78.1
black and white 77.7
posing 56.9
puppy 54.9
mammal 50.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-10
Gender Male, 100%
Angry 48.8%
Calm 33.2%
Confused 11.3%
Sad 5.1%
Happy 0.6%
Disgusted 0.4%
Surprised 0.4%
Fear 0.3%

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Dog 97.1%

Captions

Microsoft

a little boy that is standing in the grass 68.8%
a little boy that is sitting in the grass 67.3%
a little girl posing for a picture with a dog 67.2%