Human Generated Data

Title

Untitled (young boy, baby, and dog seated on carpeted brick steps outdoors)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12818

Human Generated Data

Title

Untitled (young boy, baby, and dog seated on carpeted brick steps outdoors)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.6
Human 99.6
Person 99.3
Pet 98.2
Dog 98.2
Canine 98.2
Mammal 98.2
Animal 98.2
Clothing 87.5
Apparel 87.5
Shorts 87.5
Potted Plant 86.1
Plant 86.1
Pottery 86.1
Vase 86.1
Jar 86.1
Tire 72.9
Pot 61.9
Planter 61
Finger 57.7
Child 56.6
Kid 56.6
Furniture 56.1
Couch 56.1
Flagstone 55.7
Outdoors 55.6

Clarifai
created on 2019-11-16

people 99.9
monochrome 98.5
child 98.4
group 97.8
woman 97.5
group together 96.4
adult 95.4
portrait 94.6
man 94.4
street 94.3
family 93.6
wear 91.4
sit 90.1
dog 90.1
two 88.4
music 88.3
dancer 87
canine 86.9
many 86.6
three 85.8

Imagga
created on 2019-11-16

dog 33.7
shepherd dog 27.1
people 22.9
adult 22.8
collie 21.8
love 21.3
person 19.6
couple 19.1
canine 19
man 18.1
happy 17.5
portrait 17.5
outdoors 16.6
trainer 16.5
attractive 15.4
male 14.9
outdoor 14.5
kin 14.3
fashion 14.3
fun 14.2
domestic animal 14.2
dark 13.4
happiness 13.3
park 13.2
sitting 12.9
water 12.7
together 12.3
home 12
hound 11.7
child 11.2
two 11
model 10.9
joy 10.8
lifestyle 10.8
smile 10.7
river 10.7
face 10.6
pretty 10.5
sexy 10.4
boy 10.4
hair 10.3
black 10.2
park bench 10.1
bench 9.9
lady 9.7
life 9.7
summer 9.6
fur coat 9.6
looking 9.6
body 9.6
wife 9.5
hunting dog 9.1
relaxing 9.1
romantic 8.9
family 8.9
night 8.9
interior 8.8
women 8.7
day 8.6
married 8.6
luxury 8.6
enjoy 8.5
passion 8.5
leisure 8.3
sky 8.3
street 8.3
dress 8.1
romance 8
light 8
smiling 7.9
cute 7.9
furniture 7.9
cold 7.7
couch 7.7
men 7.7
seat 7.7
room 7.7
expression 7.7
coat 7.7
husband 7.6
casual 7.6
erotic 7.6
pleasure 7.5
relaxation 7.5
lying 7.5
human 7.5
one 7.5
silhouette 7.4
cheerful 7.3
indoor 7.3
sensual 7.3
color 7.2
television 7.2
childhood 7.2
wet 7.2
posing 7.1
kid 7.1

Google
created on 2019-11-16

Photograph 96.7
Black 94.5
Black-and-white 94.3
Snapshot 88.2
Monochrome 83.8
Photography 81.6
Monochrome photography 76.2
Stock photography 68.5
Room 65.7
Sitting 57.5
Photographic paper 56.3
Style 53.5

Microsoft
created on 2019-11-16

toddler 96.1
baby 94
person 91.8
child 91
outdoor 90.7
black and white 88.1
human face 87.2
clothing 85.2
boy 80.2
text 72.4
monochrome 60.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 53.7%
Surprised 0.4%
Happy 97.1%
Sad 0.4%
Fear 0.2%
Calm 0.9%
Confused 0.2%
Disgusted 0.1%
Angry 0.8%

AWS Rekognition

Age 0-3
Gender Female, 69.6%
Happy 0%
Sad 13%
Disgusted 1.1%
Surprised 1.5%
Fear 4.3%
Angry 75.5%
Confused 2.3%
Calm 2.2%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Dog 98.2%

Captions

Microsoft

a person sitting on a bench 75.3%
a group of people posing for a photo 70%
a girl sitting on a bench 59.2%