Human Generated Data

Title

Untitled (boy, girl, and dog by tree in snow)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17073

Human Generated Data

Title

Untitled (boy, girl, and dog by tree in snow)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17073

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Clothing 99.1
Apparel 99.1
Person 98.7
Face 97.2
Chair 95.6
Furniture 95.6
Smile 94.5
Outdoors 89.2
Canine 88.5
Mammal 88.5
Animal 88.5
Female 86.7
Puppy 85
Dog 85
Pet 85
Shelter 82.7
Countryside 82.7
Rural 82.7
Nature 82.7
Building 82.7
Portrait 74.6
Photography 74.6
Photo 74.6
Shorts 70.9
Kid 68.8
Child 68.8
Porch 68.8
Girl 68.4
Room 67.8
Indoors 67.8
Housing 66.5
Woman 65.4
Door 65.2
Dress 60.5
Costume 57.2
Hat 56.7
Coat 55.6

Clarifai
created on 2023-10-29

people 99.7
canine 98.9
two 98.1
dog 97.7
family 96.9
child 96.6
portrait 95.1
wear 92
adult 91.4
offspring 91.4
actress 91.2
administration 89.3
three 88.8
home 88.1
one 87.4
four 86.4
sibling 83.6
woman 83.5
leader 83.3
affection 83.3

Imagga
created on 2022-02-26

shepherd dog 93.3
dog 83.2
canine 42.9
domestic animal 33
terrier 27.9
man 23.5
people 23.4
hunting dog 20.6
pet 19.3
male 19.1
outdoors 17.9
person 16.8
portrait 14.9
west highland white terrier 14.2
couple 13.9
park 13.2
outdoor 13
cold 12.9
water 12.7
two 11.9
adult 11.7
summer 11.6
smiling 11.6
smile 11.4
happy 11.3
happiness 11
cute 10.8
family 10.7
women 10.3
outside 10.3
day 10.2
lifestyle 10.1
dress 9.9
together 9.6
love 9.5
men 9.4
snow 9.4
black 9
sun 8.9
holiday 8.6
sitting 8.6
friends 8.5
attractive 8.4
old 8.4
ocean 8.3
fun 8.2
brunette 7.8
standing 7.8
travel 7.7
breed 7.7
winter 7.7
sky 7.6
friend 7.6
walk 7.6
wife 7.6
senior 7.5
leisure 7.5
ice 7.4
wedding 7.4
activity 7.2
face 7.1
businessman 7.1
sea 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.3
building 99
outdoor 96.3
clothing 86
white 78
person 76.1
smile 64.5
black and white 64.2
posing 47.4
old 46.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Happy 63.9%
Calm 26.2%
Surprised 2.9%
Disgusted 1.9%
Confused 1.6%
Sad 1.6%
Fear 1.1%
Angry 0.9%

AWS Rekognition

Age 21-29
Gender Female, 89.6%
Happy 99.4%
Calm 0.3%
Sad 0.1%
Surprised 0.1%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.5%
Person 98.7%

Categories

Text analysis

Amazon

14
MJ17--YT37--N

Google

14 M
14
M