Human Generated Data

Title

Untitled (family sitting on lawn)
Date

1962
People

Artist: Curtis Studio, American active 1891 - 1935
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1296

Human Generated Data

Title

Untitled (family sitting on lawn)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99
Human 99
Chair 98.8
Furniture 98.8
Person 98.6
Person 98.4
Clothing 97.9
Apparel 97.9
Person 96
Meal 91.6
Food 91.6
Grass 84.8
Plant 84.8
Vacation 83.3
People 83.2
Leisure Activities 75.3
Picnic 71.3
Face 68.7
Shorts 64.8
Female 64.4
Girl 63
Photography 62.5
Photo 62.5
Tree 61.6
Kid 61.2
Child 61.2

Imagga
created on 2022-01-22

kin 80.5
child 62.6
mother 51
family 49.8
happy 45.1
together 41.2
park 37.1
children 36.5
fun 34.4
smiling 34
parent 33.7
daughter 32.9
kid 32.8
happiness 32.1
people 30.1
male 29.5
father 29.5
smile 29.2
boy 28.7
childhood 27.8
love 27.6
portrait 27.2
lifestyle 26
man 25.5
cheerful 24.4
senior 24.4
outdoors 23.9
joy 23.4
adult 23
playing 22.8
togetherness 22.7
outdoor 21.4
little 21.2
person 20
kids 19.8
couple 19.2
son 19.1
play 19
outside 18.8
summer 18.7
dad 18.5
home 18.4
cute 17.2
husband 17.2
casual 17
leisure 16.6
sister 16.6
girls 16.4
laughing 16.1
sibling 16
brother 15.8
mature 15.8
enjoying 15.2
swing 15.1
grass 15
baby 15
day 14.9
youth 14.5
women 14.2
sitting 13.7
retired 13.6
two 13.6
elderly 13.4
enjoy 13.2
adorable 12.9
relaxing 12.7
blond 12
garden 11.7
grandma 11.6
retirement 11.5
wife 11.4
face 11.4
group 11.3
mom 10.7
affectionate 10.6
affection 10.6
loving 10.5
grandfather 10.1
generations 9.9
mum 9.8
parents 9.8
old 9.8
autumn 9.7
toddler 9.6
playful 9.5
friends 9.4
relaxed 9.4
care 9.1
active 9
granddaughter 8.9
parenting 8.8
grandmother 8.8
boys 8.7
30s 8.7
generation 8.6
laugh 8.6
walk 8.6
joyful 8.3
countryside 8.2
indoor 8.2
hat 8.2
healthy 8.2
meadow 8.1
recreation 8.1
hair 7.9
indoors 7.9
couch 7.7
attractive 7.7
four 7.7
relax 7.6
enjoyment 7.5
relationship 7.5
friendship 7.5
camera 7.4
holiday 7.2
handsome 7.1
clothing 7.1

Google
created on 2022-01-22

Clothing 98.7
Face 98.4
Photograph 94.2
Smile 92.4
Plant 87.1
Grass 84.1
People in nature 83.7
Happy 83.2
Shorts 83.1
Tree 81.5
People 79
Leisure 78.6
Fun 77.6
Toddler 77.3
Vintage clothing 74.8
Snapshot 74.3
Event 71.5
Child 71.1
Chair 71
Family reunion 70.7

Microsoft
created on 2022-01-22

clothing 99
human face 98.4
baby 98.2
person 97
outdoor 96.9
smile 96.9
toddler 94
child 86.2
family 81.2
woman 74.9
boy 64.2
text 60
old 59.8
posing 46

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Female, 94.3%
Happy 89%
Confused 3.8%
Calm 2.4%
Angry 2.3%
Disgusted 0.9%
Surprised 0.8%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 4-12
Gender Male, 100%
Calm 60.5%
Happy 23.4%
Confused 9.9%
Angry 1.9%
Surprised 1.4%
Disgusted 1.3%
Sad 0.8%
Fear 0.7%

AWS Rekognition

Age 52-60
Gender Male, 100%
Happy 61.8%
Calm 26.5%
Confused 4.5%
Angry 2.5%
Disgusted 1.5%
Sad 1.2%
Fear 1.1%
Surprised 0.9%

AWS Rekognition

Age 48-54
Gender Female, 99.9%
Calm 77.9%
Confused 13.8%
Sad 3%
Happy 2.1%
Angry 1.3%
Disgusted 1.1%
Fear 0.4%
Surprised 0.4%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Chair 98.8%

Captions

Microsoft

Larry McReynolds, Spring Byington sitting posing for the camera 93.6%
Larry McReynolds, Spring Byington posing for a photo 91.2%
Larry McReynolds, Spring Byington posing for a picture 91.1%