Human Generated Data

Title

Adele Burnes, James Nelson Burnes, and Kennett Farrar Burnes

Date

1915

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.714

Human Generated Data

Title

Adele Burnes, James Nelson Burnes, and Kennett Farrar Burnes

People

Artist: Martin Schweig, American 20th century

Date

1915

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.714

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 98.6
Person 92.7
Clothing 90.4
Apparel 90.4
People 79.6
Wood 77.8
Door 72.7
Art 70.7
Painting 66.6
Face 65.8
Photography 63.5
Photo 63.5
Sculpture 63.4
Shelf 60
Portrait 58.6
Girl 57.9
Female 57.9
Pants 55.7

Clarifai
created on 2023-10-25

people 99.9
child 99.8
sepia 99.7
portrait 99.4
son 99.2
family 98.7
two 98.1
baby 98
group 96.6
sibling 96.2
offspring 96
documentary 95.9
three 95.3
affection 95.2
girl 94.6
nostalgia 94.1
retro 94.1
woman 93.1
adult 92.8
vintage 91.9

Imagga
created on 2022-01-08

grandfather 70.5
family 59.7
home 51.1
grandma 50.5
mother 47.2
male 44.9
happy 42.7
child 38.8
man 37
father 36.2
people 35.2
couple 34
smiling 33.3
together 31.6
parent 30.4
husband 29.6
indoors 29
daughter 28.4
love 27.7
happiness 26.7
senior 26.3
boy 25.3
kid 24.9
adult 24.7
children 24.6
sitting 24.1
casual 23.8
kin 23.4
couch 23.2
lifestyle 23.2
son 23
room 22.8
wife 22.8
baby 22.1
elderly 21.1
cheerful 20.3
portrait 19.4
person 19.3
old 18.8
living room 18.6
mature 18.6
smile 18.6
30s 18.3
loving 18.2
fun 18
retired 17.5
living 17.1
kids 17
joy 16.7
dad 16.5
playing 16.4
sofa 16.3
laughing 16.1
relaxing 15.5
togetherness 15.1
cute 15.1
mom 14.6
face 14.2
interior 14.2
relaxed 14.1
adorable 13.9
indoor 13.7
domestic 13.6
two 13.6
parents 12.7
little 12.4
sibling 12.2
middle aged 11.7
two people 11.7
childhood 11.7
hug 11.6
affectionate 11.6
holding 11.6
retirement 11.5
clothing 11.4
looking 11.2
house 10.9
70s 10.8
parenthood 10.8
thirties 10.7
men 10.3
women 10.3
hospital 10.2
aged 10
care 9.9
generations 9.9
cuddling 9.9
40s 9.7
affection 9.7
married 9.6
four 9.6
illness 9.5
enjoying 9.5
day 9.4
brother 9.3
joyful 9.2
blond 9
medical 8.8
4 8.8
mum 8.8
older 8.8
mid adult 8.7
looking camera 8.7
nurse 8.6
patient 8.5
doctor 8.5
relationship 8.4
horizontal 8.4
color 8.4
camera 8.3
pensioner 8
good mood 7.9
grandmother 7.8
sister 7.8
lounge 7.8
play 7.8
boys 7.8
expression 7.7
health 7.7
talking 7.6
sit 7.6
enjoyment 7.5
leisure 7.5
three 7.5
20s 7.3
group 7.3
handsome 7.1
life 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 99
human face 98.9
clothing 98.7
window 97.4
baby 96.5
toddler 95.4
child 93.8
smile 92.3
text 81.3
girl 62.4
vintage clothing 53
old 49.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 69.7%
Calm 74.6%
Sad 15.4%
Disgusted 3.1%
Confused 2.8%
Fear 1.9%
Angry 1.1%
Happy 0.6%
Surprised 0.5%

AWS Rekognition

Age 18-26
Gender Female, 99.1%
Sad 62.2%
Calm 34.5%
Confused 1.6%
Disgusted 0.6%
Angry 0.5%
Fear 0.3%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 0-4
Gender Male, 92.3%
Calm 99.7%
Sad 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 16
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 66.6%

Categories

Imagga

people portraits 54%
paintings art 45.1%

Text analysis

Amazon

MARTIN
MARTIN SCHWEIG
SCHWEIG

Google

MANTIA SeHwEK
MANTIA
SeHwEK