Human Generated Data

Title

Jackie & Jamie Taylor, Boston Medical Center

Date

2007

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, 2008.90

Copyright

© Nicholas Nixon

Human Generated Data

Title

Jackie & Jamie Taylor, Boston Medical Center

People

Artist: Nicholas Nixon, American born 1947

Date

2007

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, 2008.90

Copyright

© Nicholas Nixon

Machine Generated Data

Tags

Amazon
created on 2019-08-08

Human 100
Face 100
Head 98.3
Person 95.7
Person 90.8
Baby 86.7
Photography 85.1
Photo 85.1
Portrait 85.1
Newborn 80.8
Smile 80.5
Finger 75.2
Skin 61.1
Selfie 61.1

Clarifai
created on 2019-08-08

people 99.9
portrait 99.8
adult 99.3
child 99
two 98.9
baby 98.8
one 98.6
son 98.2
man 97.7
facial expression 97.6
monochrome 97.3
wear 95.7
offspring 93.6
woman 93.1
affection 90.7
love 86.9
girl 86.7
face 86.3
side view 83.8
three 81.1

Imagga
created on 2019-08-08

child 85
parent 51.5
father 49.3
male 48.7
son 48.1
dad 47.6
man 36.3
family 34.7
mother 33.9
happy 33.2
love 30
portrait 28.5
people 26.2
smiling 25.3
baby 23.9
together 23.7
boy 23.5
smile 22.1
couple 21.8
person 21.7
adult 21.3
home 20.7
happiness 20.4
kid 19.5
juvenile 19.1
cute 17.2
face 17
daughter 16.5
childhood 16.1
handsome 16
care 15.6
affection 15.5
offspring 15.4
lifestyle 15.2
little 15
hug 14.5
senior 14.1
attractive 14
newborn 13.6
fun 13.5
husband 13.4
grandfather 13.2
casual 12.7
married 12.5
sitting 12
black 12
affectionate 11.6
wife 11.4
old 11.1
life 11.1
children 10.9
brother 10.7
infant 10.6
indoors 10.5
elderly 10.5
togetherness 10.4
eyes 10.3
cheerful 9.8
youth 9.4
hospital 9.4
mature 9.3
inside 9.2
playing 9.1
holding 9.1
healthy 8.8
hugging 8.8
30s 8.7
joy 8.4
park 8.2
looking 8
grandmother 7.8
color 7.8
men 7.7
health 7.6
toddler 7.6
loving 7.6
two 7.6
ethnic 7.6
hand 7.6
relationship 7.5
hold 7.4
sibling 7.4

Google
created on 2019-08-08

Photograph 96.7
Face 96.4
People 94.1
Snapshot 83.9
Forehead 82.2
Child 78.5
Smile 72.9
Photography 70.6
Black-and-white 68.3
Adaptation 67
Stock photography 59.4
Father 56.1
Mother 54.1
Portrait 53.5
Family 50.2

Microsoft
created on 2019-08-08

person 99.8
human face 98.8
baby 98
man 97.7
toddler 95.6
child 94.1
smile 85.8
text 82.3
face 75.1
smiling 74.3
boy 70.6
portrait 68.3
posing 66.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 98%
Surprised 19.6%
Angry 5.9%
Fear 3.7%
Sad 30.1%
Calm 32.5%
Happy 1.6%
Confused 3.1%
Disgusted 3.4%

AWS Rekognition

Age 0-3
Gender Male, 97.6%
Calm 11.8%
Disgusted 0.5%
Angry 0.6%
Confused 1.2%
Happy 0.5%
Surprised 0.1%
Sad 84.3%
Fear 1%

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.7%

Categories

Imagga

people portraits 87.5%
paintings art 12.4%

Text analysis

Google

UVVV
UVVV