Human Generated Data

Title

Pat Sabatine’s Eighth Birthday Party

Date

April 1977

People

Artist: Larry Fink, American 1941 - 2023

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of George and Alexandra Stephanopoulos, 2014.473

Copyright

© Larry Fink

Human Generated Data

Title

Pat Sabatine’s Eighth Birthday Party

People

Artist: Larry Fink, American 1941 - 2023

Date

April 1977

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of George and Alexandra Stephanopoulos, 2014.473

Copyright

© Larry Fink

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.9
Human 99.9
Person 99.8
Person 99.8
Clothing 99.2
Apparel 99.2
Pants 91
Sleeve 86.8
Shorts 81.4
Face 78
People 76.7
Wood 69.8
Long Sleeve 66.5
Couch 64.6
Furniture 64.6
Shirt 57.7
Chair 56.2
Denim 55.7
Jeans 55.7
Building 55.2
Housing 55.2

Clarifai
created on 2018-02-09

people 99.7
group 98.7
adult 98.2
woman 97.9
man 97.6
two 95.3
family 92.6
administration 91
several 90.1
portrait 89.2
music 88.5
wear 87.7
facial expression 85.7
movie 85.5
leader 85.3
actress 85.2
three 85
interaction 84.2
home 83.3
group together 82.4

Imagga
created on 2018-02-09

person 27.6
adult 26.5
people 23.4
fashion 23.4
man 20.8
portrait 20.7
attractive 20.3
model 20.2
crutch 19.4
male 18.7
black 18.3
hair 18.2
world 16.7
dark 16.7
sexy 16.1
one 15.7
lady 15.4
dress 15.4
body 15.2
happy 15
staff 15
couple 14.8
style 14.1
human 13.5
face 13.5
passion 13.2
lifestyle 13
expression 12.8
sensual 12.7
stick 12.7
pretty 11.9
smile 11.4
erotic 11.3
pleasure 11.3
blond 11.2
love 11
elegance 10.9
sensuality 10.9
interior 10.6
looking 10.4
clothes 10.3
fun 9.7
together 9.6
seductive 9.6
rain 9.4
enjoy 9.4
room 9.1
sibling 9.1
old 9.1
posing 8.9
women 8.7
happiness 8.6
jeans 8.6
sitting 8.6
two 8.5
light 8.2
smiling 8
mother 7.8
passionate 7.8
splashes 7.8
men 7.7
skin 7.6
gesture 7.6
studio 7.6
vintage 7.4
guy 7.4
art 7.2

Google
created on 2018-02-09

people 96.3
photograph 96
white 95.8
black 95.4
man 94.7
person 94.2
facial expression 93.6
standing 87.4
black and white 85.4
emotion 84.6
photography 82.6
snapshot 81.8
male 81.6
fun 80.5
sitting 79.9
smile 75.4
human 73.5
interaction 73.5
monochrome photography 69.4
monochrome 63.9

Microsoft
created on 2018-02-09

person 99.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Male, 99.8%
Disgusted 7.3%
Happy 54%
Surprised 3.6%
Angry 4.2%
Calm 21.8%
Sad 3.3%
Confused 6%

AWS Rekognition

Age 35-52
Gender Female, 99.6%
Calm 0.1%
Sad 0.2%
Happy 96.8%
Angry 0.4%
Surprised 1.1%
Disgusted 0.6%
Confused 0.7%

AWS Rekognition

Age 38-59
Gender Female, 58.4%
Disgusted 0.8%
Confused 2.3%
Happy 4.2%
Angry 2.8%
Calm 85%
Surprised 1.9%
Sad 3%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Chair 56.2%

Categories

Imagga

people portraits 51.4%
events parties 48.5%