Human Generated Data

Title

Eleventh Birthday Party at the Sabatine’s, Martins Creek, Pa.

Date

1980

People

Artist: Larry Fink, American 1941 - 2023

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of George and Alexandra Stephanopoulos, 2012.246

Copyright

© Larry Fink

Human Generated Data

Title

Eleventh Birthday Party at the Sabatine’s, Martins Creek, Pa.

People

Artist: Larry Fink, American 1941 - 2023

Date

1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of George and Alexandra Stephanopoulos, 2012.246

Copyright

© Larry Fink

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Couch 99.9
Furniture 99.9
Human 99.9
Person 99.9
Person 99.8
Person 99.5
Person 99.3
Person 99.3
Person 98
Person 97
Clothing 93.9
Apparel 93.9
People 91.4
Person 88.6
Living Room 85.9
Room 85.9
Indoors 85.9
Face 77.6
Family 72.6
Photography 56.7
Photo 56.7
Display 56.1
Monitor 56.1
Electronics 56.1
LCD Screen 56.1
Screen 56.1

Clarifai
created on 2018-02-09

people 99.8
group 99.1
child 98.8
woman 96.2
man 95.5
portrait 95
family 95
monochrome 94.4
group together 93.2
music 92.8
adult 90.4
recreation 89.6
facial expression 87.3
boy 87.3
wear 86.6
son 86.5
actor 84.6
fear 84.3
movie 84.2
adolescent 84.1

Imagga
created on 2018-02-09

uniform 31.1
clothing 29.4
person 24.7
man 24.2
covering 20.8
black 20.7
male 19.1
people 18.4
adult 16.3
portrait 14.2
dark 14.2
face 13.5
hair 13.5
model 13.2
fashion 12.8
attractive 12.6
lady 12.2
business 12.1
office 12
one 11.9
sexy 11.2
old 11.1
dress 10.8
device 10.4
clothes 10.3
world 10.1
happy 10
vintage 9.9
pretty 9.8
style 9.6
looking 9.6
couple 9.6
smile 9.3
jacket 9.2
indoor 9.1
pose 9.1
human 9
brunette 8.7
light 8.7
art 8.7
expression 8.5
work 7.8
boy 7.8
commodity 7.5
symbol 7.4

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

wall 96.7
person 93.7
posing 88.1
group 74.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-27
Gender Male, 91.2%
Happy 0.2%
Disgusted 0.7%
Angry 2.8%
Calm 30.1%
Surprised 0.8%
Sad 62.6%
Confused 2.8%

AWS Rekognition

Age 9-14
Gender Male, 93.5%
Calm 67.2%
Happy 4.1%
Confused 9.3%
Sad 3.4%
Angry 2.4%
Disgusted 1.6%
Surprised 12%

AWS Rekognition

Age 35-52
Gender Male, 94.3%
Happy 0.3%
Sad 24.2%
Calm 48.3%
Confused 21.1%
Angry 2.3%
Disgusted 2%
Surprised 1.7%

AWS Rekognition

Age 14-25
Gender Female, 66.6%
Calm 2.7%
Sad 87.3%
Surprised 0.9%
Happy 2.5%
Confused 1.6%
Angry 3%
Disgusted 2%

AWS Rekognition

Age 4-9
Gender Female, 99.7%
Happy 0.4%
Sad 85.5%
Calm 8.3%
Confused 1.5%
Angry 2.6%
Disgusted 0.9%
Surprised 0.9%

AWS Rekognition

Age 15-25
Gender Male, 98.5%
Happy 1.1%
Surprised 1.5%
Angry 6.4%
Sad 71.9%
Confused 7.4%
Disgusted 0.8%
Calm 10.9%

AWS Rekognition

Age 14-25
Gender Female, 53.9%
Calm 87.6%
Sad 4.3%
Surprised 2.1%
Happy 1.1%
Confused 1.3%
Angry 2.9%
Disgusted 0.7%

AWS Rekognition

Age 10-15
Gender Male, 53.8%
Sad 45.2%
Happy 53.9%
Calm 45.7%
Surprised 45%
Disgusted 45%
Angry 45.1%
Confused 45%

AWS Rekognition

Age 26-44
Gender Female, 50.1%
Surprised 5.5%
Sad 12%
Angry 34.9%
Calm 28.9%
Confused 4.4%
Disgusted 6.8%
Happy 7.6%

AWS Rekognition

Age 26-44
Gender Female, 67.9%
Disgusted 1.2%
Calm 13.3%
Angry 1.9%
Happy 1%
Confused 2.7%
Sad 78.9%
Surprised 1%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Text analysis

Amazon

cen
GHE
t cen
GHE FOn
FOn
t
I2s

Google

$0nz
$0nz