Human Generated Data

Title

Felicity Then and Now

Date

1980s

People

Artist: Mariette Pathy Allen, American born 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.39

Copyright

© Mariette Pathy Allen

Human Generated Data

Title

Felicity Then and Now

People

Artist: Mariette Pathy Allen, American born 1940

Date

1980s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.4
Human 99.4
Person 99.3
Furniture 98.2
Person 96.6
Sitting 96
Interior Design 90
Indoors 90
Face 86.6
Couch 84.6
Apparel 81.4
Clothing 81.4
Female 70.7
Cushion 66.1
Bed 65.6
Smile 61.8
Room 59.8
Girl 59.1
Chair 58.6
Hair 57.6
Head 57.2
Table 56.3

Imagga
created on 2022-02-26

person 38.7
people 34.6
adult 31.4
man 30.9
home 29.5
director 29.2
office 29.1
sitting 28.4
senior 27.2
male 27
portrait 25.3
business 23.7
happy 23.2
smiling 23.2
computer 22.7
laptop 22.1
indoors 22
executive 21.9
lifestyle 21
mature 20.5
room 19.2
casual 18.7
couple 18.3
work 18.1
elderly 17.3
smile 17.1
looking 16.8
businesswoman 16.4
suit 16.3
desk 16.1
couch 15.5
grandma 15.2
businessman 15
one 14.9
pretty 14.7
corporate 14.6
lady 13.8
professional 13.8
retired 13.6
face 13.5
sofa 13.4
handsome 13.4
happiness 13.3
attractive 13.3
working 13.3
old 13.3
together 13.2
call 13.1
table 13
confident 12.8
job 12.4
glasses 12
alone 11.9
interior 11.5
group 11.3
technology 11.1
husband 10.6
cheerful 10.6
retirement 10.6
look 10.5
success 10.5
wife 10.4
hair 10.3
women 10.3
expression 10.2
successful 10.1
worker 9.9
family 9.8
workplace 9.5
businesspeople 9.5
two 9.3
manager 9.3
mother 9.2
indoor 9.1
holding 9.1
human 9
fun 9
elevator 8.8
grandmother 8.8
middle aged 8.8
love 8.7
education 8.7
bright 8.6
age 8.6
elegant 8.6
tie 8.5
living 8.5
life 8.4
book 8.3
inside 8.3
gray 8.1
brunette 7.8
partner 7.7
scholar 7.7
health 7.6
chair 7.6
hand 7.6
females 7.6
sit 7.6
mobile 7.5
fashion 7.5
teacher 7.4
single 7.4
emotion 7.4
occupation 7.3
stylish 7.2
cup 7.2
blond 7.2
device 7.2
romance 7.2
performer 7.1
lifting device 7.1
spectator 7.1
modern 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 98.9
human face 98.6
clothing 97.2
wall 96.7
indoor 95.8
text 91.4
woman 87.8
smile 80.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Female, 100%
Confused 88.8%
Calm 3.9%
Disgusted 3.6%
Sad 1.3%
Surprised 0.7%
Happy 0.7%
Angry 0.5%
Fear 0.5%

AWS Rekognition

Age 10-18
Gender Female, 100%
Calm 49.2%
Disgusted 39.4%
Sad 6.8%
Angry 1.2%
Surprised 1.1%
Happy 0.9%
Fear 0.7%
Confused 0.6%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 98.5%
Happy 0.6%
Fear 0.3%
Surprised 0.2%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 58.6%

Captions

Microsoft

a person sitting in a room 92.7%
a person sitting on a table 77.4%
a girl sitting on a table 63%