Human Generated Data

Title

Me and Mom's Boyfriend Mr. Art
Date

2005
People

Artist: LaToya Ruby Frazier, American born 1982
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Angela Lorenz in honor of curator emeritus Davis Pratt, 2010.574
Copyright

Me and Mom's Boyfriend Mr. Art, 2005, © LaToya Ruby Frazier

Human Generated Data

Title

Me and Mom's Boyfriend Mr. Art

People

Artist: LaToya Ruby Frazier, American born 1982

Date

2005

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Apparel 99.4
Clothing 99.4
Person 99.2
Human 99.2
Person 91.8
Female 91.6
Furniture 87.8
Woman 82.6
Indoors 79.9
Room 79.9
Fashion 68.6
Gown 68.6
Robe 68.6
Evening Dress 68.6
Sitting 66
Bed 65.3
Door 61.1
Back 57.9
Hair 57.7
Bedroom 55.4
Person 45.9

Clarifai
created on 2018-03-23

people 99.7
two 99.2
adult 98.5
woman 97.8
man 97.3
room 95.8
one 94.4
portrait 93.7
family 93.3
wear 92.4
indoors 91.8
furniture 91.4
child 88.4
sit 86.9
three 85.9
dressing room 84.8
side view 84
group 83.8
sadness 82.9
chair 81.2

Imagga
created on 2018-03-23

call 58.4
man 25.5
male 24.2
people 21.2
person 20.8
fashion 19.6
door 18.3
adult 16.3
device 16.2
black 15.9
portrait 15.5
indoors 14.9
locker 14.7
business 14.6
sliding door 13.9
dress 13.6
elevator 13.5
interior 13.3
style 12.6
office 12.3
attractive 11.9
model 11.7
lifestyle 11.6
clothing 11.5
clothes 11.2
suit 11.2
looking 11.2
pretty 11.2
home 11.2
wardrobe 11.1
fastener 11
lifting device 10.9
posing 10.7
happy 10.7
brunette 10.5
sexy 10.4
men 10.3
wall 10.3
indoor 10
furniture 10
room 10
lady 9.7
couple 9.6
standing 9.6
hand 9.1
human 9
to 8.8
building 8.7
hair 8.7
garment 8.7
robe 8.7
casual 8.5
movable barrier 8.4
modern 8.4
house 8.4
restraint 8.3
alone 8.2
telephone 8.2
shop 8.1
businessman 7.9
life 7.9
urban 7.9
smile 7.8
happiness 7.8
elegant 7.7
old 7.7
city 7.5
holding 7.4
street 7.4
window 7.3
sensual 7.3
student 7.2
pay-phone 7.1

Google
created on 2018-03-23

photograph 95.5
black 95.3
black and white 92.8
monochrome photography 84.5
photography 82.8
snapshot 81.8
sitting 75.7
girl 71.5
monochrome 68.2
window 59

Microsoft
created on 2018-03-23

person 99.5
wall 98.2
indoor 87.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.7%
Angry 13.4%
Confused 3.4%
Disgusted 2.9%
Surprised 2.5%
Calm 23.9%
Sad 53.1%
Happy 0.8%

AWS Rekognition

Age 6-13
Gender Male, 51.5%
Confused 45.1%
Angry 45.1%
Disgusted 45.1%
Sad 45.4%
Happy 53.2%
Calm 45.9%
Surprised 45.2%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man and a woman sitting in a room 81.7%
a man and a woman sitting on a bed 40.4%
a man and a woman standing in a room 40.3%

Text analysis

Amazon

THE
SMIOH