Human Generated Data

Title

Ellamore, West Virginia

Date

1974

People

Artist: Dennis Feldman, American born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, 2018.286

Human Generated Data

Title

Ellamore, West Virginia

People

Artist: Dennis Feldman, American born 1946

Date

1974

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, 2018.286

Machine Generated Data

Tags

Amazon
created on 2023-01-24

Living Room 100
Furniture 100
Indoors 100
Room 100
Building 100
Architecture 100
Screen 100
Computer Hardware 100
Hardware 100
Electronics 100
Person 99.5
Teen 99.5
Boy 99.5
Male 99.5
TV 99.5
Person 99.3
Baby 99.3
Shoe 98.7
Footwear 98.7
Clothing 98.7
Shoe 97.2
Person 96.7
Painting 95.2
Art 95.2
Interior Design 93.5
Person 93.4
Home Decor 89.9
Rug 89.3
Couch 88
Painting 85.6
Monitor 80.7
Person 79.5
Face 74.7
Head 74.7
Handbag 68.1
Bag 68.1
Accessories 68.1
Person 65.3
Cushion 57.7
Rug 56.1
Back 55.8
Body Part 55.8
Sitting 55.7
Flooring 55.6
Floor 55.6
Fireplace 55.2

Clarifai
created on 2023-10-13

people 99.8
room 99.5
monochrome 99.1
furniture 99.1
analogue 95.8
adult 95.2
indoors 94.7
chair 94.5
seat 94.3
portrait 94.2
one 93.6
home 92.2
family 92
art 91.7
street 88.8
man 86.7
woman 86
sofa 85.8
music 84.6
easy chair 82.7

Imagga
created on 2023-01-24

man 33.6
room 33.3
people 29
home 28.7
person 27.5
indoors 27.2
adult 27.1
computer 25.2
male 24.2
sitting 24
indoor 21
office 20.1
interior 19.4
barbershop 19
couch 18.4
chair 17.7
laptop 17.4
lifestyle 17.3
shop 17.3
business 17
happy 16.9
working 16.8
work 16.1
table 16.1
smiling 15.2
house 14.2
relaxing 13.6
looking 13.6
communication 13.4
salon 13.3
businessman 13.2
meeting 13.2
classroom 13.2
mercantile establishment 13
casual 12.7
living 12.3
couple 12.2
women 11.9
desk 11.6
attractive 11.2
corporate 11.2
men 11.2
happiness 11
child 10.8
smile 10.7
30s 10.6
restaurant 10.4
portrait 10.4
professional 10.3
luxury 10.3
relax 10.1
20s 10.1
horizontal 10
relaxation 10
businesswoman 10
modern 9.8
cheerful 9.8
together 9.6
furniture 9.4
relaxed 9.4
mature 9.3
phone 9.2
leisure 9.1
alone 9.1
newspaper 9
team 9
sofa 8.9
bedroom 8.9
technology 8.9
family 8.9
place of business 8.9
love 8.7
education 8.7
executive 8.6
screen 8.6
talking 8.6
businesspeople 8.5
adults 8.5
keyboard 8.4
old 8.4
seat 8.3
student 8.2
one 8.2
cup 8.1
worker 8.1
group 8.1
job 8
living room 7.8
clothing 7.8
color 7.8
apartment 7.7
comfortable 7.6
two 7.6
resting 7.6
kin 7.5
senior 7.5
holding 7.4
notebook 7

Google
created on 2023-01-24

Microsoft
created on 2023-01-24

text 98.9
furniture 97.5
couch 95.4
black and white 95.1
indoor 94.8
bed 92.1
house 92
pillow 70.5
sofa bed 57.3
curtain 56.6
bedroom 54.5
chair 51.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-47
Gender Male, 99.8%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 11-19
Gender Female, 94.3%
Sad 100%
Fear 7.9%
Surprised 6.4%
Calm 2.4%
Disgusted 0.4%
Confused 0.4%
Angry 0.3%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Female, 68.6%
Happy 85.2%
Fear 9.2%
Surprised 6.6%
Sad 3.3%
Calm 2.8%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 33-41
Gender Female, 99.1%
Sad 78.1%
Fear 53.3%
Calm 12.5%
Surprised 7%
Disgusted 2.3%
Angry 2.2%
Confused 2.2%
Happy 0.5%

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Teen 99.5%
Boy 99.5%
Male 99.5%
Baby 99.3%
Shoe 98.7%
Painting 95.2%
Rug 89.3%
Couch 88%
Monitor 80.7%
Handbag 68.1%

Captions

Microsoft
created on 2023-01-24

a person sitting on a couch 77.7%
a person sitting on a bed 70.5%
a person sitting on a couch 70.4%

Text analysis

Google

MOTHER 300 **** AND 1919
MOTHER
300
****
AND
1919