Human Generated Data

Title

Untitled (man, woman, and three children in living room)

Date

1946

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15992

Human Generated Data

Title

Untitled (man, woman, and three children in living room)

People

Artist: Jack Gould, American

Date

1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15992

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Person 98.5
Human 98.5
Furniture 97.8
Person 97.7
Couch 97.6
Living Room 97.5
Room 97.5
Indoors 97.5
Monitor 88.7
Display 88.7
Screen 88.7
Electronics 88.7
Person 87.7
Chair 87.4
Person 84.2
Interior Design 84.1
Person 78.9
Painting 78.2
Art 78.2
Sitting 75.9
Home Decor 73.6
Bed 71.6
Clothing 66.3
Apparel 66.3
Curtain 64
People 60.4
TV 60.1
Television 60.1
LCD Screen 59.6
Female 56.6
Table Lamp 55.3
Lamp 55.3
Flooring 55.2
Shorts 55.2

Clarifai
created on 2023-10-29

people 99.9
room 99.8
seat 99.1
furniture 99.1
two 98.6
chair 98.5
home 97.4
family 96.6
indoors 96.5
adult 95.4
woman 95
child 94.5
easy chair 93.3
group 93.2
sit 93.2
curtain 92.3
three 91.9
sofa 90
offspring 89
four 88.7

Imagga
created on 2022-03-25

chair 47.9
rocking chair 44.3
sliding door 28.9
seat 27.9
home 27.1
door 25
man 22.8
furniture 22.8
room 22.2
adult 20.8
happy 20
person 19.8
indoors 19.3
people 18.4
love 18.1
male 17.8
family 17.8
couple 17.4
women 17.4
movable barrier 17.4
indoor 17.3
happiness 17.2
sitting 17.2
lifestyle 16.6
mother 16.4
portrait 16.2
couch 15.5
together 14
house 13.4
living 13.3
senior 13.1
interior 12.4
parent 12.3
window 12.3
child 12.2
casual 11.9
aged 11.8
barrier 11.6
smiling 11.6
loving 11.4
old 11.1
domestic 11
face 10.7
elderly 10.5
attractive 10.5
smile 10
retired 9.7
sofa 9.6
looking 9.6
grandfather 9.5
men 9.4
togetherness 9.4
furnishing 9.4
day 9.4
mature 9.3
modern 9.1
children 9.1
cheerful 8.9
affection 8.7
architecture 8.6
husband 8.6
adults 8.5
enjoyment 8.4
relationship 8.4
black 8.4
screen 8.4
20s 8.2
dress 8.1
computer 8.1
fireplace 8
light 8
living room 7.8
color 7.8
model 7.8
elegant 7.7
hospital 7.6
joy 7.5
clothing 7.5
holding 7.4
television 7.4
inside 7.4
daughter 7.3
alone 7.3
lady 7.3

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

indoor 96.6
floor 91.6
window 88.8
house 82.2
room 73.7
wedding dress 60.4
bed 57.9
clothing 53.6
person 52
dress 51.8
furniture 30.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 97%
Confused 2.1%
Disgusted 0.2%
Surprised 0.2%
Angry 0.2%
Sad 0.2%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 10-18
Gender Female, 99.5%
Happy 98.9%
Surprised 0.5%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 100%
Happy 98.2%
Calm 0.7%
Surprised 0.3%
Angry 0.2%
Sad 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 0-3
Gender Female, 66.4%
Calm 98.4%
Surprised 0.8%
Happy 0.5%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0%
Angry 0%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Bed
Person 98.5%
Person 97.7%
Person 87.7%
Person 84.2%
Person 78.9%
Painting 78.2%
Bed 71.6%