Human Generated Data

Title

Untitled (mother smiling with newborn twins)

Date

1956

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18306

Human Generated Data

Title

Untitled (mother smiling with newborn twins)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-31

Furniture 99.7
Chair 99.3
Couch 95.3
Bed 95.1
Room 92.8
Indoors 92.8
Living Room 87.8
Human 85.3
Person 84.4
Bedroom 81.1
Clinic 73.1
Apparel 65.6
Clothing 65.6
Screen 62.9
Electronics 62.9
Monitor 62.9
Display 62.9
Table 59.3
LCD Screen 58.1
Home Decor 57.1
Linen 57.1
Photo 55.4
Photography 55.4

Clarifai
created on 2019-07-31

people 99.5
man 98.9
adult 98.3
indoors 96.3
one 96.3
sit 94.1
furniture 93
room 92.9
two 92.5
family 90.5
seat 88.5
reclining 88.1
woman 87
chair 86.7
portrait 85.9
monochrome 85.7
wear 84.2
patient 83.2
music 81.4
facial expression 78.6

Imagga
created on 2019-07-31

room 34.2
home 31.1
adult 27.4
person 25.9
man 25.5
sitting 24
chair 22.8
couch 22.2
people 21.7
indoors 21.1
happy 20.7
male 20.6
interior 20.3
house 20
bedroom 20
patient 18.5
sofa 18.3
seat 17.9
bed 17.3
modern 15.4
pillow 14.9
living 14.2
furniture 14
smiling 13.7
armchair 13.6
casual 13.5
lifestyle 13
cheerful 13
attractive 12.6
happiness 12.5
device 12.5
portrait 12.3
couple 12.2
health 11.8
human 11.2
inside 11
window 11
work 11
indoor 10.9
relaxing 10.9
smile 10.7
case 10.6
senior 10.3
leisure 10
hospital 9.8
fun 9.7
rest 9.7
comfort 9.6
support 9.6
comfortable 9.5
grandfather 9.5
sit 9.5
men 9.4
luxury 9.4
relax 9.3
electric chair 9
family 8.9
sick person 8.9
table 8.9
medicine 8.8
life 8.8
lamp 8.7
love 8.7
resting 8.6
reading 8.6
fashion 8.3
light 8
clothing 8
television 7.9
women 7.9
business 7.9
face 7.8
apartment 7.7
relaxation 7.5
joy 7.5
laptop 7.5
floor 7.4
care 7.4
glasses 7.4
lady 7.3
nurse 7.2
instrument of execution 7.2
child 7.2
looking 7.2

Google
created on 2019-07-31

Photograph 95.5
White 95.5
Black 94.8
Snapshot 84.9
Black-and-white 82.7
Sitting 74.5
Room 71.4
Monochrome 64.3
Photography 62.4
Chair 57.9
Monochrome photography 57.8
Furniture 56.7
Style 53.5
Family 51

Microsoft
created on 2019-07-31

furniture 94.9
sitting 94.4
bed 88.2
text 74.1
couch 69.7
black and white 64.5
pillow 63.7
chair 51.6

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 76.3%
Sad 1.8%
Confused 1.7%
Disgusted 0.4%
Angry 1.5%
Calm 1.1%
Surprised 2.8%
Happy 90.6%

AWS Rekognition

Age 23-38
Gender Male, 53.1%
Happy 45.1%
Angry 45.2%
Surprised 45.2%
Calm 53.1%
Confused 45.3%
Disgusted 45.1%
Sad 46.1%

Feature analysis

Amazon

Bed 95.1%
Person 84.4%

Captions

Microsoft

a man sitting on a bed 83.2%
a man and a woman sitting on a bed 62.2%
a man sitting on top of a bed 62.1%

Text analysis

Amazon

EITW
NAAOY

Google

MJI3--YT 33A AGO
33A
MJI3--YT
AGO