Human Generated Data

Title

Untitled (woman on couch with two children)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.12

Human Generated Data

Title

Untitled (woman on couch with two children)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Furniture 100
Person 99.2
Human 99.2
Person 99
Apparel 98.5
Clothing 98.5
Person 97.7
Couch 96.3
Footwear 93
Shoe 93
Room 83.5
Living Room 83.5
Indoors 83.5
Shorts 83
Chair 77.4
Cushion 73.8
Face 67.2
People 63.1
Baby 61.6
Shoe 55.9
Sitting 55.8
Plant 55.5
Bush 55.5
Vegetation 55.5

Clarifai
created on 2019-03-25

people 99.9
two 99.2
child 99.1
group 98.8
four 98.6
offspring 98.5
sibling 98.4
three 98.1
group together 98
family 97.5
facial expression 97.3
woman 97.2
adult 96.9
actress 95.9
portrait 94.7
man 94.1
furniture 94.1
son 89
sit 87.8
five 87.5

Imagga
created on 2019-03-25

home 47.9
adult 41.5
happy 35.8
couch 33.9
sitting 33.5
sofa 33
couple 32.3
person 30.5
smiling 30.4
people 29
man 28.9
attractive 27.3
indoors 26.4
happiness 25.1
lifestyle 24.6
male 23
armchair 22.6
interior 22.1
casual 22.1
room 21.3
love 19.7
house 19.2
mother 19
pretty 18.9
family 18.7
20s 18.3
relaxing 18.2
child 17.8
together 17.5
portrait 17.5
indoor 17.4
cheerful 17.1
smile 15.7
father 15.5
parent 15.2
seat 14.6
sibling 13.9
sexy 13.7
comfort 13.5
patient 13.4
life 12.8
computer 12.8
looking 12.8
women 12.7
apartment 12.5
comfortable 12.4
living 12.3
adults 12.3
fashion 12.1
kin 11.9
two 11.9
laptop 11.9
living room 11.8
chair 11.8
husband 11.7
leisure 11.6
jeans 11.5
relaxed 11.3
fun 11.2
dad 10.9
horizontal 10.9
cushions 10.9
holding 10.7
handsome 10.7
lady 10.6
bed 10.5
clothing 10.5
inside 10.1
model 10.1
furniture 10
children 10
cushion 9.8
kid 9.8
30s 9.6
brunette 9.6
loving 9.5
hair 9.5
wife 9.5
sick person 9.4
expression 9.4
face 9.2
case 9.2
relaxation 9.2
joyful 9.2
playing 9.1
pillow 8.8
full length 8.7
hug 8.7
boy 8.7
hospital 8.5
females 8.5
sit 8.5
lying 8.5
bedroom 8.4
blond 8.3
technology 8.2
gorgeous 8.2
new 8.1
domestic 7.9
parents 7.8
daughter 7.7
break 7.6
relax 7.6
kids 7.5
joy 7.5
enjoyment 7.5
one 7.5
son 7.4
camera 7.4
girls 7.3
sensual 7.3
sensuality 7.3
color 7.2
nurse 7.2
cute 7.2
childhood 7.2
buddy 7.2
modern 7

Google
created on 2019-03-25

Photograph 97.6
People 96.4
Snapshot 90.8
Photography 81.2
Black-and-white 78.1
Vintage clothing 75.7
Child 74.2
Family 71.8
Sitting 71.1
Fun 70.4
Monochrome 70.2
Room 65.7
Retro style 62.7
Stock photography 62.1
Sibling 59.5
Photo caption 58.3
Classic 56.7
Photographic paper 54.3

Microsoft
created on 2019-03-25

person 99.7
posing 90.6
window 87.8
child 22.1
boy 22
black and white 18.1
baby 12.1
family 12

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 95.1%
Happy 12.6%
Confused 6.4%
Calm 19.5%
Sad 12%
Disgusted 35.6%
Angry 6%
Surprised 7.9%

AWS Rekognition

Age 6-13
Gender Female, 81.9%
Confused 0.8%
Surprised 0.8%
Sad 0.5%
Disgusted 0.2%
Happy 97%
Calm 0.5%
Angry 0.4%

AWS Rekognition

Age 4-7
Gender Female, 87.5%
Angry 1.2%
Happy 89.3%
Sad 2%
Confused 1.9%
Disgusted 0.6%
Surprised 1.7%
Calm 3.3%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Couch 96.3%
Shoe 93%

Captions

Microsoft

a group of people sitting posing for the camera 98.2%
a group of people posing for a photo 97.4%
a group of people sitting posing for a photo 97.3%

Text analysis

Amazon

MARTIN
MARTIN SCHWEIC
SCHWEIC
SAINT
SAINT LOUIS
LOUIS

Google

SCHWEIC
SAINT
MARTIN SCHWEIC SAINT LOUIS
MARTIN
LOUIS