Human Generated Data

Title

Untitled (woman in floral dress with little girl on lap, holding hands, silver bowl of roses to left)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12837

Human Generated Data

Title

Untitled (woman in floral dress with little girl on lap, holding hands, silver bowl of roses to left)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99
Person 99
Person 98.3
Apparel 98.3
Clothing 98.3
Hat 77.6
Finger 66.1
Female 60.4
Girl 57
Fireplace 55.1
Indoors 55.1
Furniture 55
Couch 55

Clarifai
created on 2019-11-16

people 99.9
child 98.7
movie 98.7
actress 98.6
woman 98.1
theater 97.9
music 97.8
family 97.7
group 97.7
portrait 97.3
adult 97.1
sit 95.6
wear 95.2
two 94.8
man 94.8
offspring 94.7
actor 93.7
dancer 92
furniture 92
musician 91.5

Imagga
created on 2019-11-16

world 43.5
man 30.2
parent 29.3
couple 27.9
male 27.7
people 26.8
mother 24.6
portrait 23.9
happy 23.2
love 22.9
child 21.4
kin 21.1
adult 20.9
dad 20.7
father 19.4
black 17.5
happiness 16.5
home 16
together 15.8
attractive 15.4
person 15.1
lifestyle 14.5
husband 14.3
women 14.2
face 14.2
smiling 13.7
looking 13.6
smile 13.5
handsome 13.4
fashion 12.8
boy 12.2
lady 12.2
casual 11.9
dress 11.7
leisure 11.6
romantic 11.6
family 11.6
relationship 11.2
body 11.2
men 11.2
expression 11.1
indoor 11
model 10.9
boyfriend 10.6
girlfriend 10.6
loving 10.5
sexy 10.4
sitting 10.3
hair 10.3
20s 10.1
elegance 10.1
cute 10
sensuality 10
romance 9.8
pretty 9.8
cheerful 9.8
business 9.7
married 9.6
brunette 9.6
wife 9.5
youth 9.4
two 9.3
room 9.2
suit 9
human 9
group 8.9
domestic 8.8
businessman 8.8
couch 8.7
standing 8.7
relaxation 8.4
studio 8.4
one 8.2
interior 8
hug 7.7
comfort 7.7
skin 7.6
tie 7.6
fireplace 7.5
hot 7.5
sibling 7.4
girls 7.3
posing 7.1
day 7.1
indoors 7
clothing 7
look 7

Google
created on 2019-11-16

Photograph 96.9
Black 95.7
People 93.1
Black-and-white 90.7
Snapshot 87.9
Photography 80.6
Room 80.1
Monochrome 79.4
Photographic paper 78.8
Monochrome photography 78.5
Stock photography 66.6
Child 64.5
Family 61.6
Vintage clothing 59
Retro style 57
Style 56
Mother 55.6
Sitting 54.1
Picture frame 52.9
Portrait 51.6

Microsoft
created on 2019-11-16

clothing 98.6
human face 97.9
person 97.1
text 95.5
smile 87.2
dress 85.4
woman 81
black and white 78.1
girl 60.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-20
Gender Female, 88.3%
Disgusted 0.5%
Happy 63.8%
Angry 1%
Confused 3.9%
Calm 14.9%
Fear 3.4%
Sad 10.7%
Surprised 1.8%

AWS Rekognition

Age 2-8
Gender Female, 98.6%
Fear 0.5%
Calm 41%
Disgusted 1.4%
Angry 0.9%
Surprised 0.9%
Happy 53%
Sad 1.2%
Confused 1.1%

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a woman sitting in front of a window 90.8%
a woman sitting on a bench in front of a window 82.3%
a woman sitting next to a window 82.2%