Human Generated Data

Title

Untitled (woman in cardigan sweater and pearls holding hand of little girl on her lap)
Date

c. 1940, printed later
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12839

Human Generated Data

Title

Untitled (woman in cardigan sweater and pearls holding hand of little girl on her lap)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.7
Person 99.7
Person 99.1
Display 98.2
Monitor 98.2
Electronics 98.2
Screen 98.2
LCD Screen 86.5
Indoors 81
TV 78.8
Television 78.8
Apparel 72
Clothing 72
Fireplace 72
People 60.4
Hearth 57.3
Female 56.9
Room 56.2

Clarifai
created on 2019-11-16

people 99.9
portrait 99.1
two 98.1
woman 96.9
adult 96.7
child 96.7
monochrome 96.3
family 95.7
actress 95.4
man 95.1
group 94.3
music 92.6
movie 92
offspring 91.5
facial expression 91.3
love 90.9
girl 90.2
baby 90
son 88.1
wear 87.7

Imagga
created on 2019-11-16

parent 40.5
man 36.3
dad 34.5
couple 34
people 32.9
father 31.8
male 31.4
mother 30.6
adult 30.5
happy 28.2
love 27.6
attractive 25.9
world 25.7
portrait 24
happiness 23.5
computer 22.7
child 21.6
kin 20.9
face 20.6
handsome 19.6
smiling 19.5
laptop 19.5
home 19.2
indoor 18.3
husband 18.1
lifestyle 18.1
together 17.5
casual 17
person 16.9
indoors 16.7
boyfriend 16.4
smile 16.4
girlfriend 16.4
expression 16.2
pretty 16.1
businessman 15.9
sitting 15.5
looking 15.2
business 15.2
office 14.5
family 14.2
black 13.9
wife 13.3
relationship 13.1
20s 12.8
horizontal 12.6
30s 12.5
loving 12.4
boy 12.2
suit 11.7
dark 11.7
cute 11.5
fashion 11.3
daughter 11.3
sexy 11.3
two 11
grand piano 10.8
sibling 10.7
couch 10.6
job 10.6
working 10.6
brunette 10.5
desk 10.4
men 10.3
room 10.2
work 10.2
executive 10.1
clothing 9.9
romance 9.8
groom 9.8
25 30 years 9.8
cheerful 9.8
lady 9.7
piano 9.7
fun 9.7
hug 9.7
hair 9.5
women 9.5
businesspeople 9.5
corporate 9.5
togetherness 9.4
youth 9.4
manager 9.3
joy 9.2
studio 9.1
romantic 8.9
group 8.9
hugging 8.8
comfort 8.7
boss 8.6
model 8.6
adults 8.5
career 8.5
leisure 8.3
confident 8.2
technology 8.2
adolescent 8.1
day 7.9
their 7.8
half length 7.8
color 7.8
professional 7.7
modern 7.7
married 7.7
formal 7.6
skin 7.6
tie 7.6
living 7.6
erotic 7.6
communication 7.6
passion 7.5
enjoyment 7.5
one 7.5
holding 7.4
camera 7.4
emotion 7.4
make 7.3
lovely 7.1
kid 7.1
baby 7.1

Google
created on 2019-11-16

Photograph 97.4
People 94.1
Black-and-white 91.8
Photographic paper 91
Snapshot 89.1
Photography 84.4
Monochrome 81.2
Monochrome photography 78.5
Child 72.8
Room 71.4
Fun 70.4
Stock photography 68.5
Picture frame 63.8
Family 60.7
Portrait 56.7
Style 54.3
Smile 54
Father 52.9
Flash photography 51.3
Baby 50.9

Microsoft
created on 2019-11-16

person 99.2
human face 98.5
smile 97.4
text 96.6
clothing 96.3
baby 94.1
electronics 90.6
toddler 90.1
posing 78.3
black 77.3
black and white 70.8
woman 63.4
white 60.1
boy 56.8
girl 53.2
display 43.9
image 31.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-30
Gender Female, 99.3%
Angry 1.5%
Happy 91.7%
Disgusted 1.9%
Confused 0.9%
Surprised 0.7%
Calm 2.5%
Fear 0.5%
Sad 0.3%

AWS Rekognition

Age 2-8
Gender Female, 98.2%
Happy 92.2%
Calm 5.7%
Disgusted 1%
Surprised 0.2%
Fear 0.1%
Sad 0.2%
Confused 0.3%
Angry 0.3%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a black and white photo of a woman 90.7%
a woman posing for a photo in front of a television 84.4%
a woman posing for a photo 84.3%