Human Generated Data

Title

Untitled (two photographs: studio portraits of woman with baby girl in white dress)

Date

c. 1920-1940, printed later

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12326

Human Generated Data

Title

Untitled (two photographs: studio portraits of woman with baby girl in white dress)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1920-1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Furniture 99.9
Human 98.7
Person 98.7
Person 98.6
Person 97.5
Person 97.4
Crib 96.3
Baby 79.2
Newborn 69.5
Bed 64.7
Advertisement 61.6
Poster 61.6
Cradle 56.8

Clarifai
created on 2019-11-16

people 100
group 99.4
child 99.4
actress 97.4
woman 97
adult 96.7
wear 96.3
furniture 95.4
family 95.3
outfit 94.9
two 94.1
three 93.5
offspring 93.3
portrait 93.1
sit 92.3
group together 92.1
four 91.8
room 91.6
facial expression 91.5
man 90.5

Imagga
created on 2019-11-16

groom 100
couple 37.4
bride 33.1
man 31.6
dress 30.7
kin 28.8
love 27.6
people 27.3
wedding 26.7
adult 25.3
portrait 25.2
person 24
male 22.7
attractive 21.7
sexy 20.9
happy 20.7
marriage 19.9
happiness 19.6
two 19.5
fashion 16.6
bouquet 16.2
pretty 16.1
flowers 15.6
gown 15.6
romantic 15.1
waiter 15
smile 15
romance 14.3
businessman 14.1
black 13.8
lady 13.8
face 13.5
elegance 13.4
handsome 12.5
married 12.5
passion 12.2
relationship 12.2
dining-room attendant 12.1
celebration 12
wed 11.8
veil 11.7
bridal 11.7
model 11.7
employee 11.6
family 11.6
business 11.5
women 11.1
suit 10.8
worker 10.7
brunette 10.4
wife 10.4
smiling 10.1
lifestyle 10.1
flower 10
make 10
studio 9.9
style 9.6
head 9.2
sensuality 9.1
pose 9.1
posing 8.9
office 8.8
looking 8.8
together 8.8
hair 8.7
professional 8.6
husband 8.6
elegant 8.6
tie 8.5
holding 8.2
human 8.2
clothing 8
tuxedo 7.9
look 7.9
boy 7.8
ceremony 7.8
sitting 7.7
youth 7.7
chair 7.6
event 7.4
executive 7.4
sensual 7.3
gorgeous 7.2
interior 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

baby 99.6
toddler 99.2
person 98.9
clothing 98.8
human face 98.1
smile 96.4
wall 95.4
child 94.8
text 84.4
boy 79.7
gallery 76.1
girl 72.7
room 41.7
posing 40.2
image 31.7
picture frame 27.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 72.9%
Sad 1.4%
Calm 76.5%
Happy 0.7%
Surprised 5.3%
Disgusted 1.6%
Confused 1.4%
Angry 12.5%
Fear 0.6%

AWS Rekognition

Age 2-8
Gender Female, 56.7%
Disgusted 1.1%
Fear 1%
Confused 3.7%
Angry 35.8%
Calm 30.2%
Surprised 0.7%
Sad 27%
Happy 0.4%

AWS Rekognition

Age 13-25
Gender Female, 82.9%
Happy 8.8%
Angry 0.9%
Disgusted 1.2%
Surprised 1.5%
Sad 2.8%
Fear 0.7%
Calm 83%
Confused 1.1%

AWS Rekognition

Age 9-19
Gender Female, 80.6%
Fear 0.2%
Disgusted 0.3%
Calm 83.9%
Angry 0.3%
Sad 1.3%
Surprised 0.4%
Happy 13.1%
Confused 0.4%

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Poster 61.6%

Captions

Microsoft

a group of people sitting in front of a window 75.8%
a man and woman sitting next to a window 55.6%
a person sitting on a bench in front of a window 55.5%

Text analysis

Amazon

MAE

Google

NAGON
EV2LNTn-KODVK
2EMT2A3
NAGON UT 2EMT2A3 EV2LNTn-KODVK
UT