Human Generated Data

Title

Untitled (proof print: two women in black dresses with toddler)

Date

1940

People

Artist: Curtis Studio, American active 1891 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1162

Human Generated Data

Title

Untitled (proof print: two women in black dresses with toddler)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Blonde 99.6
Female 99.6
Girl 99.6
Kid 99.6
Human 99.6
Child 99.6
Teen 99.6
Woman 99.6
Person 99.3
Person 99.2
Face 98.8
Person 98.6
Text 88.8
Word 88.3
People 82
Smile 77
Head 74
Advertisement 72.1
Collage 72.1
Photo 71.1
Photography 71.1
Portrait 70.4
Hair 56.6
Highway 56.1
Road 56.1
Freeway 56.1
Poster 55.8
Clothing 55.3
Apparel 55.3

Imagga
created on 2022-01-22

mother 50.7
child 38.3
parent 38.3
brother 38.2
family 36.4
male 31.7
love 31.5
man 28.9
happy 27.6
couple 27
people 26.2
father 25.6
adult 23.3
kin 23.3
portrait 23.3
sibling 22.9
baby 20.6
smiling 20.2
together 20.1
black 19.8
kid 19.5
husband 19.4
smile 18.5
happiness 18
wife 17.1
casual 16.9
women 16.6
boy 16.5
cute 16.5
face 16.3
fun 15
daughter 14.8
two 14.4
son 14.3
human 14.2
lifestyle 13.7
girls 13.7
person 13.6
home 13.6
childhood 13.4
dad 13.3
attractive 12.6
men 12
expression 11.9
joy 11.7
newborn 11.7
little 11.5
hand 11.4
eyes 11.2
clothing 11.1
care 10.7
mom 10.7
infant 10.6
fashion 10.5
body 10.4
hair 10.3
children 10
pretty 9.8
married 9.6
sitting 9.4
youth 9.4
model 9.3
studio 9.1
holding 9.1
blond 8.6
skin 8.5
senior 8.4
head 8.4
grandma 8.3
cheerful 8.1
looking 8
interior 8
parents 7.8
old 7.7
kids 7.5
dark 7.5
hold 7.4
lady 7.3
teenager 7.3
group 7.2
dress 7.2
sexy 7.2
handsome 7.1
posing 7.1

Google
created on 2022-01-22

Hairstyle 95.1
Facial expression 93.2
Coat 88.9
Suit 79.4
Smile 76.6
Vintage clothing 76.1
Picture frame 75.7
Art 74.5
Font 71.4
Toddler 69.1
Oval 68.8
Event 67.5
Room 66.1
History 65.5
Stock photography 65.1
Formal wear 60.2
Baby 60.2
Classic 60.1
Visual arts 59.6
Monochrome 58.5

Microsoft
created on 2022-01-22

text 99.8
human face 98.6
wall 97.4
clothing 96
smile 94.4
person 90.6
baby 84.6
posing 66.6
toddler 64

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Female, 100%
Happy 89.9%
Surprised 2.1%
Calm 1.9%
Fear 1.9%
Angry 1.8%
Disgusted 1.1%
Confused 0.6%
Sad 0.6%

AWS Rekognition

Age 62-72
Gender Female, 100%
Calm 84%
Confused 10.9%
Angry 1.4%
Sad 1.1%
Surprised 0.9%
Happy 0.7%
Disgusted 0.5%
Fear 0.5%

AWS Rekognition

Age 0-3
Gender Female, 100%
Happy 99%
Calm 0.4%
Surprised 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Poster 55.8%

Captions

Microsoft

a person posing for the camera 87.5%
a person holding a sign posing for the camera 53.4%
a boy and a girl posing for a photo 34.2%

Text analysis

Amazon

PROOF
UNFINISHED PROOF
UNFINISHED

Google

PROOF
UNFINISHED PROOF
UNFINISHED