Human Generated Data

Title

Untitled (studio portrait of boy with two younger twin sisters)

Date

1940

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10157

Human Generated Data

Title

Untitled (studio portrait of boy with two younger twin sisters)

People

Artist: Martin Schweig, American 20th century

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.9
Human 98.9
Person 98.5
People 98
Person 97.6
Family 95.6
Face 80.7
Girl 64.8
Female 64.8
Hair 60.3
Teen 57.3

Imagga
created on 2022-01-22

mother 68
parent 54.2
kin 46
family 40.9
happy 38.9
couple 37.5
people 35.2
child 34.5
daughter 32.8
love 32.4
man 32.3
male 31.2
smile 30.7
together 26.3
happiness 25.9
home 24.7
portrait 24.6
groom 24
father 23.5
two 22.9
smiling 22.4
adult 22
husband 21.3
son 19
boy 18.3
married 18.2
wife 18
relationship 16.9
kid 16.9
domestic 16.8
indoors 16.7
lifestyle 15.9
cheerful 15.5
dad 15.2
face 14.9
bride 14.4
childhood 14.3
joy 14.2
attractive 14
person 13.9
children 13.7
women 13.5
marriage 13.3
little 13.3
senior 13.1
cute 12.9
wedding 12.9
fun 12.7
dress 12.7
pretty 12.6
laughing 12.3
friends 12.2
sibling 12.1
old 11.9
grandmother 11.8
romance 11.6
sitting 11.2
casual 11
day 11
playing 10.9
parents 10.8
infant 10.6
lady 10.6
toddler 10.5
loving 10.5
baby 10.3
men 10.3
holding 9.9
affectionate 9.7
affection 9.7
looking 9.6
bow tie 9.6
elderly 9.6
pair 9.5
togetherness 9.4
expression 9.4
mature 9.3
romantic 8.9
celebration 8.8
mom 8.7
enjoying 8.5
youth 8.5
fashion 8.3
care 8.2
indoor 8.2
grandma 8.1
group 8.1
handsome 8
parenting 7.9
life 7.8
parenthood 7.8
two people 7.8
kids 7.5
friendship 7.5
teen 7.4
girls 7.3
necktie 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

human face 99.7
wall 98.1
person 98
clothing 97.3
text 94.8
posing 85.9
indoor 85.9
old 77.9
smile 76.8
girl 74.7
child 73.4
black 72.8
portrait 69.3
boy 66.3
woman 59.2
vintage clothing 51.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 7-17
Gender Male, 99.9%
Calm 100%
Confused 0%
Angry 0%
Sad 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 6-16
Gender Female, 82.8%
Calm 99.5%
Confused 0.3%
Surprised 0%
Angry 0%
Sad 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 4-12
Gender Female, 100%
Calm 99.9%
Sad 0%
Confused 0%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 13
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people posing for a photo 97.4%
a group of people posing for the camera 97.3%
an old photo of a group of people posing for the camera 96%

Text analysis

Amazon

PROOF
SCHWEIG
LOUIS
MARTIN SCHWEIG
SAINT LOUIS
MARTIN
SAINT
At

Google

PROOF MARTIN SCHWEIG SAINT LOUIS
PROOF
MARTIN
SCHWEIG
LOUIS
SAINT