Human Generated Data

Title

Untitled (Miss Schucart to Mr. Shapiro)

Date

c. 1925

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.680

Human Generated Data

Title

Untitled (Miss Schucart to Mr. Shapiro)

People

Artist: Martin Schweig, American 20th century

Date

c. 1925

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.1
Person 99.1
Clothing 98.9
Apparel 98.9
Person 98.7
Evening Dress 87.5
Robe 87.5
Gown 87.5
Fashion 87.5
Military 80.4
Military Uniform 80.4
Face 72.7
Door 67.3
Officer 66.9
Coat 65.4
Overcoat 65.4
Female 64.2
People 62.8
Finger 58.1
Suit 51.3

Imagga
created on 2022-01-08

groom 88.9
man 37.7
person 36.1
couple 34.9
adult 34.4
male 34
portrait 29.8
people 29.6
love 27.6
happy 25.7
bride 25
happiness 23.5
dress 22.6
suit 22.6
wedding 21.2
attractive 21
two 18.7
business 18.2
sexy 17.7
pretty 17.5
smiling 15.9
fashion 15.8
smile 15.7
adolescent 15.4
lady 14.6
romance 14.3
tie 14.2
relationship 14.1
cheerful 13.8
men 13.7
home 13.6
married 13.4
romantic 13.4
marriage 13.3
businessman 13.3
face 12.8
professional 12.8
juvenile 12.6
handsome 12.5
bouquet 12.3
human 12
looking 12
husband 11.7
engagement 11.6
family 11.6
lifestyle 11.6
kin 11.5
together 11.4
brunette 11.3
standing 11.3
office 11.3
mother 10.9
clothing 10.8
parent 10.7
hair 10.3
elegance 10.1
indoor 10
room 10
bow tie 10
holding 9.9
veil 9.8
embracing 9.8
executive 9.7
style 9.7
child 9.6
corporate 9.5
expression 9.4
black 9.3
alone 9.1
modern 9.1
sensuality 9.1
one 9
tuxedo 8.9
interior 8.9
dressed 8.8
flowers 8.7
sitting 8.6
serious 8.6
model 8.6
wife 8.5
adults 8.5
youth 8.5
togetherness 8.5
hand 8.4
job 8
women 7.9
boy 7.8
gown 7.8
hugging 7.8
affectionate 7.7
old 7.7
formal 7.6
loving 7.6
studio 7.6
father 7.5
vintage 7.4
confident 7.3
sensual 7.3
make 7.3
computer 7.2
celebration 7.2
cute 7.2
dad 7.1
posing 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

window 99.4
person 96.9
clothing 95.4
text 94.2
smile 91.7
human face 89.5
gallery 67.9
black 66.5
woman 61.3
old 53.8
vintage clothing 51.3
retro style 50.4
posing 39.5
picture frame 22.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Female, 100%
Calm 93.4%
Happy 4.7%
Surprised 1.5%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%
Angry 0%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 98.9%
Sad 0.3%
Angry 0.2%
Confused 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 51.3%

Captions

Microsoft

a man and a woman standing in front of a window 75.8%
a person sitting in front of a mirror posing for the camera 72.7%
a person standing in front of a mirror posing for the camera 72.6%

Text analysis

Amazon

SCHWEIG
LOUIS
ST. LOUIS
ST.

Google

SCHWEIG
LOUIS
ST.
SCHWEIG ST. LOUIS