Human Generated Data

Title

Untitled (studio portrait of newlywed couple with woman wearing bow-shaped hat)
Date

1925-1940
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10200

Human Generated Data

Title

Untitled (studio portrait of newlywed couple with woman wearing bow-shaped hat)

People

Artist: Martin Schweig, American 20th century

Date

1925-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Tie 99.8
Accessories 99.8
Accessory 99.8
Person 97.7
Human 97.7
Suit 93.1
Overcoat 93.1
Apparel 93.1
Clothing 93.1
Coat 93.1
Text 92.5
Person 92.1
Sleeve 84.7
People 77.8
Long Sleeve 70.4
White Board 68.5
Tuxedo 57.3
Fashion 57.1

Imagga
created on 2022-01-22

groom 74.3
suit 42.8
man 41.7
person 37.1
business 34.7
businessman 34.5
male 33.5
people 31.8
adult 31.4
office 30.6
happy 28.9
portrait 25.3
attractive 24.5
professional 24.4
handsome 24.1
standing 23.5
corporate 23.2
businesswoman 22.8
executive 22.7
smiling 22.5
work 22
smile 21.4
couple 20.9
job 20.4
confident 20
team 19.7
success 19.3
successful 18.3
tie 17.1
cheerful 16.3
group 16.1
clothing 15.7
happiness 15.7
face 15.6
looking 15.2
love 15
businesspeople 14.3
teamwork 13.9
pretty 13.3
meeting 13.2
company 13
garment 12.9
two 12.7
building 12.7
colleagues 12.6
family 12.5
boss 12.4
lifestyle 12.3
together 12.3
fashion 12.1
modern 11.9
manager 11.2
home 11.2
men 11.2
expression 11.1
indoor 11
jacket 10.9
dress 10.9
worker 10.8
working 10.6
formal 10.5
workplace 10.5
career 10.4
style 10.4
casual 10.2
model 10.1
20s 10.1
communication 10.1
alone 10.1
old 9.8
partners 9.7
coat 9.7
corporation 9.7
mother 9.6
partnership 9.6
leadership 9.6
brunette 9.6
camera 9.3
adolescent 9.2
guy 9.2
friendly 9.2
one 9
lady 8.9
color 8.9
indoors 8.8
confidence 8.6
senior 8.4
studio 8.4
holding 8.3
human 8.3
sexy 8
women 7.9
boy 7.8
black 7.8
only 7.6
husband 7.6
hand 7.6
smart 7.5
juvenile 7.5
care 7.4
occupation 7.3
posing 7.1
bow tie 7.1

Google
created on 2022-01-22

Face 98.3
Smile 94.4
Coat 89.6
Standing 86.4
Gesture 85.3
Tie 84.6
Suit 79.7
Collar 79.1
Blazer 78.2
Vintage clothing 77.2
Formal wear 76.1
Art 73.9
Handwriting 70.9
Fashion design 70.8
Classic 69
Happy 68.4
Autograph 65
Pattern 64.8
Event 64.5
Stock photography 63.7

Microsoft
created on 2022-01-22

person 99.7
posing 99
wall 97.8
standing 96.1
suit 95.3
text 94.9
man 94.9
human face 83
clothing 74.6
handwriting 69
smile 56.5
drawing 54.6
old 48.1
clothes 15.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 100%
Happy 99.3%
Surprised 0.2%
Calm 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 91.9%
Happy 4.6%
Surprised 1.5%
Sad 0.8%
Angry 0.5%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.8%
Person 97.7%
Suit 93.1%

Captions

Microsoft

a man and woman posing for a photo 92.4%
a man and a woman posing for a photo 92.3%
a person standing in front of a group of people posing for a photo 91.8%

Text analysis

Amazon

MARTIN
STUDIO
TEN
AND
DAYS
THE
WITHIN TEN DAYS
THIS
IS
OF
WITHIN
OF THE
SHOULD
BE
AND SHOULD BE RETURNED
d
PROPERTY
RETURNED
MARTIN SCRWBIG STUDIO
on
THIS PUQOF IS THE PROPERTY
be
your on
d there
your
we
SCRWBIG
there
all
lighter
be Alexenting
fill we hali
Take an all
PUQOF
hali
fill
Take an
what
Alexenting
Impformans

Google

diftfene
fell
THIS
POOF
IS
BE
WITHIN
TEN
DAYS
MARTIN
BETURNES
diftfene legken moouth fell THIS POOF IS THE PROPERTY OF THE MARTIN SCAWDIC STUDIO AND SHOULD BE BETURNES WITHIN TEN DAYS
THE
SHOULD
legken
moouth
PROPERTY
OF
SCAWDIC
STUDIO
AND