Human Generated Data

Title

Untitled (portrait of a couple)
Date

c. 1945
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1455

Human Generated Data

Title

Untitled (portrait of a couple)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Suit 99.4
Clothing 99.4
Coat 99.4
Overcoat 99.4
Apparel 99.4
Tie 99.1
Accessories 99.1
Accessory 99.1
Suit 98.3
Person 97.9
Human 97.9
Person 97.7
Face 95.7
Tie 94.1
People 82.7
Female 78.3
Girl 66.7
Shirt 64.4
Jacket 64.4
Portrait 63.1
Photography 63.1
Photo 63.1
Smile 60.8
Blazer 58.3
Family 56.7
Man 56.4
Officer 55.4
Military 55.4
Military Uniform 55.4

Imagga
created on 2022-01-22

suit 76.5
businessman 54
groom 51
man 50.5
bow tie 49
business 45.6
necktie 42.3
garment 40
male 40
corporate 39.6
executive 36.9
office 35.4
person 35.4
people 34.1
businesswoman 31.9
team 31.4
professional 30
successful 27.5
success 27.4
handsome 26.8
adult 26.6
smiling 26.1
clothing 25.9
men 25.8
tie 25.7
meeting 25.5
confident 24.6
happy 24.5
work 24.4
group 23.4
smile 22.9
teamwork 22.3
standing 21.8
portrait 20.1
colleagues 19.5
couple 19.2
company 18.6
formal 18.2
businesspeople 18.1
job 17.7
attractive 17.5
partnership 17.3
expression 17.1
building 16.7
partners 16.6
staff 16.3
boss 16.3
manager 15.9
friendly 15.6
workplace 15.3
looking 15.2
businessmen 14.7
guy 14.4
smart 14.2
two 13.6
worker 13.3
face 12.8
coworkers 12.8
corporation 12.6
leadership 12.5
holding 12.4
black 12.3
modern 11.9
colleague 11.7
employee 11.4
cheerful 11.4
consumer goods 11.3
elegant 11.2
covering 11.1
partner 10.6
married 10.6
together 10.5
human 10.5
love 10.3
hand 9.9
fashion 9.8
entrepreneur 9.6
career 9.5
jacket 9.3
communication 9.3
wedding 9.2
dress 9.1
outdoors 9
businesswomen 8.8
handshake 8.8
cooperation 8.7
women 8.7
happiness 8.6
confidence 8.6
outside 8.6
mature 8.4
lifestyle 8
boy 7.8
model 7.8
deal 7.8
agreement 7.8
diversity 7.7
serious 7.6
commerce 7.5
husband 7.5
adolescent 7.2

Google
created on 2022-01-22

Face 98.3
Smile 98
Outerwear 95.1
Coat 91.4
Gesture 85.3
Collar 83.8
Suit 81
Blazer 77.8
Military person 77.1
Formal wear 77
Vintage clothing 75.9
Tie 75.1
Non-commissioned officer 75
Classic 70.7
Military officer 68.3
White-collar worker 68.2
Event 67.3
Uniform 65.6
History 61.7
Bow tie 58.8

Microsoft
created on 2022-01-22

person 99.7
text 99.2
human face 97.9
smile 97.2
clothing 94.3
man 94
standing 89
suit 79.1
posing 76.8
old 70.5
portrait 61.6
black and white 59.8
necktie 29.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Happy 96.6%
Confused 1.1%
Angry 0.8%
Calm 0.4%
Disgusted 0.4%
Surprised 0.3%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Female, 100%
Happy 89.6%
Confused 5.1%
Surprised 2%
Fear 1.2%
Disgusted 0.8%
Angry 0.6%
Calm 0.4%
Sad 0.4%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Suit 99.4%
Tie 99.1%
Person 97.9%

Captions

Microsoft

a man and woman posing for a photo 89.6%
a man and a woman posing for a photo 89.5%
a man wearing a suit and a woman posing for a photo 89.4%

Text analysis

Amazon

PROOF
MARTIN
SAINT
SAINT LOUIS
MARTIN SCHWEIG
LOUIS
SCHWEIG

Google

PROOF MARTIN SCHWEIG SAINT L OUIS
PROOF
MARTIN
SCHWEIG
SAINT
L
OUIS