Human Generated Data

Title

Untitled (portrait of a couple)
Date

c. 1945
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1455

Human Generated Data

Title

Untitled (portrait of a couple)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1455

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Suit 99.4
Clothing 99.4
Coat 99.4
Overcoat 99.4
Apparel 99.4
Accessories 99.1
Accessory 99.1
Tie 99.1
Suit 98.3
Human 97.9
Person 97.9
Person 97.7
Face 95.7
Tie 94.1
People 82.7
Female 78.3
Girl 66.7
Shirt 64.4
Jacket 64.4
Photo 63.1
Portrait 63.1
Photography 63.1
Smile 60.8
Blazer 58.3
Family 56.7
Man 56.4
Officer 55.4
Military 55.4
Military Uniform 55.4

Clarifai
created on 2023-10-26

people 100
portrait 99.8
adult 99.3
two 98.9
man 98.4
retro 96.7
administration 96.6
wear 95.9
leader 95
facial expression 94.1
monochrome 93.6
music 93.5
one 93
three 90.9
group 90
outfit 89.9
musician 86.3
politician 85.5
actor 85.4
nostalgia 79.9

Imagga
created on 2022-01-22

suit 76.5
businessman 54
groom 51
man 50.5
bow tie 49
business 45.6
necktie 42.3
garment 40
male 40
corporate 39.6
executive 36.9
office 35.4
person 35.4
people 34.1
businesswoman 31.9
team 31.4
professional 30
successful 27.5
success 27.4
handsome 26.8
adult 26.6
smiling 26.1
clothing 25.9
men 25.8
tie 25.7
meeting 25.5
confident 24.6
happy 24.5
work 24.4
group 23.4
smile 22.9
teamwork 22.3
standing 21.8
portrait 20.1
colleagues 19.5
couple 19.2
company 18.6
formal 18.2
businesspeople 18.1
job 17.7
attractive 17.5
partnership 17.3
expression 17.1
building 16.7
partners 16.6
staff 16.3
boss 16.3
manager 15.9
friendly 15.6
workplace 15.3
looking 15.2
businessmen 14.7
guy 14.4
smart 14.2
two 13.6
worker 13.3
face 12.8
coworkers 12.8
corporation 12.6
leadership 12.5
holding 12.4
black 12.3
modern 11.9
colleague 11.7
employee 11.4
cheerful 11.4
consumer goods 11.3
elegant 11.2
covering 11.1
partner 10.6
married 10.6
together 10.5
human 10.5
love 10.3
hand 9.9
fashion 9.8
entrepreneur 9.6
career 9.5
jacket 9.3
communication 9.3
wedding 9.2
dress 9.1
outdoors 9
businesswomen 8.8
handshake 8.8
cooperation 8.7
women 8.7
happiness 8.6
confidence 8.6
outside 8.6
mature 8.4
lifestyle 8
boy 7.8
model 7.8
deal 7.8
agreement 7.8
diversity 7.7
serious 7.6
commerce 7.5
husband 7.5
adolescent 7.2

Google
created on 2022-01-22

Face 98.3
Smile 98
Outerwear 95.1
Coat 91.4
Gesture 85.3
Collar 83.8
Suit 81
Blazer 77.8
Military person 77.1
Formal wear 77
Vintage clothing 75.9
Tie 75.1
Non-commissioned officer 75
Classic 70.7
Military officer 68.3
White-collar worker 68.2
Event 67.3
Uniform 65.6
History 61.7
Bow tie 58.8

Microsoft
created on 2022-01-22

person 99.7
text 99.2
human face 97.9
smile 97.2
clothing 94.3
man 94
standing 89
suit 79.1
posing 76.8
old 70.5
portrait 61.6
black and white 59.8
necktie 29.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Happy 96.6%
Confused 1.1%
Angry 0.8%
Calm 0.4%
Disgusted 0.4%
Surprised 0.3%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Female, 100%
Happy 89.6%
Confused 5.1%
Surprised 2%
Fear 1.2%
Disgusted 0.8%
Angry 0.6%
Calm 0.4%
Sad 0.4%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Suit 99.4%
Tie 99.1%
Person 97.9%

Categories

Imagga

people portraits 92.9%
paintings art 7%

Text analysis

Amazon

PROOF
MARTIN
SAINT
SAINT LOUIS
MARTIN SCHWEIG
LOUIS
SCHWEIG

Google

PROOF
MARTIN
SCHWEIG
SAINT
L
OUIS
PROOF MARTIN SCHWEIG SAINT L OUIS