Human Generated Data

Title

Untitled (portrait of an older couple)
Date

c. 1945
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1434

Human Generated Data

Title

Untitled (portrait of an older couple)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1434

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 97.6
Human 97.6
Tie 97.2
Accessories 97.2
Accessory 97.2
Glasses 96.6
Suit 96.5
Coat 96.5
Overcoat 96.5
Clothing 96.5
Apparel 96.5
Face 95.8
Person 94.4
Attorney 91.4
Head 91.2
Text 85.7
Glasses 82.7
Suit 80.1
Man 70.8
Photography 67.8
Photo 67.8
Advertisement 67.7
Officer 67.4
Military Uniform 67.4
Military 67.4
Portrait 67
Poster 63.1
Jaw 57.9

Clarifai
created on 2023-10-26

people 99.8
portrait 99.7
two 98
adult 97.5
man 97.3
elderly 97
eyewear 95.4
leader 95.2
three 91.5
group 91.3
eyeglasses 90.1
facial expression 87.7
old 86.2
administration 85.5
retro 85
wear 84.9
politician 79.4
monochrome 78.8
sepia 77.5
science 75.8

Imagga
created on 2022-01-22

mug shot 62.7
bow tie 57.9
man 55.2
necktie 50.6
photograph 48.7
male 46.2
representation 37.4
senior 36.6
businessman 34.5
person 32.7
portrait 31.7
executive 30.8
people 30.2
happy 30.1
adult 29.9
business 29.8
mature 26.1
smiling 25.3
handsome 25
elderly 24.9
creation 24.6
couple 24.4
suit 23.6
face 23.5
garment 22.5
old 22.3
office 21.7
corporate 21.5
smile 21.4
expression 20.5
husband 20.2
grandfather 19.8
tie 19
men 18.9
glasses 18.5
computer 17.6
home 17.6
clothing 16.6
laptop 16.4
professional 16.4
gray 16.2
wife 16.1
looking 16
manager 15.8
jacket 15.4
together 14.9
success 14.5
working 14.2
eyes 13.8
sitting 13.8
retired 13.6
love 13.4
retirement 12.5
married 12.5
family 12.5
businesspeople 12.4
indoors 12.3
desk 12.3
hand 12.2
confident 11.8
guy 11.8
work 11.8
aged 11.8
hair 11.1
successful 11
businesswoman 10.9
lady 10.6
marriage 10.5
meeting 10.4
shirt 10.3
casual 10.2
occupation 10.1
indoor 10.1
40s 9.7
older 9.7
happiness 9.4
grandma 9.4
head 9.2
attractive 9.1
holding 9.1
cheerful 9
boss 8.6
formal 8.6
age 8.6
modern 8.4
alone 8.2
technology 8.2
team 8.1
romantic 8
lifestyle 8
look 7.9
elder 7.9
director 7.9
60s 7.8
black 7.8
affection 7.7
corporation 7.7
laugh 7.7
two 7.6
career 7.6
beard 7.6
horizontal 7.5
human 7.5
close 7.4
20s 7.3
group 7.3
women 7.1

Google
created on 2022-01-22

Glasses 98
Tie 91.4
Collar 80.9
Font 77.8
Blazer 77.5
Event 70.6
Formal wear 70.6
Vintage clothing 70.4
Smile 70.1
Suit 67.9
Sleeve 66.8
History 64.1
Stock photography 63.7
Monochrome photography 62
Photo caption 59.6
Eyewear 55.2
Portrait 53
Monochrome 52.6
Art 50.2

Microsoft
created on 2022-01-22

wall 100
indoor 99.4
human face 97.5
text 96.3
person 94.2
glasses 91.3
man 80
clothing 77.9
smile 65.8
tie 64.1
posing 59.9
portrait 56.8
old 51.2
suit 31.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Female, 100%
Calm 96.2%
Surprised 1.7%
Angry 0.7%
Disgusted 0.4%
Sad 0.3%
Fear 0.3%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 63-73
Gender Male, 100%
Calm 98.9%
Happy 0.4%
Surprised 0.2%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Tie 97.2%
Glasses 96.6%
Suit 96.5%

Categories

Imagga

people portraits 72.7%
paintings art 15.1%
food drinks 10.3%

Text analysis

Amazon

PROOF
LOUIS
SAINT LOUIS
SAINT
MARTIN
MARTIN SCHWEIG
SCHWEIG
design

Google

PROOF MARTIN SCHWEIG SAINT LOUIS idenign
PROOF
MARTIN
SCHWEIG
SAINT
LOUIS
idenign