Human Generated Data

Title

Untitled (proof print: family portrait of four, older and younger couple)
Date

c. 1950
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14111

Human Generated Data

Title

Untitled (proof print: family portrait of four, older and younger couple)

People

Artist: Martin Schweig, American 20th century

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14111

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.2
Human 99.2
Person 98.7
Tie 97.1
Accessories 97.1
Accessory 97.1
Person 96.7
Person 96.7
Suit 91.6
Coat 91.6
Clothing 91.6
Overcoat 91.6
Apparel 91.6
People 86
Family 75.6
Suit 74.4
Tie 68.4

Clarifai
created on 2023-10-26

people 100
group 99.8
adult 98.8
portrait 98.6
three 98.3
leader 97.9
man 97.4
administration 96.9
four 96.4
two 95
group together 93.5
woman 93
five 92.3
sit 92.1
several 92.1
chair 87.7
wear 87.5
scientist 85.5
outfit 85.2
offspring 83.4

Imagga
created on 2022-01-22

man 45
male 36.2
businessman 32.7
people 31.8
kin 29.8
bow tie 29
business 28.5
office 27.3
couple 26.1
happy 25.7
senior 25.3
grandfather 24.4
person 23.4
necktie 23.2
men 22.3
adult 22.2
suit 21.9
businesswoman 20
executive 19.8
smiling 19.5
portrait 19.4
corporate 18.9
sibling 18.7
world 18.3
old 18.1
businesspeople 18
meeting 17
together 16.6
team 16.1
professional 14.9
elderly 14.4
family 14.2
clothing 13.9
businessmen 13.6
home 13.6
face 13.5
tie 13.3
desk 13.2
indoors 13.2
manager 13
mature 13
cheerful 13
group 12.9
smile 12.8
work 12.6
military uniform 12.3
60s 11.7
handsome 11.6
garment 11.4
standing 11.3
looking 11.2
sitting 11.2
teamwork 11.1
love 11
happiness 11
colleagues 10.7
working 10.6
partnership 10.6
husband 10.5
computer 10.4
uniform 10.4
lifestyle 10.1
horizontal 10
indoor 10
sixties 9.8
discussion 9.7
job 9.7
success 9.7
corporation 9.6
busy 9.6
black 9.6
room 9.5
casual 9.3
aged 9
lady 8.9
partners 8.7
retired 8.7
jacket 8.7
30s 8.7
day 8.6
talking 8.5
wife 8.5
expression 8.5
attractive 8.4
holding 8.2
occupation 8.2
20s 8.2
building 8
businessperson 7.8
40s 7.8
older 7.8
retirement 7.7
boss 7.6
formal 7.6
two 7.6
enjoying 7.6
head 7.6
communication 7.6
company 7.4
glasses 7.4
camera 7.4
confident 7.3
mother 7.2

Google
created on 2022-01-22

Hairstyle 95.1
Photograph 94.2
Coat 90.1
Suit 80.3
Blazer 77.4
Snapshot 74.3
Vintage clothing 73.4
Event 70.1
Chair 70.1
Tie 69.5
Classic 69
History 67.8
Formal wear 65.8
Sitting 65.1
Stock photography 64.7
Photo caption 61.1
Collar 59.6
White-collar worker 53.3
Retro style 52.4
Room 52.3

Microsoft
created on 2022-01-22

person 99.7
text 99.2
clothing 98.6
wall 98.5
human face 96.7
smile 94.9
suit 91.7
man 90
old 87.1
black 86.1
posing 84.7
people 72.7
group 63.3
woman 59.9
vintage 31.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 96.1%
Calm 95.1%
Happy 2.9%
Confused 0.5%
Surprised 0.5%
Angry 0.4%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 88.5%
Happy 11%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 61-71
Gender Female, 100%
Calm 99.1%
Sad 0.3%
Fear 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Calm 86.8%
Happy 11.1%
Surprised 0.5%
Sad 0.5%
Disgusted 0.4%
Angry 0.3%
Fear 0.3%
Confused 0.2%

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 97.1%
Suit 91.6%

Categories

Imagga

people portraits 75.9%
paintings art 24%

Text analysis

Amazon

PROOF
LOUIS
SAINT LOUIS
SAINT
MARTIN
MARTIN SCHWEIG
SCHWEIG
he
Cremone
double
clui
pesall

Google

sevcoue PROOF MARTIN SCHWEIG SAINT LOUIS
sevcoue
PROOF
MARTIN
SCHWEIG
SAINT
LOUIS