Human Generated Data

Title

Untitled (double studio portrait of boy wearing shirt with large white collar)
Date

1940
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10225

Human Generated Data

Title

Untitled (double studio portrait of boy wearing shirt with large white collar)

People

Artist: Martin Schweig, American 20th century

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.1
Face 99.1
Person 98.2
Clothing 96.1
Apparel 96.1
Coat 84.3
Lab Coat 77.4
Photography 71.5
Portrait 71.5
Photo 71.5
Head 68.6
Man 67.6

Imagga
created on 2022-01-22

nurse 44.4
person 41
portrait 34.4
people 32.4
man 32.3
doctor 30.1
male 29.3
medical 29.2
adult 28.7
smile 28.5
professional 28.2
coat 27.4
hospital 26
medicine 25.6
adolescent 25.3
happy 25.1
smiling 24.6
face 23.5
office 23.3
attractive 23.1
juvenile 22.7
stethoscope 22.6
lab coat 21.9
business 20.7
looking 19.2
handsome 18.8
standing 18.3
garment 18
clinic 17.6
care 17.3
clothing 17.1
casual 17
friendly 16.5
one 16.5
health 16
worker 15.7
occupation 15.6
job 15.1
mature 14.9
men 14.6
specialist 14.6
work 14.2
businessman 14.1
shirt 14
expertise 13.6
working 13.3
boy 13.1
confident 12.8
businesswoman 12.7
hair 12.7
women 12.7
confidence 12.5
indoors 12.3
guy 12.1
physician 11.7
model 11.7
suit 11.6
lifestyle 11.6
wearing 11.4
practitioner 11.3
human 11.3
surgeon 10.8
student 10.4
happiness 10.2
lady 9.8
black 9.7
uniform 9.7
looking camera 9.6
serious 9.6
tie 9.5
eyes 9.5
smart 9.4
senior 9.4
successful 9.2
fashion 9.1
single 9.1
clinical 8.8
mid adult 8.7
profession 8.6
corporate 8.6
youth 8.5
career 8.5
child 8.5
patient 8.5
head 8.4
glasses 8.3
alone 8.2
healthy 8.2
cheerful 8.1
success 8.1
surgery 7.8
consultant 7.8
middle aged 7.8
thoughtful 7.8
necktie 7.8
exam 7.7
staff 7.7
only 7.6
businesspeople 7.6
desk 7.6
dark 7.5
camera 7.4
treatment 7.4
indoor 7.3
employee 7.2
pretty 7

Google
created on 2022-01-22

Forehead 98.5
Eyebrow 94.4
Jaw 88.2
Window 83.6
Collar 76.6
Vintage clothing 75
Tints and shades 73.2
Art 65.4
Crop 61.2
Portrait 60.5
Bangs 60.4
Portrait photography 58.4
Uniform 57.5
Monochrome 57.5
Room 57.4
Retro style 56.2
White-collar worker 56.1
Tie 54.3
History 53.4
Smile 51

Microsoft
created on 2022-01-22

person 99.8
indoor 99.6
wall 99.6
human face 99.5
text 96.2
clothing 94.6
portrait 92
posing 72.1
boy 60.5
smile 58.8
picture frame 6.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Female, 53.8%
Calm 88.7%
Confused 5.7%
Surprised 3%
Fear 0.7%
Angry 0.7%
Sad 0.6%
Disgusted 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 11
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 66.4%
a young man standing in front of a mirror posing for the camera 53.9%
a person posing for the camera 53.8%

Text analysis

Amazon

PROOF
MARTIN
MARTIN SCHWEIG
SAINT
SAINT LOUIS
LOUIS
SCHWEIG

Google

17 PRO TIN SCHW SAINT LOUIS
PRO
SCHW
SAINT
LOUIS
17
TIN