Human Generated Data

Title

Untitled (portrait of three men with young boy and two black dogs)

Date

1925-1940

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10199

Human Generated Data

Title

Untitled (portrait of three men with young boy and two black dogs)

People

Artist: Martin Schweig, American 20th century

Date

1925-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Accessory 97.7
Tie 97.7
Accessories 97.7
Coat 97.6
Apparel 97.6
Clothing 97.6
Overcoat 97.6
Suit 97.4
Person 96.5
Human 96.5
Person 96.4
Person 95.6
Person 94.7
Suit 92
People 90
Suit 89.6
Tie 88.6
Family 87.4
Face 79.9
Person 78.8
Tuxedo 76.2
Blazer 64.4
Jacket 64.4
Text 61.8
Couch 55.9
Furniture 55.9
Photo Booth 55.8
Advertisement 55.5

Imagga
created on 2022-01-22

man 47.7
businessman 43.3
office 38.6
male 37
business 36.5
person 33
people 32.9
bow tie 31.4
meeting 30.2
businesswoman 30
necktie 28.4
professional 27.7
team 26.9
corporate 26.6
adult 26.1
executive 24.5
happy 24.4
businesspeople 23.7
group 23.4
suit 23
men 21.5
kin 21.1
colleagues 20.4
work 19.6
teamwork 19.5
job 19.5
smiling 18.8
senior 18.8
mature 18.6
couple 18.3
portrait 17.5
smile 17.1
manager 16.8
tie 16.1
standing 15.6
stethoscope 15.4
clothing 15
garment 14.8
coworkers 14.7
confident 14.6
partnership 14.4
worker 14.3
family 14.2
working 14.1
indoors 14.1
success 12.9
indoor 12.8
discussion 12.7
corporation 12.5
30s 12.5
handsome 12.5
elderly 12.5
staff 12.4
workplace 12.4
career 12.3
lifestyle 12.3
doctor 12.2
cheerful 12.2
sitting 12
looking 12
home 12
businessmen 11.7
successful 11
secretary 10.8
discussing 10.8
care 10.7
desk 10.4
planner 10.2
occupation 10.1
20s 10.1
face 9.9
attractive 9.8
40s 9.7
partners 9.7
medical 9.7
partner 9.7
table 9.5
talking 9.5
baron 9.4
happiness 9.4
presentation 9.3
company 9.3
speaker 9
grandfather 9
associates 8.9
computer 8.8
conference 8.8
together 8.8
women 8.7
busy 8.7
leadership 8.6
adults 8.5
two 8.5
hospital 8.5
communication 8.4
horizontal 8.4
old 8.4
love 7.9
patient 7.8
diverse 7.8
boy 7.8
middle aged 7.8
agreement 7.8
expertise 7.8
jacket 7.7
looking camera 7.7
diversity 7.7
collar 7.7
four 7.7
confidence 7.7
boss 7.7
finance 7.6
director 7.5
room 7.5
holding 7.4
articulator 7.4
uniform 7.1
day 7.1
medicine 7

Google
created on 2022-01-22

Photograph 94.2
Coat 87.9
Collar 83.8
Suit 81.2
Tie 79
Blazer 78.2
Vintage clothing 75.4
Formal wear 74.4
Event 70.5
Classic 68.6
Sitting 62.4
Retro style 57
White-collar worker 57
History 54.4
Family 53.5

Microsoft
created on 2022-01-22

wall 100
person 98.9
indoor 94.3
clothing 93.4
text 92.9
suit 92.1
military uniform 89.8
man 81.7
human face 81.5
smile 75.8
old 58.7
posing 49

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Calm 82.5%
Happy 12.2%
Sad 1.4%
Confused 1.2%
Angry 1%
Disgusted 0.6%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 99.4%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Male, 99.9%
Calm 98.2%
Confused 0.6%
Sad 0.4%
Angry 0.3%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 99.9%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%
Surprised 0%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 97.7%
Suit 97.4%
Person 96.5%

Captions

Microsoft

Tex Ritter et al. standing in front of a mirror posing for the camera 90%
Tex Ritter et al. posing for a photo 89.9%
Tex Ritter et al. sitting in front of a mirror posing for the camera 86.4%

Text analysis

Amazon

MARTIN
AND
SHOULD
WITHIN
PROPERTY
TEN
MARTIN $
WITHIN TEN DAYS
$
DE
AND SHOULD DE REPUBLIC
THIS
DAYS
OF TME
THIS PROOFISING PROPERTY
REPUBLIC
PROOFISING

Google

THIS PROOF18T MARTIN SEWST00 AND SHOULD BETER L WITHIN TEN DAY
THIS
AND
BETER
WITHIN
SEWST00
SHOULD
L
PROOF18T
MARTIN
TEN
DAY