Human Generated Data

Title

Untitled (portrait of a couple)
Date

c. 1870
People

Artist: John Deusing, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.748

Human Generated Data

Title

Untitled (portrait of a couple)

People

Artist: John Deusing, American active 1940s

Date

c. 1870

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 97.7
Human 97.7
Head 97
Face 97
Suit 91.1
Clothing 91.1
Coat 91.1
Overcoat 91.1
Apparel 91.1
Person 89.3
Tie 88.6
Accessories 88.6
Accessory 88.6
Advertisement 88.2
Art 79.7
Text 75.7
Portrait 71.8
Photography 71.8
Photo 71.8
Drawing 62
Billboard 60.1
Poster 59.6

Imagga
created on 2022-01-09

man 53.8
male 46.4
suit 44.4
businessman 40.6
business 35.2
portrait 35
person 32.7
groom 31.2
tie 30.4
people 30.1
executive 27.4
adult 26.6
office 24.9
happy 24.5
handsome 24.1
corporate 24.1
men 23.2
professional 23.1
smiling 22.4
bow tie 21.4
necktie 20.1
face 19.9
expression 19.6
smile 19.3
couple 18.3
confident 17.3
looking 16.8
guy 16.1
love 15.8
work 15.7
manager 14.9
glasses 14.8
standing 14.8
attractive 14
mature 14
meeting 13.2
senior 13.1
success 12.9
beard 12.7
communication 12.6
family 12.5
formal 12.4
together 12.3
group 12.1
successful 11.9
jacket 11.8
businesswoman 11.8
black 11.8
head 11.8
happiness 11.8
businessmen 11.7
team 11.7
husband 11.6
lifestyle 11.6
garment 11.5
partnership 11.5
job 11.5
boss 11.5
businesspeople 11.4
cheerful 11.4
human 11.3
modern 11.2
old 11.2
phone 11.1
parent 11.1
two 11
father 10.7
partner 10.6
serious 10.5
boy 10.4
smart 10.4
teamwork 10.2
friendly 10.1
mother 9.7
sibling 9.7
look 9.6
married 9.6
elegant 9.4
shirt 9.3
studio 9.1
grandfather 9.1
fashion 9.1
romance 8.9
confidence 8.6
dad 8.5
relationship 8.4
hand 8.4
kin 8.3
call 8.3
one 8.2
hair 7.9
brunette 7.8
colleague 7.8
corporation 7.7
double 7.7
leadership 7.7
stress 7.7
workplace 7.6
marriage 7.6
telephone 7.6
mobile 7.5
clothing 7.5
service 7.4
occupation 7.3
working 7.1

Google
created on 2022-01-09

Forehead 98.5
Chin 96.6
Photograph 94.2
Coat 91.9
Jaw 88
Art 85.3
Gesture 85.3
Collar 84
Tie 80.1
Suit 77.6
Vintage clothing 77
Formal wear 74.5
Moustache 69.1
Blazer 67.1
Event 65.5
History 65.5
Font 64.9
Visual arts 64.7
Room 62.5
Monochrome 62.3

Microsoft
created on 2022-01-09

wall 99.7
man 97.8
human face 96.5
text 92.2
person 90.5
clothing 84.1
portrait 77.9
sketch 74.1
drawing 68.2
photograph 54.5
old 51.8
posing 47.4
suit 36.4
necktie 25.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 87%
Sad 9.2%
Angry 1.4%
Confused 0.8%
Surprised 0.6%
Fear 0.5%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Calm 98%
Angry 0.8%
Confused 0.3%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%
Happy 0.2%
Surprised 0.1%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Suit 91.1%
Tie 88.6%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 80.3%
a man wearing a suit and tie 80.2%
an old photo of a man in a suit and tie 80.1%