Human Generated Data

Title

Untitled (portrait of man wearing coat and bowtie)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17579

Human Generated Data

Title

Untitled (portrait of man wearing coat and bowtie)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Accessories 99.4
Accessory 99.4
Tie 99.4
Suit 98.7
Coat 98.7
Overcoat 98.7
Clothing 98.7
Apparel 98.7
Person 97.8
Human 97.8
Tie 96.2
Face 79.3
Tuxedo 75
Man 66
Portrait 66
Photography 66
Photo 66

Imagga
created on 2022-02-26

bow tie 100
necktie 100
garment 72.8
man 58.6
businessman 52.2
male 51.2
handsome 43.8
suit 43.4
clothing 39.7
portrait 38.3
business 37.7
adult 37.6
person 36.9
tie 35.2
professional 31.3
executive 31
mature 28.9
senior 28.2
looking 28
confident 26.4
manager 25.2
people 25.1
black 24.7
face 24.2
corporate 24.1
boss 23
old 22.3
expression 22.2
men 21.5
elderly 21.1
shirt 20.6
glasses 19.5
success 18.5
successful 18.3
smile 17.8
work 17.3
one 17.2
jacket 16.4
happy 16.3
hair 15.9
standing 15.7
older 15.6
office 15.3
smiling 14.5
serious 14.3
job 14.2
guy 12.9
occupation 12.9
studio 12.2
worker 11.8
businesspeople 11.4
eyes 11.2
alone 11
head 10.9
leadership 10.6
formal 10.5
human 10.5
casual 10.2
lifestyle 10.1
gray 9.9
modern 9.8
attractive 9.8
60s 9.8
cheerful 9.8
leader 9.7
retirement 9.6
hands 9.6
hand 9.1
gray hair 8.9
happiness 8.6
career 8.5
smart 8.5
friendly 8.2
aged 8.2
look 7.9
lawyer 7.9
grandfather 7.8
retired 7.8
power 7.6
fashion 7.6
one person 7.5
holding 7.4
close 7.4
to 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

man 99.7
person 99.7
text 99.7
suit 96.3
human face 96.1
tie 87.4
portrait 86.9
clothing 83.5
necktie 69.1
old 62
gentleman 52.4
posing 47

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 96.7%
Disgusted 25.4%
Surprised 19.6%
Sad 17.5%
Happy 12.2%
Calm 9.5%
Confused 8.9%
Fear 3.5%
Angry 3.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.4%
Suit 98.7%
Person 97.8%

Captions

Microsoft

a man wearing a suit and tie 98.9%
a man in a suit and tie 98.8%
an old photo of a man in a suit and tie 98.4%

Text analysis

Amazon

are

Google

1.
1.