Human Generated Data

Title

Untitled (young man in military jacket)

Date

c. 1978

People

Artist: Mark Goodman, American born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1779

Human Generated Data

Title

Untitled (young man in military jacket)

People

Artist: Mark Goodman, American born 1946

Date

c. 1978

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.1
Person 99.1
Tie 90.6
Accessories 90.6
Accessory 90.6
Apparel 89.3
Clothing 89.3
Transportation 87.4
Car 87.4
Vehicle 87.4
Automobile 87.4
Face 82.6
Overcoat 81.2
Coat 81.2
Man 80
Suit 70.7
Necktie 69.7
Portrait 64.1
Photography 64.1
Photo 64.1

Imagga
created on 2021-12-14

suit 88.9
man 55.9
businessman 54.8
garment 52.8
male 49.9
person 47.3
handsome 45.5
business 44.4
clothing 43.7
adult 42.8
necktie 38.7
bow tie 37.2
success 33
executive 32.4
professional 31.6
portrait 30.5
corporate 29.3
people 27.9
successful 26.6
guy 25.7
confident 25.5
tie 24.7
office 23.3
one 23.2
men 22.4
looking 21.6
smile 21.4
expression 21.4
job 21.3
standing 20.9
covering 20.5
work 20.4
lifestyle 20.3
consumer goods 20
modern 19.7
smiling 19.6
face 19.2
happy 18.2
formal 18.2
shirt 17.8
worker 17.2
jacket 17.1
model 16.4
attractive 16.1
studio 16
manager 15.9
businesspeople 15.2
fashion 15.1
scholar 14.5
employee 14.4
human 14.3
career 14.2
black 14.2
occupation 13.8
beard 13.7
casual 13.6
confidence 13.4
happiness 13.3
smart 13.2
hand 13.1
cheerful 13
adolescent 12.9
intellectual 12.5
boss 12.5
serious 12.4
alone 11.9
businessperson 11.7
only 11.5
company 11.2
mature 11.2
1 10.6
juvenile 10.3
hat 10.1
look 9.7
color 9.5
elegant 9.4
positive 9.2
20s 9.2
pose 9.1
posing 8.9
hair 8.7
one person 8.5
camera 8.3
laptop 8.2
businesswoman 8.2
style 8.2
stylish 8.2
indoors 7.9
hands 7.8
good looking 7.8
eyes 7.8
glasses 7.4
lawyer 7.4
friendly 7.3
gray 7.2
building 7.2

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

person 99.6
text 98.2
man 97.1
human face 96
clothing 92.9
smile 83.7
suit 78.5
standing 75.6
white 72.6
fashion accessory 70.5
portrait 69.2
black and white 69.1
old 67.1
coat 63.5
posing 60.6
jacket 55.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-31
Gender Male, 98.7%
Calm 97%
Happy 2.4%
Sad 0.3%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Car 87.4%
Suit 70.7%

Captions

Microsoft

a man wearing a suit and tie 98.8%
a man wearing a suit and tie posing for a photo 98.2%
an old photo of a man wearing a suit and tie 98%