Human Generated Data

Title

We All Knew Each Other: Triptych (center panel)
Date

1978
People

Artist: Todd Watts, American born 1949
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Joan and Roger Sonnabend, P1998.91.8

Human Generated Data

Title

We All Knew Each Other: Triptych (center panel)

People

Artist: Todd Watts, American born 1949

Date

1978

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Lighting 100
Person 99.1
Human 99.1
Person 97.6
Clothing 79
Apparel 79
Photography 71.8
Photo 71.8
Overcoat 66.8
Coat 66.8
Portrait 64.1
Face 64.1
Man 62.8
Spotlight 59.5
LED 59.5
Lamp 58.9
Suit 57
Performer 55.2

Imagga
created on 2022-01-08

man 46.7
person 46
black 45.2
male 44.8
portrait 38.9
adult 35.6
businessman 34.5
handsome 33.9
suit 33.8
face 29.2
people 29
looking 27.2
dark 22.6
expression 22.2
professional 21.5
business 20.7
studio 20.5
human 20.3
attractive 19.6
serious 19.1
men 18.9
executive 17.4
head 15.1
one 15
model 14.8
confident 14.6
guy 14.4
mature 14
hair 13.5
modern 13.3
hand 12.6
work 12.6
old 12.6
formal 12.4
senior 12.2
manager 12.1
success 12.1
fashion 12.1
eyes 12.1
alone 11.9
job 11.5
tie 11.4
glasses 11.1
smile 10.7
posing 10.7
happy 10.7
clothing 10.5
performer 10.4
corporate 10.3
youth 10.2
holding 9.9
sexy 9.7
boss 9.6
standing 9.6
macho 9.5
love 9.5
shirt 9.5
jacket 9.4
casual 9.3
occupation 9.2
pretty 9.1
to 8.9
look 8.8
brunette 8.7
hands 8.7
elegant 8.6
smart 8.5
passion 8.5
cool 8
smiling 8
couple 7.9
masculine 7.8
entertainer 7.8
elderly 7.7
stress 7.7
elegance 7.6
beard 7.5
emotion 7.4
pose 7.3
lifestyle 7.2
office 7.2
eye 7.2
skin 7

Google
created on 2022-01-08

Flash photography 88.6
Jaw 87.9
Gesture 85.3
Style 83.8
Black-and-white 83
Tints and shades 76.9
Movie 74.5
Eyewear 73.9
Monochrome photography 72.9
Monochrome 72.6
Darkness 72.4
Midnight 71
Hat 69.4
Event 68.2
Room 64.9
Stock photography 64.1
Fun 61.9
Portrait 59.1
Portrait photography 58.9
Lens flare 58.4

Microsoft
created on 2022-01-08

man 99.1
human face 99
person 97.8
text 97.4
clothing 90.8
portrait 74.6
black 69.5
dark 64.5
black and white 56.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Male, 100%
Sad 72%
Confused 22%
Angry 2%
Calm 1.4%
Fear 1.2%
Disgusted 0.7%
Surprised 0.5%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Male, 96.6%
Calm 98.6%
Fear 1.1%
Sad 0.1%
Surprised 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a man in a dark room 93.4%
a man sitting in a dark room 86.3%
a man looking at the camera 86.2%

Text analysis

Amazon

TOO
TOO wtt
wtt