Human Generated Data

Title

We All Knew Each Other: Triptych (center panel)

Date

1978

People

Artist: Todd Watts, American born 1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Joan and Roger Sonnabend, P1998.91.8

Human Generated Data

Title

We All Knew Each Other: Triptych (center panel)

People

Artist: Todd Watts, American born 1949

Date

1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Joan and Roger Sonnabend, P1998.91.8

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Lighting 100
Person 99.1
Human 99.1
Person 97.6
Clothing 79
Apparel 79
Photography 71.8
Photo 71.8
Overcoat 66.8
Coat 66.8
Portrait 64.1
Face 64.1
Man 62.8
Spotlight 59.5
LED 59.5
Lamp 58.9
Suit 57
Performer 55.2

Clarifai
created on 2023-10-25

portrait 99.8
man 99.1
people 98.5
monochrome 97
dark 96.8
studio 96.5
light 96.4
model 95.4
shadow 94.8
music 94.8
concert 93.5
face 93.3
fashion 92.6
guy 92.1
contrast 91.9
spotlight 88.3
street 88.2
adult 88.2
black and white 87.9
art 84.9

Imagga
created on 2022-01-08

man 46.7
person 46
black 45.2
male 44.8
portrait 38.9
adult 35.6
businessman 34.5
handsome 33.9
suit 33.8
face 29.2
people 29
looking 27.2
dark 22.6
expression 22.2
professional 21.5
business 20.7
studio 20.5
human 20.3
attractive 19.6
serious 19.1
men 18.9
executive 17.4
head 15.1
one 15
model 14.8
confident 14.6
guy 14.4
mature 14
hair 13.5
modern 13.3
hand 12.6
work 12.6
old 12.6
formal 12.4
senior 12.2
manager 12.1
success 12.1
fashion 12.1
eyes 12.1
alone 11.9
job 11.5
tie 11.4
glasses 11.1
smile 10.7
posing 10.7
happy 10.7
clothing 10.5
performer 10.4
corporate 10.3
youth 10.2
holding 9.9
sexy 9.7
boss 9.6
standing 9.6
macho 9.5
love 9.5
shirt 9.5
jacket 9.4
casual 9.3
occupation 9.2
pretty 9.1
to 8.9
look 8.8
brunette 8.7
hands 8.7
elegant 8.6
smart 8.5
passion 8.5
cool 8
smiling 8
couple 7.9
masculine 7.8
entertainer 7.8
elderly 7.7
stress 7.7
elegance 7.6
beard 7.5
emotion 7.4
pose 7.3
lifestyle 7.2
office 7.2
eye 7.2
skin 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

man 99.1
human face 99
person 97.8
text 97.4
clothing 90.8
portrait 74.6
black 69.5
dark 64.5
black and white 56.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Male, 100%
Sad 72%
Confused 22%
Angry 2%
Calm 1.4%
Fear 1.2%
Disgusted 0.7%
Surprised 0.5%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Male, 96.6%
Calm 98.6%
Fear 1.1%
Sad 0.1%
Surprised 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Categories

Captions

Microsoft
created on 2022-01-08

a man in a dark room 93.4%
a man sitting in a dark room 86.3%
a man looking at the camera 86.2%

Text analysis

Amazon

TOO
TOO wtt
wtt