Human Generated Data

Title

Grace Line 5th Avenue, New York

Date

1955

People

Artist: William Klein, American 1928 - 2022

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.603

Human Generated Data

Title

Grace Line 5th Avenue, New York

People

Artist: William Klein, American 1928 - 2022

Date

1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.603

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99
Human 99
Person 98.7
Person 98.6
Crowd 94.8
Person 92.9
Person 89.4
Clothing 86.9
Apparel 86.9
Person 82.4
Person 79.9
Person 75.6
People 72.4
Parade 70.5
Face 69.4
Pedestrian 66.5
Person 64.8
Protest 64.8
Suit 62.4
Coat 62.4
Overcoat 62.4
Audience 57
Text 56
Word 55.6

Clarifai
created on 2023-10-25

people 99.9
portrait 99.3
adult 98.9
group 98.4
man 98.4
group together 95.1
street 94.5
leader 93.6
monochrome 92.6
music 91.2
administration 90.5
actor 88
movie 87.9
woman 82.6
many 78.3
chair 77.7
three 77.4
retro 76.7
musician 75.3
two 75.3

Imagga
created on 2022-01-08

man 42.3
male 35.5
portrait 33
person 29.5
adult 27.2
black 26.8
face 24.9
people 24.5
expression 22.2
suit 21.3
attractive 18.2
couple 17.4
business 17
businessman 16.8
studio 16.7
jacket 15.8
guy 15.8
human 15
look 14.9
eyes 14.6
handsome 14.3
love 14.2
one 13.4
world 13.4
executive 13.3
happy 13.2
looking 12.8
head 12.6
bow tie 12.4
lifestyle 12.3
professional 12.2
fashion 12.1
hair 11.9
dark 11.7
model 11.7
office 11.6
smile 11.4
sexy 11.2
clothing 11.2
pretty 11.2
emotion 11.1
casual 11
necktie 11
hand 10.8
cute 10.8
tie 10.4
style 10.4
happiness 10.2
confident 10
photographer 9.5
serious 9.5
two 9.3
alone 9.1
close 9.1
to 8.9
corporate 8.6
men 8.6
passion 8.5
glasses 8.3
sensual 8.2
lady 8.1
romance 8
husband 8
romantic 8
smiling 8
product 7.9
women 7.9
depression 7.8
elegant 7.7
youth 7.7
relationship 7.5
billboard 7.4
lips 7.4
beard 7.4
sensuality 7.3
success 7.2
family 7.1
modern 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 99.8
human face 98.2
clothing 97.5
man 96.3
person 95.4
black and white 93.8
smile 89.2
suit 88.9
glasses 80.3
electronics 72.9
monochrome 55.5
old 41.6
computer 30.1
picture frame 8.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Angry 71.5%
Calm 18.9%
Confused 6.8%
Sad 1.3%
Fear 0.5%
Disgusted 0.4%
Surprised 0.4%
Happy 0.3%

AWS Rekognition

Age 57-65
Gender Male, 100%
Calm 77.9%
Sad 5.6%
Disgusted 5.5%
Confused 4.2%
Fear 3.8%
Angry 1.5%
Surprised 0.8%
Happy 0.7%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Confused 42.8%
Calm 38.1%
Sad 12.9%
Angry 2.5%
Surprised 2.2%
Fear 0.6%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 56-64
Gender Male, 99.8%
Calm 98.8%
Angry 0.5%
Sad 0.3%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 41-49
Gender Male, 90.5%
Calm 91.4%
Sad 3.4%
Angry 2.3%
Happy 1.3%
Surprised 0.7%
Disgusted 0.4%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Angry 50.3%
Calm 26.8%
Sad 14.7%
Fear 3.5%
Confused 1.6%
Disgusted 1.4%
Happy 0.9%
Surprised 0.8%

AWS Rekognition

Age 20-28
Gender Female, 96.3%
Calm 77.3%
Disgusted 7.9%
Happy 6.1%
Angry 2.4%
Surprised 2.3%
Sad 1.8%
Confused 1.5%
Fear 0.7%

AWS Rekognition

Age 24-34
Gender Male, 98.3%
Calm 97.6%
Sad 1.2%
Fear 0.7%
Happy 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 22-30
Gender Male, 88.9%
Calm 71.7%
Sad 14%
Surprised 4.3%
Fear 3.4%
Confused 3%
Angry 1.7%
Disgusted 1.3%
Happy 0.5%

AWS Rekognition

Age 12-20
Gender Male, 87.9%
Surprised 70%
Angry 13.4%
Happy 5.6%
Sad 3.6%
Disgusted 2.6%
Fear 2.1%
Confused 1.8%
Calm 1.1%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Calm 44.6%
Surprised 20.3%
Confused 14.6%
Sad 7.5%
Happy 6.7%
Fear 4.8%
Disgusted 0.9%
Angry 0.7%

AWS Rekognition

Age 21-29
Gender Female, 98.4%
Fear 45.2%
Calm 19%
Sad 13.7%
Surprised 12%
Angry 4.1%
Happy 2.9%
Disgusted 2%
Confused 1.1%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Suit 62.4%

Categories

Imagga

paintings art 86.7%
people portraits 11.9%

Text analysis

Amazon

GRACE

Google

MINK GRACE
GRACE
MINK