Human Generated Data

Title

National Democratic Convention, New York City

Date

1976

People

Artist: Lotte Jacobi, German 1896 - 1990

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Helen D. Willard, P1979.18

Human Generated Data

Title

National Democratic Convention, New York City

People

Artist: Lotte Jacobi, German 1896 - 1990

Date

1976

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Helen D. Willard, P1979.18

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.9
Apparel 99.9
Person 98.6
Human 98.6
Person 97.3
Person 96.7
Person 92.7
Person 91.6
Sun Hat 86.3
Hat 86.2
Dog 81.9
Mammal 81.9
Animal 81.9
Canine 81.9
Pet 81.9
Crowd 77.3
Person 75.8
Face 71.6
People 65.3
Overcoat 59.4
Coat 59.4
Photographer 57.4
Musician 57.3
Musical Instrument 57.3
Finger 56.8
Person 51.7
Person 48.8

Clarifai
created on 2023-10-25

people 99.9
adult 98.5
group 98
group together 97.9
many 96.7
administration 94.3
wear 93.9
woman 93.3
man 92.4
two 90.9
music 90.1
several 89.6
military 88.4
outfit 88.1
leader 87.7
war 87.2
canine 85.8
lid 84.2
one 84.2
monochrome 83.3

Imagga
created on 2021-12-14

statue 29
sculpture 21.2
person 17.6
man 16.9
art 16.2
city 15.8
architecture 14
ancient 13.8
history 13.4
stone 12.8
male 12.8
uniform 12.7
landmark 12.6
photographer 12.3
monument 12.1
black 12.1
people 11.7
clothing 10.9
sky 10.8
culture 10.2
tourism 9.9
building 9.8
to 9.7
marble 9.7
travel 9.1
military uniform 9.1
old 9.1
roman 8.8
horse 8.5
historic 8.2
stretcher 8.1
detail 8
portrait 7.8
professional 7.7
decoration 7.6
adult 7.5
traditional 7.5
litter 7.5
planner 7.3
tourist 7.2
religion 7.2
sword 7.2

Google
created on 2021-12-14

Hairstyle 95.1
Photograph 94.2
White 92.2
Black 90
Black-and-white 87.2
Standing 86.4
Hat 84.8
Style 84.2
Interaction 83.9
Headgear 83.2
Public space 81
Monochrome 77.1
Monochrome photography 76.6
Sun hat 75.2
Youth 74.7
Snapshot 74.3
Event 73.8
Street 72.2
Crowd 72
Fedora 71.4

Microsoft
created on 2021-12-14

person 99.6
text 94.1
clothing 92
black and white 69.5
drawing 60.9
man 60.7
poster 56.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 98.4%
Happy 97%
Calm 1.1%
Angry 0.5%
Sad 0.4%
Fear 0.4%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 33-49
Gender Male, 80.8%
Calm 97.2%
Angry 1.3%
Surprised 0.8%
Fear 0.4%
Sad 0.1%
Happy 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 31-47
Gender Female, 51.3%
Calm 79.5%
Sad 11.3%
Happy 3.3%
Angry 1.6%
Confused 1.3%
Surprised 1.2%
Disgusted 1.2%
Fear 0.7%

AWS Rekognition

Age 15-27
Gender Female, 83.9%
Sad 32.2%
Calm 29.5%
Happy 25.2%
Disgusted 5.4%
Fear 3.5%
Angry 2.4%
Confused 1.2%
Surprised 0.6%

AWS Rekognition

Age 23-35
Gender Male, 80.6%
Calm 74.4%
Happy 25.2%
Sad 0.2%
Surprised 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 21-33
Gender Female, 73.1%
Sad 91.4%
Calm 4.6%
Angry 3.2%
Happy 0.4%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 57-75
Gender Female, 87.5%
Calm 57.1%
Happy 14.8%
Sad 10.5%
Disgusted 5.8%
Angry 3.8%
Fear 3%
Surprised 2.8%
Confused 2.2%

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 98.6%
Hat 86.2%
Dog 81.9%

Categories

Imagga

paintings art 97.5%
people portraits 1.4%

Text analysis

Amazon

y
ELTI