Human Generated Data

Title

Untitled (New Orleans, Louisiana)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1521
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New Orleans, Louisiana)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1521

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Person 98.7
Person 98
Adult 98
Male 98
Man 98
Person 97.7
Male 97.7
Boy 97.7
Child 97.7
Person 97.6
Male 97.6
Boy 97.6
Child 97.6
Person 97.1
Male 97.1
Boy 97.1
Child 97.1
Person 96.6
Person 96.4
Male 96.4
Boy 96.4
Child 96.4
Person 95.9
Male 95.9
Boy 95.9
Child 95.9
Person 90.8
Adult 90.8
Bride 90.8
Female 90.8
Wedding 90.8
Woman 90.8
Person 90.3
Person 86.9
Adult 86.9
Male 86.9
Man 86.9
Person 85.8
Animal 84.7
Canine 84.7
Dog 84.7
Mammal 84.7
Pet 84.7
Person 84.1
Face 83.3
Head 83.3
Wildlife 81.7
Clothing 67.3
Footwear 67.3
Shoe 67.3
Bear 64.7
Black Bear 64.7
Person 59.8
Shoe 57.9
Ape 57.7
Zoo 56

Clarifai
created on 2018-05-11

people 100
group 99.4
adult 98.6
many 97.5
administration 97.5
man 96.9
group together 96.9
military 95.4
war 93.9
several 92.1
child 91.9
police 91.9
woman 89
offense 88.2
wear 87
leader 85.4
vehicle 84.3
recreation 81.9
soldier 80.4
canine 78

Imagga
created on 2023-10-07

musical instrument 34.2
man 26.9
people 25.1
percussion instrument 24
bass 22.2
male 19.2
person 18.5
adult 17.7
brass 17.5
wind instrument 16.7
men 15.4
drum 15.1
business 14.6
work 14.6
steel drum 13.9
teacher 12.3
group 12.1
hand 11.4
indoors 10.5
happy 10
laptop 10
team 9.8
job 9.7
educator 9.5
women 9.5
uniform 9.1
worker 8.9
office 8.8
computer 8.8
device 8.8
musician 8.7
corporate 8.6
smile 8.5
two 8.5
music 8.3
street 8.3
technology 8.2
professional 8
businessman 7.9
together 7.9
couple 7.8
old 7.7
casual 7.6
outdoors 7.5
meeting 7.5
human 7.5
religious 7.5
leisure 7.5
entertainment 7.4
student 7.3
black 7.2
suit 7.2
handsome 7.1
travel 7

Google
created on 2018-05-11

black 95.4
photograph 95.3
mammal 92.6
black and white 91.2
vertebrate 90.4
snapshot 81.8
monochrome photography 75.4
monochrome 67.5
human behavior 62.5

Microsoft
created on 2018-05-11

person 100
group 80.6
people 74.7
mammal 56.9
crowd 23.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Female, 53%
Calm 53.4%
Confused 18.7%
Happy 12.1%
Sad 10.1%
Surprised 6.6%
Fear 6.1%
Angry 1.9%
Disgusted 1.1%

AWS Rekognition

Age 16-24
Gender Female, 63.4%
Calm 67.8%
Fear 14%
Surprised 8.7%
Happy 4.6%
Sad 3.4%
Angry 2.3%
Confused 2.2%
Disgusted 1.4%

AWS Rekognition

Age 6-16
Gender Male, 99.8%
Calm 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 1.4%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 2-10
Gender Female, 87.6%
Sad 100%
Calm 8%
Surprised 6.3%
Fear 5.9%
Confused 2.5%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Male, 69.6%
Sad 100%
Calm 18.3%
Surprised 6.3%
Fear 5.9%
Confused 0.7%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Sad 100%
Surprised 6.5%
Fear 6%
Calm 3.2%
Confused 1.2%
Angry 0.5%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 18-24
Gender Male, 99.9%
Happy 50.7%
Calm 42.5%
Surprised 8.5%
Fear 6%
Sad 2.3%
Confused 0.9%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 2-8
Gender Female, 98.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.3%
Confused 0.2%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 14-22
Gender Male, 80.3%
Sad 99.1%
Calm 39.2%
Surprised 6.3%
Fear 5.9%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99%
Calm 95.3%
Surprised 6.4%
Fear 5.9%
Sad 2.9%
Angry 0.9%
Disgusted 0.5%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 94.3%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.2%
Confused 0.9%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 48-56
Gender Female, 73.9%
Calm 70%
Happy 14%
Surprised 8.4%
Fear 6.1%
Sad 4%
Angry 3.2%
Disgusted 2.3%
Confused 1.8%

AWS Rekognition

Age 22-30
Gender Male, 97%
Calm 84.5%
Sad 9.4%
Surprised 6.4%
Fear 5.9%
Happy 2.7%
Confused 1%
Angry 0.4%
Disgusted 0.2%

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 15
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Boy
Child
Bride
Female
Woman
Dog
Shoe
Person 98.7%
Person 98%
Person 97.7%
Person 97.6%
Person 97.1%
Person 96.6%
Person 96.4%
Person 95.9%
Person 90.8%
Person 90.3%
Person 86.9%
Person 85.8%
Person 84.1%
Person 59.8%
Adult 98%
Adult 90.8%
Adult 86.9%
Male 98%
Male 97.7%
Male 97.6%
Male 97.1%
Male 96.4%
Male 95.9%
Male 86.9%
Man 98%
Man 86.9%
Boy 97.7%
Boy 97.6%
Boy 97.1%
Boy 96.4%
Boy 95.9%
Child 97.7%
Child 97.6%
Child 97.1%
Child 96.4%
Child 95.9%
Bride 90.8%
Female 90.8%
Woman 90.8%
Dog 84.7%
Shoe 67.3%
Shoe 57.9%

Categories

Imagga

people portraits 66.5%
paintings art 29.4%
pets animals 1.9%
food drinks 1.4%