Human Generated Data

Title

Races, Negroes: United States. Virginia. Hampton. Hampton Normal and Industrial School: Hampton Normal and Agricultural Institute, Hampton, Va.: Hampton exstudents and their children.

Date

1899-1900

People

Artist: Frances Benjamin Johnston, American 1864 - 1952

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.471.1

Human Generated Data

Title

Races, Negroes: United States. Virginia. Hampton. Hampton Normal and Industrial School: Hampton Normal and Agricultural Institute, Hampton, Va.: Hampton exstudents and their children.

People

Artist: Frances Benjamin Johnston, American 1864 - 1952

Date

1899-1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.6
Human 99.6
Person 99.5
Person 98.7
Person 97.6
Person 97.2
Clothing 91
Shoe 91
Apparel 91
Footwear 91
People 86.4
Sitting 80.1
Suit 78.1
Overcoat 78.1
Coat 78.1
Furniture 67.7
Chair 65.8
Painting 60.3
Art 60.3
Family 57.2
Room 57.1
Indoors 57.1

Clarifai
created on 2019-06-05

people 100
group 99.4
adult 98.5
administration 96.7
leader 96.3
man 95.9
print 93.5
many 92.7
furniture 92.3
room 92.2
chair 91.8
wear 89.2
woman 87.2
military 84.3
several 84.2
sit 83.7
group together 83.7
offense 80.8
outfit 80.2
portrait 78.8

Imagga
created on 2019-06-05

kin 37.2
man 28.2
people 25.1
male 23.5
room 22.7
person 22
adult 19.9
world 18.6
couple 18.3
family 16
happiness 14.9
happy 14.4
love 13.4
child 13.4
classroom 12.6
silhouette 11.6
fun 11.2
mother 10.9
together 10.5
home 10.4
portrait 10.3
men 10.3
two 10.2
attractive 9.8
old 9.7
boy 9.6
women 9.5
lifestyle 9.4
business 9.1
lady 8.9
youth 8.5
casual 8.5
house 8.4
joy 8.3
aged 8.1
sunset 8.1
group 8.1
romantic 8
kid 8
smiling 8
indoors 7.9
play 7.8
husband 7.7
couch 7.7
parent 7.5
vintage 7.4
teacher 7.3
girls 7.3
new 7.3
grandfather 7.3
dress 7.2
looking 7.2
sibling 7.2
guy 7.2
smile 7.1
face 7.1
interior 7.1
businessman 7.1
clothing 7

Google
created on 2019-06-05

Photograph 96.1
People 95.2
Snapshot 84.3
Art 72.1
Family 67.6
Room 65.7
Visual arts 62.5
Photography 62.4
Vintage clothing 61.7
Picture frame 54.8

Microsoft
created on 2019-06-05

clothing 99.2
person 98.7
wall 98.2
smile 95.6
human face 95.3
woman 90.8
indoor 88.4
man 81.7
group 76.5
old 69.9
family 63.4
people 56.6
footwear 55.5
posing 52.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Female, 50.8%
Disgusted 46.1%
Confused 45.2%
Happy 45.1%
Sad 48.6%
Surprised 45.1%
Calm 48.3%
Angry 46.6%

AWS Rekognition

Age 30-47
Gender Female, 51.2%
Angry 45.5%
Surprised 45.2%
Disgusted 45.6%
Sad 52.5%
Happy 45.3%
Confused 45.5%
Calm 45.5%

AWS Rekognition

Age 26-44
Gender Female, 87.9%
Surprised 1.5%
Disgusted 3.2%
Sad 14.8%
Calm 74.5%
Happy 2.5%
Confused 0.7%
Angry 2.9%

AWS Rekognition

Age 20-38
Gender Female, 53.8%
Disgusted 46%
Confused 45.1%
Surprised 45.5%
Calm 47.7%
Happy 45.6%
Angry 45.6%
Sad 49.4%

AWS Rekognition

Age 23-38
Gender Female, 52.4%
Sad 50.6%
Angry 45.6%
Confused 45.2%
Happy 45.3%
Disgusted 45.8%
Surprised 45.3%
Calm 47.2%

AWS Rekognition

Age 4-7
Gender Female, 54.9%
Surprised 45.1%
Happy 45.1%
Confused 45.3%
Calm 46.4%
Disgusted 45.2%
Sad 51%
Angry 46.8%

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 91%
Suit 78.1%
Chair 65.8%
Painting 60.3%

Captions

Microsoft

a group of people posing for a photo 96%
a group of people posing for the camera 95.9%
a group of people posing for a picture 95.8%

Text analysis

Amazon

69a

Google

69a
69a