Human Generated Data

Title

Races, Negroes: United States. Virginia. Hampton. Hampton Normal and Industrial School: Hampton Normal and Agricultural Institute, Hampton, Va.: Hampton exstudents and their children.

Date

1899-1900

People

Artist: Frances Benjamin Johnston, American 1864 - 1952

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.471.2

Human Generated Data

Title

Races, Negroes: United States. Virginia. Hampton. Hampton Normal and Industrial School: Hampton Normal and Agricultural Institute, Hampton, Va.: Hampton exstudents and their children.

People

Artist: Frances Benjamin Johnston, American 1864 - 1952

Date

1899-1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

People 99.7
Family 99.7
Human 99.7
Person 99.4
Person 99.1
Person 98.6
Person 98.5
Painting 93.1
Art 93.1

Clarifai
created on 2019-06-05

people 100
group 99.8
adult 99
wear 98.5
offspring 97.2
child 96.6
woman 95.8
sibling 95
administration 94.9
leader 94.2
portrait 93.8
four 93.6
actress 93.3
man 93
group together 92.9
music 92.5
five 92.3
family 91.9
three 91.1
several 91.1

Imagga
created on 2019-06-05

kin 100
man 32.9
mother 31.3
couple 29.6
family 29.3
male 28.6
people 28.4
child 26.3
love 26
happy 25.7
portrait 23.3
together 21.9
smiling 21
parent 20.6
happiness 20.4
adult 19.6
home 17.5
person 16.1
father 15.5
fun 15
daughter 14.3
kid 13.3
attractive 13.3
husband 13.2
room 13.1
lifestyle 13
cheerful 13
dress 12.6
joy 12.5
boy 12.2
smile 12.1
group 12.1
two 11.9
bride 11.5
cute 11.5
men 11.2
old 11.1
women 11.1
sibling 11.1
fashion 10.5
married 10.5
marriage 10.4
wife 10.4
wedding 10.1
face 9.9
holding 9.9
groom 9.9
romance 9.8
pretty 9.8
lady 9.7
play 9.5
sitting 9.4
culture 9.4
senior 9.4
sexy 8.8
dad 8.8
day 8.6
brother 8.5
relationship 8.4
outdoors 8.2
playing 8.2
children 8.2
son 8.2
romantic 8
couch 7.7
casual 7.6
friendship 7.5
traditional 7.5
vintage 7.4
color 7.2
looking 7.2
handsome 7.1

Google
created on 2019-06-05

Photograph 97
People 96.5
Snapshot 88.2
Vintage clothing 82
Standing 79.6
Family 72.9
Child 64.5
Photography 62.4
Sibling 51.9
Retro style 51.3
Art 50.2

Microsoft
created on 2019-06-05

posing 99.7
wall 99.7
clothing 99.4
smile 96.6
human face 96.5
person 95.8
baby 94.2
holding 93.1
woman 89.9
toddler 89.4
standing 86.3
child 80.3
vintage clothing 73.5
photograph 73
old 71.9
dress 67.2
girl 58.3
vintage 25.1
family 15.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-7
Gender Female, 97.5%
Confused 0.7%
Surprised 0.5%
Angry 2%
Happy 1.6%
Sad 5.7%
Calm 88.3%
Disgusted 1.1%

AWS Rekognition

Age 26-43
Gender Male, 68.2%
Angry 6.5%
Sad 17.5%
Disgusted 13.7%
Calm 17.4%
Surprised 3.9%
Confused 8.9%
Happy 32.1%

AWS Rekognition

Age 15-25
Gender Male, 91%
Angry 0.3%
Confused 0.3%
Calm 2%
Surprised 0.4%
Sad 5.8%
Happy 90.9%
Disgusted 0.4%

AWS Rekognition

Age 10-15
Gender Female, 54.5%
Happy 45%
Sad 54.5%
Confused 45%
Calm 45.3%
Angry 45.1%
Disgusted 45%
Surprised 45%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 93.1%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 96.3%
a group of people posing for a photo 96.2%
a vintage photo of a group of people posing for a picture 96.1%

Text analysis

Amazon

69