Human Generated Data

Title

Untitled (children dancing in dance class)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15971

Human Generated Data

Title

Untitled (children dancing in dance class)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Person 99.6
Human 99.6
Person 98.9
Person 97.8
Leisure Activities 97.1
Dance Pose 97.1
Person 96.6
Clothing 96.2
Apparel 96.2
Person 93.9
Shorts 80.9
Stage 79.4
Flooring 74.6
People 74.6
Female 72.7
Dance 71.4
Chair 70.8
Furniture 70.8
Girl 63.6
Blonde 61.6
Child 61.6
Teen 61.6
Kid 61.6
Woman 61.6
Sleeve 59.6
Shoe 56.7
Footwear 56.7
Performer 55.2

Imagga
created on 2022-03-25

kin 34.1
people 25.1
man 20.8
male 19.9
person 19.2
couple 19.2
love 18.1
happiness 17.2
portrait 16.8
world 16.5
happy 15.7
military uniform 15.1
adult 14.9
clothing 13.6
sexy 12.8
fashion 12.1
dress 11.7
dark 11.7
uniform 11.6
silhouette 11.6
family 11.6
bride 11.5
together 11.4
group 11.3
fun 10.5
black 10.3
men 10.3
culture 10.2
smiling 10.1
wedding 10.1
groom 10
traditional 10
art 9.9
old 9.8
style 9.6
body 9.6
celebration 9.6
women 9.5
face 9.2
one 9
romantic 8.9
husband 8.7
hair 8.7
antique 8.7
party 8.6
model 8.6
smile 8.5
youth 8.5
bouquet 8.5
vintage 8.3
girls 8.2
religion 8.1
ancient 7.8
sculpture 7.8
attractive 7.7
two 7.6
skin 7.6
statue 7.6
wife 7.6
passion 7.5
decoration 7.3
covering 7.3
sensual 7.3
history 7.2

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

person 99.9
dance 98.2
clothing 96.7
standing 91
posing 81.9
group 72.2
text 71.3
footwear 65.9
dancing 56.1
woman 51.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Female, 100%
Disgusted 53.9%
Confused 30.2%
Angry 8.7%
Calm 4.8%
Sad 1.3%
Surprised 0.5%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 2-10
Gender Female, 100%
Fear 48.5%
Surprised 42.5%
Calm 6.3%
Confused 1.3%
Angry 0.4%
Sad 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 2-10
Gender Female, 65.1%
Calm 41.5%
Fear 31.6%
Confused 9.8%
Surprised 4.5%
Sad 4.5%
Angry 3.4%
Disgusted 2.6%
Happy 2.1%

AWS Rekognition

Age 2-8
Gender Female, 95.2%
Calm 87.1%
Fear 4.7%
Sad 4.5%
Confused 1.3%
Surprised 0.8%
Disgusted 0.7%
Angry 0.6%
Happy 0.2%

AWS Rekognition

Age 4-12
Gender Female, 97.4%
Calm 94.3%
Confused 2.2%
Angry 1.1%
Sad 1%
Fear 0.6%
Disgusted 0.4%
Surprised 0.4%
Happy 0.1%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 46.9%
Sad 20.7%
Confused 16.8%
Disgusted 6.8%
Surprised 2.9%
Fear 2.7%
Angry 2.1%
Happy 1%

AWS Rekognition

Age 22-30
Gender Male, 98%
Calm 86.4%
Sad 6.5%
Disgusted 2.7%
Fear 1.4%
Angry 1%
Confused 0.9%
Happy 0.6%
Surprised 0.5%

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 56.7%

Captions

Microsoft

Dick Jones et al. posing for a photo 93.6%
Dick Jones et al. posing for a picture 93.5%
Dick Jones et al. posing for the camera 93.4%