Human Generated Data

Title

Untitled (girls in matching polka dot outfits, Derry, New Hampshire)

Date

1954-1956, printed later

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.31

Human Generated Data

Title

Untitled (girls in matching polka dot outfits, Derry, New Hampshire)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1954-1956, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Apparel 99.6
Clothing 99.6
Person 99.5
Human 99.5
Person 99.3
Person 97.7
Dance Pose 97.6
Leisure Activities 97.6
Shorts 97.2
Person 95
Person 94.9
Stage 94.6
Person 93.7
Person 92.9
Female 91.6
Person 83.3
Woman 75.3
Shoe 69
Footwear 69
Skirt 68.5
People 63.1
Girl 62.1
Dress 58.8

Imagga
created on 2022-01-08

dancer 35.9
performer 35.6
person 33.2
entertainer 25.5
people 25.1
adult 23.8
kin 23.1
portrait 19.4
dress 18
sexy 17.6
attractive 17.5
fashion 17.3
male 15.7
happy 15.6
man 15.6
style 15.6
happiness 14.9
black 13.8
women 13.4
pretty 13.3
mother 13.2
model 13.2
child 13.1
clothing 12.8
world 12.5
family 12.4
couple 12.2
room 12.1
decoration 12
fun 12
traditional 11.6
face 11.4
lady 11.3
home 11.2
celebration 11.2
hair 11.1
doll 11
together 10.5
group 10.5
art 10.4
youth 10.2
elegance 10.1
makeup 10.1
vintage 9.9
childhood 9.8
love 9.5
party 9.4
lifestyle 9.4
cute 9.3
smile 9.3
indoor 9.1
teacher 8.9
body 8.8
professional 8.7
brunette 8.7
flowers 8.7
bride 8.6
luxury 8.6
culture 8.5
color 8.3
blond 8.2
girls 8.2
retro 8.2
posing 8
interior 8
colorful 7.9
holiday 7.9
boy 7.8
gift 7.7
men 7.7
two 7.6
pleasure 7.5
joy 7.5
cheerful 7.3
smiling 7.2
musical instrument 7.2
bouquet 7.1
kid 7.1

Google
created on 2022-01-08

Vertebrate 92.8
Human 89.8
Dress 89.5
Fashion 88
Mammal 86.8
Picture frame 86.7
Black-and-white 85.8
Style 84
Happy 80.3
Adaptation 79.3
People 78.2
Font 78.1
Monochrome 76.8
Monochrome photography 76.4
Art 73.6
Event 72.2
Fashion design 71.3
Vintage clothing 69.6
Design 68.3
Smile 65.3

Microsoft
created on 2022-01-08

wall 99.9
clothing 97.1
person 96.1
posing 95.2
text 94
footwear 93.2
indoor 88.1
woman 87.3
dance 83.9
smile 77
dress 71.8
group 59
dancer 56
human face 55.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 89.8%
Sad 73.2%
Confused 22%
Disgusted 2.7%
Fear 0.6%
Calm 0.6%
Surprised 0.5%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 4-10
Gender Female, 100%
Confused 52.9%
Sad 25.9%
Surprised 8.9%
Calm 5.9%
Angry 2.6%
Happy 1.7%
Disgusted 1.1%
Fear 1%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 77.2%
Happy 11.1%
Confused 4.5%
Sad 2%
Surprised 1.6%
Angry 1.5%
Disgusted 1.3%
Fear 0.8%

AWS Rekognition

Age 6-12
Gender Female, 100%
Happy 99.3%
Surprised 0.5%
Disgusted 0.1%
Confused 0.1%
Angry 0%
Sad 0%
Calm 0%
Fear 0%

AWS Rekognition

Age 6-12
Gender Female, 68.1%
Calm 89.8%
Angry 8.4%
Sad 0.8%
Confused 0.2%
Surprised 0.2%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 2-8
Gender Female, 96%
Calm 97.2%
Sad 0.7%
Confused 0.7%
Fear 0.4%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 6-14
Gender Male, 92.8%
Calm 67.2%
Happy 21.1%
Sad 5.1%
Confused 3.1%
Surprised 1.3%
Angry 1.1%
Disgusted 0.7%
Fear 0.4%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 97.2%
Sad 1.5%
Fear 0.5%
Surprised 0.4%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 69%

Captions

Microsoft

a group of people posing for a photo 96.5%
a group of people posing for a picture 96.4%
a group of people posing for the camera 96.3%