Human Generated Data

Title

Untitled (Seminole woman with three children; youngest is drinking a Coke)

Date

1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11757

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Seminole woman with three children; youngest is drinking a Coke)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 99.5
Person 99.5
Person 99
Dance Pose 98.2
Leisure Activities 98.2
Person 97.5
Person 97.5
Person 95.8
Person 94.7
Apparel 91.9
Clothing 91.9
Painting 87.2
Art 87.2
Costume 85.9
Person 84.3
Person 80
Crowd 74.4
People 74.2
Performer 70.5
Sitting 67.9
Festival 67.8
Female 65.8
Sleeve 63.9
Dance 63.5
Plant 63.5
Outdoors 61.6
Sari 57.4
Silk 57.4
Tribe 57.3
Person 55.4
Long Sleeve 55

Imagga
created on 2022-02-05

cabaret 57.1
spot 45.2
place of business 34.4
man 28.2
male 27.8
people 24.5
establishment 22.9
together 21
adult 19.8
person 19
happy 18.8
couple 18.3
portrait 18.1
fun 15.7
art 14.9
child 14.9
smiling 14.5
love 13.4
friends 13.1
church 12.9
group 12.1
dance 11.7
room 11.7
lifestyle 11.6
smile 11.4
enjoying 11.4
disco 11.1
old 11.1
structure 10.9
nightclub 10.7
religion 10.7
handsome 10.7
god 10.5
party 10.3
casual 10.2
two 10.2
color 10
attractive 9.8
lady 9.7
cathedral 9.6
club 9.4
face 9.2
20s 9.2
teenager 9.1
music 9
black 9
nightlife 8.8
couch 8.7
prayer 8.7
dancing 8.7
sitting 8.6
men 8.6
culture 8.5
youth 8.5
sit 8.5
guy 8.5
passion 8.5
camera 8.3
teen 8.3
playing 8.2
style 8.2
cheerful 8.1
women 7.9
happiness 7.8
boy 7.8
kin 7.7
pretty 7.7
spirituality 7.7
expression 7.7
spiritual 7.7
faith 7.6
jeans 7.6
loving 7.6
religious 7.5
friendship 7.5
vintage 7.4
holding 7.4
musician 7.4
entertainment 7.4
dress 7.2
holiday 7.2
colorful 7.2
romantic 7.1
family 7.1
mother 7.1
night 7.1
husband 7.1

Google
created on 2022-02-05

Human 89.6
Textile 87.5
Sharing 87.1
Organism 86.6
Sari 81.1
Adaptation 79.5
Happy 76.5
Beauty 76.2
Lap 74
Event 73.9
Sitting 69
Design 68.3
Jewellery 66.6
Room 65.2
Photo caption 64
Child 63.7
Stock photography 63.1
Art 63.1
Tradition 62.8
Visual arts 62.5

Microsoft
created on 2022-02-05

person 99
text 96.6
clothing 94.8
human face 91.7
smile 85.1
woman 77.6
dance 68.4
celebration 56.7
people 55.2
family 18
crowd 2.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-59
Gender Female, 62.2%
Sad 86.7%
Calm 11.1%
Confused 0.9%
Surprised 0.4%
Fear 0.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 30-40
Gender Female, 98%
Calm 30.1%
Sad 22.4%
Confused 18.6%
Angry 11.8%
Disgusted 10.1%
Happy 3.4%
Surprised 2.1%
Fear 1.5%

AWS Rekognition

Age 16-24
Gender Female, 99.3%
Calm 94.7%
Sad 3.2%
Fear 0.5%
Confused 0.4%
Angry 0.4%
Surprised 0.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 0-4
Gender Male, 55.6%
Calm 89%
Sad 7%
Fear 3.6%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 4-12
Gender Female, 98.2%
Calm 99.1%
Sad 0.3%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 27-37
Gender Female, 58.6%
Sad 83.7%
Calm 4.6%
Fear 3.5%
Happy 3.4%
Angry 2.3%
Disgusted 1.1%
Confused 0.7%
Surprised 0.7%

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 87.2%

Captions

Microsoft

a group of people sitting posing for the camera 93.5%
a group of people posing for the camera 92.6%
a group of people posing for a picture 92.4%

Text analysis

Amazon

SARASOTA,
STEINMETZ, SARASOTA, FLORIDA
STEINMETZ,
FLORIDA

Google

STEINMETZ, SARASOTA, FLORIDA
STEINMETZ,
SARASOTA,
FLORIDA