Human Generated Data

Title

Untitled (Head Dress Ball - Bellevue Stratford: Philadelphia, Pennsylvania)

Date

1940, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.259

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Head Dress Ball - Bellevue Stratford: Philadelphia, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Performer 99.6
Human 99.6
Person 99.5
Person 99.2
Person 99.2
Person 98.6
Crowd 81.2
Clothing 73.7
Apparel 73.7
Leisure Activities 72.6
Hat 72
Person 72
Clown 71.1
Hat 63.3
Musician 58.1
Musical Instrument 58.1
Guitar 56.6
Guitarist 56.6
Pub 55.4

Imagga
created on 2022-01-08

bride 33.9
dress 28.9
wedding 28.5
hat 26.8
portrait 26.5
person 25.3
people 25.1
clothing 25
groom 24.5
fashion 24.1
adult 22.7
love 22.1
couple 20.9
man 18.8
happiness 18.8
gown 18.5
attractive 17.5
happy 16.9
sexy 16.9
elegance 16.8
male 16.4
pretty 16.1
hair 15.8
black 15.7
model 15.5
bouquet 15.5
studio 15.2
marriage 15.2
face 14.9
ceremony 14.5
headdress 13.9
flowers 13.9
event 13.9
covering 13.7
suit 13.5
romantic 13.4
party 12.9
wed 12.8
celebration 12.8
cowboy hat 12.6
brunette 12.2
cute 12.2
lady 12.2
smile 12.1
human 12
women 11.9
mask 11.8
veil 11.7
bridal 11.7
flower 11.5
together 11.4
costume 11.2
style 11.1
expression 11.1
emotion 11.1
romance 10.7
married 10.5
husband 10.5
sensuality 10
roses 9.7
disguise 9.6
special 9.6
wife 9.5
eyes 9.5
youth 9.4
two 9.3
skin 9.3
church 9.2
makeup 9.1
gorgeous 9.1
art 9
handsome 8.9
look 8.8
lifestyle 8.7
elegant 8.6
tie 8.5
life 8.5
color 8.3
girls 8.2
make 8.2
religion 8.1
posing 8
commitment 7.9
hands 7.8
diamond 7.7
consumer goods 7.6
seductive 7.6
head 7.6
relationship 7.5
holding 7.4
world 7.4
body 7.2
family 7.1
modern 7

Google
created on 2022-01-08

Photograph 94.2
White 92.2
Smile 91.1
Black 89.9
Hat 88.6
Black-and-white 85.8
Gesture 85.3
Style 84.1
Dress 83.5
Font 81.5
Headgear 80.9
Art 80.8
Picture frame 75
Monochrome photography 74.8
Monochrome 74.3
Snapshot 74.3
Event 73.4
Happy 70.4
Vintage clothing 69.2
Costume hat 68.6

Microsoft
created on 2022-01-08

text 97.7
cartoon 95.7
posing 94.1
person 91.1
human face 87.6
drawing 87
window 85.9
clothing 85.2
sketch 75.5
smile 72.8
people 69.3
woman 64.7
black and white 59.7
old 45.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 99.1%
Surprised 0.4%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 97.1%
Happy 0.8%
Sad 0.6%
Confused 0.5%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 39-47
Gender Female, 100%
Calm 61.1%
Angry 11.3%
Surprised 9.3%
Sad 8.6%
Fear 6.1%
Confused 1.9%
Disgusted 1.2%
Happy 0.4%

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Surprised 86.5%
Fear 7.8%
Calm 2.8%
Angry 1.1%
Disgusted 0.6%
Sad 0.5%
Confused 0.5%
Happy 0.3%

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 72%

Captions

Microsoft

a group of people posing for a photo 97.2%
a group of people posing for the camera 97.1%
a group of people posing for a picture 97%

Text analysis

Amazon

55