Human Generated Data

Title

Untitled (couple seated at table watching hula dancer perform with band, Sarasota, Florida)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11774

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated at table watching hula dancer perform with band, Sarasota, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.7
Human 99.7
Person 99.7
Person 99.6
Person 99.2
Person 99
Guitar 99
Leisure Activities 99
Musical Instrument 99
Food 89.1
Meal 89.1
Restaurant 87.3
Furniture 87
Dining Table 86.5
Table 86.5
Tablecloth 85.9
Guitar 83.8
Home Decor 80.9
Dish 80.2
Chair 79.9
Person 79.5
Flooring 68.4
Person 65.5
People 64.9
Stage 64.2
Food Court 62.8
Floor 61.4
Indoors 61
Night Life 60.9
Room 60.4
Musician 57.1
Dance Pose 56.8
Linen 56.7

Imagga
created on 2022-02-05

silhouette 34.8
person 33.5
people 32.9
crowd 26.9
music 26.2
party 24.9
audience 24.4
lights 20.4
bass 20.3
cheering 19.6
nighttime 19.6
stadium 19.5
event 19.4
patriotic 19.2
nation 18.9
flag 18.5
night 17.8
dance 17.6
symbol 16.8
dancer 16.8
icon 16.6
concert 16.5
male 16.3
musical 16.3
disco 16.3
design 15.8
sexy 15.3
theater curtain 15
glowing 14.8
star 14.4
stage 14.3
man 14.1
vibrant 14
group 13.7
home theater 13.5
art 13.5
adult 13
player 13
musician 12.9
club 12.2
guitar 12.1
curtain 11.9
band 11.7
performance 11.5
black 11.5
light 11.4
human 11.2
pretty 11.2
shiny 11.1
love 11
theater 10.8
bright 10.7
happy 10.7
match 10.6
classical 10.5
style 10.4
celebration 10.4
electric 10.3
competition 10.1
versus 9.9
attractive 9.8
shorts 9.8
nightclub 9.8
lady 9.7
fun 9.7
championship 9.7
pop 9.7
dancing 9.6
skill 9.6
muscular 9.6
athlete 9.5
men 9.4
performer 9.4
happiness 9.4
training 9.2
playing 9.1
portrait 9.1
blind 9
acoustic 8.8
live 8.8
decoration 8.7
women 8.7
rock 8.7
blackboard 8.6
holiday 8.6
model 8.6
grunge 8.5
passion 8.5
platform 8.4
structure 8.4
field 8.4
hand 8.4
dark 8.4
fashion 8.3
against 8.3
sport 8.2
park 8.2
building 8.2
cheerful 8.1
looking 8
body 8
instruments 7.9
couple 7.8
gloves 7.8
youth 7.7
pleasure 7.5
pink 7.5
house 7.5
joy 7.5
sound 7.5
vivid 7.4
frame 7.4
room 7.4
teenager 7.3
sensual 7.3
purple 7.3
posing 7.1

Google
created on 2022-02-05

Photograph 94.3
Table 91.6
Purple 89.9
Black 89.8
Chair 88.6
Violet 81.5
Adaptation 79.2
People 77.7
Magenta 77.6
Sharing 76.1
Event 74.8
Snapshot 74.3
Room 70.7
Vintage clothing 67
Tablecloth 66.1
Stock photography 65.1
History 63.9
Tableware 60
Recreation 59.5
Fun 58.2

Microsoft
created on 2022-02-05

concert 94.5
text 93.8
person 93.2
music 92.8
clothing 92.4
band 82.7
dance 72.8
man 70.8
live music 65.1
musical instrument 55.3
old 46.2

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 73.5%
Calm 47%
Happy 16.5%
Sad 15.9%
Disgusted 6.9%
Fear 5.1%
Angry 4.2%
Surprised 3.4%
Confused 1%

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 51.7%
Surprised 21%
Confused 12.3%
Angry 3.9%
Sad 3.6%
Disgusted 3.4%
Happy 2.3%
Fear 1.9%

AWS Rekognition

Age 36-44
Gender Female, 74.7%
Calm 91.3%
Happy 2.9%
Sad 2.8%
Angry 1.8%
Disgusted 0.6%
Confused 0.2%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 41-49
Gender Male, 98.4%
Angry 20.8%
Calm 17.3%
Disgusted 17.1%
Surprised 13.5%
Confused 11.9%
Sad 11.7%
Fear 5.7%
Happy 2.2%

AWS Rekognition

Age 48-54
Gender Male, 98%
Calm 100%
Sad 0%
Confused 0%
Happy 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 95.6%
Calm 58.8%
Sad 18%
Angry 13.9%
Surprised 3.8%
Happy 2.5%
Confused 1%
Disgusted 1%
Fear 1%

AWS Rekognition

Age 11-19
Gender Male, 52.7%
Calm 92.7%
Sad 2.7%
Disgusted 1.2%
Surprised 1.2%
Angry 0.9%
Confused 0.6%
Happy 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Guitar 99%

Captions

Microsoft

a group of people posing for a photo 85.3%
a group of people posing for the camera 85.2%
a group of people posing for a picture 85.1%

Text analysis

Amazon

FLORIDA
SARASOTA.
STEINMETZ. SARASOTA. FLORIDA
STEINMETZ.

Google

STEINMETZ
SARASOTA.
FLORIDA
STEINMETZ SARASOTA. FLORIDA