Human Generated Data

Title

Untitled (people gathered in a circle singing at a luau on City Island)
Date

c. 1955
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10477
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people gathered in a circle singing at a luau on City Island)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.5
Person 99.5
Person 99.1
Person 98.9
Person 98.4
Person 97.9
Person 97.3
Person 96.3
Person 95.4
Person 94.6
Musical Instrument 91.1
Horse 90.5
Animal 90.5
Mammal 90.5
Accordion 88.7
Person 88.7
Person 75.2
Musician 65.9
Person 63.4
Photography 61.8
Face 61.8
Photo 61.8
Portrait 61.8
Music Band 58.5
Person 55.8
Person 44.9

Imagga
created on 2022-01-09

wind instrument 100
musical instrument 100
keyboard instrument 100
accordion 100
man 29.5
people 24
male 22.7
concertina 17.7
person 15.8
adult 15
old 14.6
free-reed instrument 14.2
men 13.7
music 12.7
silhouette 12.4
art 12.4
portrait 12.3
couple 12.2
musician 11.8
black 10.8
musical 10.5
senior 10.3
retro 9.8
style 9.6
together 9.6
sitting 9.4
lifestyle 9.4
instrument 9.3
face 9.2
vintage 9.1
religion 9
retirement 8.6
play 8.6
statue 8.6
culture 8.5
youth 8.5
hand 8.3
playing 8.2
group 8.1
indoors 7.9
love 7.9
boy 7.8
two 7.6
studio 7.6
player 7.5
happy 7.5
traditional 7.5
monument 7.5
room 7.3
aged 7.2
history 7.1
family 7.1

Google
created on 2022-01-09

Hat 89.8
Art 76.4
Monochrome 75.6
Sun hat 75.6
Monochrome photography 74.8
Snapshot 74.3
Crowd 72.4
Event 71.4
Crew 70.5
Room 70
Vintage clothing 67.6
Stock photography 65.1
History 64.5
Visual arts 63
Team 61.9
Suit 60.8
Illustration 57.5
Font 54.2
Painting 52.3
Photography 51.7

Microsoft
created on 2022-01-09

person 98.8
text 98.5
black and white 90.4
people 67.6
group 65.8
man 64.5
clothing 53.5
crowd 1

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 98.8%
Surprised 36.3%
Calm 19.9%
Confused 19.9%
Happy 9.2%
Disgusted 8.6%
Sad 3%
Angry 2.3%
Fear 0.9%

AWS Rekognition

Age 38-46
Gender Female, 71%
Calm 99.3%
Sad 0.3%
Happy 0.2%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 26-36
Gender Female, 57.8%
Calm 91%
Sad 5.4%
Confused 1%
Happy 0.7%
Surprised 0.5%
Angry 0.5%
Fear 0.5%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Horse 90.5%

Captions

Microsoft

a group of people around each other 94.4%
a group of people sitting and standing in front of a crowd 93.9%
a group of people sitting in front of a crowd 93.1%

Text analysis

Amazon

44545
MJ17--YT3RA--X