Human Generated Data

Title

Untitled (woman in polka dot dress with two men, Debutante Dinner Dance, Sunnybrook Golf Club, Pennsylvania)
Date

1941, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.304
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman in polka dot dress with two men, Debutante Dinner Dance, Sunnybrook Golf Club, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Couch 99.3
Furniture 99.3
Person 98.9
Human 98.9
Person 98.6
Person 98.1
Clothing 97.2
Apparel 97.2
Chair 97.1
Sitting 96
Living Room 80.1
Room 80.1
Indoors 80.1
Home Decor 75
Shirt 73.1
Wood 68
Pants 65
LCD Screen 63.1
Electronics 63.1
Screen 63.1
Monitor 63.1
Display 63.1
Suit 61
Coat 61
Overcoat 61
Finger 59.2
Face 57.5
Shoe 57
Footwear 57
Plant 56.5
Sleeve 55.8
Floor 55.5
Flooring 55

Imagga
created on 2022-01-08

musical instrument 60.7
wind instrument 36.9
accordion 30.5
keyboard instrument 25
person 24.3
chair 22.5
man 22.2
people 20.6
male 19.9
stringed instrument 19.8
table 19.2
room 16.9
adult 16.3
interior 15.9
bowed stringed instrument 15.7
scholar 15.4
brass 15
sitting 13.7
house 12.5
intellectual 12.3
business 12.1
silhouette 11.6
device 11.2
home 11.2
inside 11
working 10.6
businessman 10.6
modern 10.5
style 10.4
indoors 9.7
sun 9.7
computer 9.7
office 9.6
men 9.4
day 9.4
work 8.9
technology 8.9
group 8.9
restaurant 8.7
couple 8.7
glass 8.6
guitar 8.4
professional 8.4
holding 8.3
laptop 8.2
happy 8.1
team 8.1
teacher 7.9
harmonica 7.7
executive 7.6
leisure 7.5
student 7.2
music 7.2
lifestyle 7.2
musician 7.2
black 7.2
hair 7.1
free-reed instrument 7.1
viola 7

Google
created on 2022-01-08

Chair 89.3
Style 83.8
Adaptation 79.2
Font 75.6
Event 72.4
Monochrome 72.1
Monochrome photography 71.1
Suit 70.7
Lap 70.1
Vintage clothing 70.1
Sitting 67.3
Room 66
Stock photography 65.3
Art 62.5
Photo caption 62.2
Classic 59.3
Retro style 55.4
Conversation 54.7
Fun 51.9

Microsoft
created on 2022-01-08

person 99.1
text 97.1
man 96.1
clothing 91.4
black and white 69.7
drawing 63.1
old 62.4
human face 58.1
cartoon 56.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 55.8%
Surprised 39.7%
Fear 34%
Happy 19.8%
Sad 2.4%
Calm 1.5%
Disgusted 1%
Angry 0.9%
Confused 0.6%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 89.5%
Sad 5.1%
Confused 1.9%
Surprised 1.5%
Disgusted 0.6%
Angry 0.6%
Fear 0.5%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Female, 97.5%
Fear 99.7%
Calm 0.1%
Sad 0.1%
Surprised 0.1%
Happy 0%
Disgusted 0%
Angry 0%
Confused 0%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Shoe 57%

Captions

Microsoft

a vintage photo of a man 89.9%
an old photo of a man 88.7%
a vintage photo of a man sitting in a chair 81.9%