Human Generated Data

Title

Untitled (four wedding guests seated near windows)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8482
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four wedding guests seated near windows)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Clothing 99.8
Apparel 99.8
Person 99.3
Human 99.3
Person 98.7
Person 97.9
Furniture 97.8
Chair 96.2
Plant 90.9
Potted Plant 88.1
Vase 88.1
Jar 88.1
Pottery 88.1
Face 85.9
Female 79.4
Sitting 76.8
Shirt 75.8
Pants 74.8
Suit 71.2
Coat 71.2
Overcoat 71.2
Couch 69.8
Portrait 69.6
Photography 69.6
Photo 69.6
Tree 69.1
Flower Arrangement 65.2
Flower 65.2
Blossom 65.2
Woman 63.8
Head 62.7
Shoe 62.6
Footwear 62.6
Crowd 62.3
Person 60.5
Robe 59.9
Fashion 59.9
Man 58.3
Shorts 57.6
Gown 57.3
Girl 57
Ikebana 55.5
Ornament 55.5
Art 55.5
Planter 55.2

Imagga
created on 2022-01-15

man 34.9
people 33.5
male 29.8
person 29.2
adult 24.7
couple 21.8
happiness 20.4
family 19.6
groom 19
nurse 18.8
businessman 18.5
home 18.3
men 18
indoors 16.7
smiling 16.6
business 16.4
smile 16.4
together 15.8
happy 15.7
mother 15.3
lifestyle 15.2
women 15
day 14.9
mature 14.9
room 14.8
sitting 14.6
two 14.4
bride 14.4
love 14.2
senior 14.1
professional 13.4
patient 13.3
salon 13.2
table 13
kin 12.6
teacher 12.5
cheerful 12.2
musical instrument 12.1
wedding 11.9
indoor 11.9
dress 11.7
hairdresser 11.7
portrait 11.6
talking 11.4
group 11.3
life 11.3
seller 10.8
married 10.5
new 10.5
husband 10.5
old 10.4
meeting 10.4
casual 10.2
care 9.9
job 9.7
interior 9.7
togetherness 9.4
stringed instrument 9.1
businesswoman 9.1
handsome 8.9
color 8.9
office 8.8
medical 8.8
casual clothing 8.8
elderly 8.6
marriage 8.5
businesspeople 8.5
wife 8.5
worker 8.4
communication 8.4
health 8.3
holding 8.2
daughter 8
romantic 8
discussing 7.9
face 7.8
40s 7.8
case 7.8
discussion 7.8
corporate 7.7
modern 7.7
30s 7.7
outdoors 7.5
phone 7.4
occupation 7.3
work 7.3
aged 7.2
black 7.2
romance 7.1
child 7

Google
created on 2022-01-15

Photograph 94.1
Plant 92.1
Black-and-white 86
Style 83.9
Adaptation 79.4
Monochrome photography 76.1
Suit 76
Happy 75.8
Tree 75.3
Snapshot 74.3
Event 72
Monochrome 71.8
Chair 70
Art 68.5
Room 66.2
Font 65.1
Vintage clothing 64.7
Photo caption 63.8
Stock photography 63.3
Sitting 62.6

Microsoft
created on 2022-01-15

person 99
text 96
clothing 79.1
black and white 62.4
flower 62.3
man 59.7

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 79.4%
Calm 44.7%
Sad 43.3%
Confused 4.9%
Happy 4.4%
Angry 0.9%
Fear 0.7%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 51-59
Gender Male, 96.7%
Calm 99.8%
Sad 0.1%
Happy 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Chair 96.2%
Shoe 62.6%

Captions

Microsoft

a group of people around each other 83%
a group of people standing in front of a building 82.9%
a group of people standing next to a building 81.8%

Text analysis

Amazon

1
14744.

Google

14744. 14744. 1
14744.
1