Human Generated Data

Title

Untitled (couple posing for picture, Florasota Gardens)
Date

1953
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8729
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple posing for picture, Florasota Gardens)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 99.8
Person 99.1
Human 99.1
Clothing 98.7
Apparel 98.7
Car 98
Transportation 98
Vehicle 98
Automobile 98
Person 95.5
Plant 92.3
Grass 88.2
Coat 85.6
Overcoat 85.6
Suit 85.6
Outdoors 83.9
Vegetation 83.1
Face 79.9
Tree 79
Chair 76.8
Sitting 75
Female 74
Nature 72.8
Flower 70.1
Blossom 70.1
Photography 69.7
Photo 69.7
Portrait 68.9
People 65.8
Footwear 65.7
Shoe 65.7
Fashion 63.8
Robe 63.8
Gown 62
Man 57.3
Bench 56.7
Machine 56.3
Wheel 56.3
Yard 56.3
Wedding 56.3
Person 42.9

Imagga
created on 2022-01-09

bench 100
park bench 100
seat 94.7
furniture 57.9
chair 42.3
park 34.6
outdoors 29.3
furnishing 26.1
summer 23.2
relax 20.2
outdoor 19.9
relaxing 19.1
rocking chair 17.4
day 16.5
sitting 16.3
people 16.2
outside 15.4
swing 15.3
sit 15.1
garden 15.1
wood 15
vacation 14.7
man 14.1
tree 13.8
child 13.8
adult 13.6
rest 13.5
grass 13.4
lifestyle 13
person 12.9
smile 12.8
male 12.8
relaxation 12.6
happy 12.5
leisure 12.5
autumn 12.3
couple 12.2
beach 11.8
family 11.6
trees 11.6
holiday 11.5
sun 11.3
fun 11.2
love 11
peaceful 11
sky 10.8
wooden 10.6
sea 10.2
mechanical device 10.2
plaything 10
pretty 9.8
kid 9.7
landscape 9.7
sunny 9.5
smiling 9.4
teen 9.2
old 9.1
little 8.8
forest 8.7
mother 8.5
two 8.5
vacations 8.5
portrait 8.4
ocean 8.3
fall 8.1
lady 8.1
coast 8.1
recreation 8.1
childhood 8.1
home 8
sand 7.9
chairs 7.8
happiness 7.8
season 7.8
cold 7.7
attractive 7.7
enjoying 7.6
mechanism 7.6
lawn 7.5
enjoy 7.5
senior 7.5
holidays 7.5
water 7.3
lake 7.3
cheerful 7.3
tranquil 7.2
building 7.2
work 7.2
romantic 7.1
travel 7
together 7

Google
created on 2022-01-09

Plant 89.8
Black-and-white 85.4
Gesture 85.3
Style 83.9
Tree 83.6
Adaptation 79.3
Tints and shades 77.4
Grass 75.6
Chair 75
Vintage clothing 74.6
Monochrome photography 73.2
Suit 73
Monochrome 71.4
Hat 69.3
Room 67.9
Comfort 67.7
Classic 67.4
Sitting 66.5
Stock photography 62.7
Photo caption 59.7

Microsoft
created on 2022-01-09

outdoor 97.5
text 92.8
black and white 91.6
furniture 85.9
bench 81.8
tree 72.9
chair 59.5
clothing 51.9
old 43.9

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Female, 69.3%
Happy 95.7%
Surprised 3.4%
Fear 0.4%
Calm 0.2%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 51-59
Gender Male, 98.9%
Calm 99.2%
Happy 0.3%
Surprised 0.1%
Sad 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Car 98%
Chair 76.8%
Shoe 65.7%
Bench 56.7%
Wheel 56.3%

Captions

Microsoft

a man sitting on a bench 87.9%
a man sitting on a bench in front of a building 81.2%
a man and a woman sitting on a bench 70.7%

Text analysis

Amazon

383
383 24.
24.
BED
YТ37-

Google

24.
383 24. YT37A°2- A
383
YT37A°2-
A