Human Generated Data

Title

Untitled (people playing shuffleboard by the beach)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10755

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people playing shuffleboard by the beach)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.6
Human 99.6
Person 99
Path 91.2
Person 87.4
Person 86.7
Person 86.4
Plant 81.9
Tree 81.9
Building 80.8
Person 77.6
Outdoors 76.5
Nature 76.5
Bench 72.7
Furniture 72.7
Urban 69.3
Architecture 67.4
Town 67.3
City 67.3
Person 67.2
Tarmac 66.3
Asphalt 66.3
Walkway 64.1
Road 64
Person 62.3
Sidewalk 61.9
Pavement 61.9
Grass 58.7
Weather 55.5
Landscape 55.5
Person 46.9

Imagga
created on 2022-01-15

park bench 100
seat 100
bench 100
furniture 70.2
furnishing 34.4
sky 30
landscape 27.5
clouds 22
outdoor 21.4
trees 20.5
beach 19.7
ocean 19.1
travel 18.3
water 18
winter 17.9
snow 17.3
city 16.6
park 16.5
sea 16.4
tree 16.2
sand 15.7
architecture 15.6
chair 15
summer 14.8
vacation 14.7
road 14.5
coast 14.4
sun 12.9
building 12.8
relax 12.6
horizon 12.6
season 12.5
cold 12.1
fence 11.9
peaceful 11.9
grass 11.9
street 11.1
island 11
day 11
wood 10.9
scenic 10.5
cloud 10.3
lake 10.1
holiday 10
scenery 9.9
tourism 9.9
forest 9.6
color 8.9
lonely 8.7
scene 8.7
resort 8.4
history 8.1
river 8
night 8
weather 8
autumn 7.9
urban 7.9
outside 7.7
tropical 7.7
lawn 7.5
paradise 7.5
house 7.5
sunrise 7.5
shore 7.4
peace 7.3
alone 7.3
support 7
nobody 7

Google
created on 2022-01-15

Plant 90.6
Black 89.6
Building 88.4
Black-and-white 86.9
Sky 85.3
Architecture 85.1
Style 84.1
Line 81.7
Rectangle 81.6
Picture frame 79.7
Adaptation 79.3
Monochrome 77.4
Tints and shades 77.3
Urban design 77.3
Monochrome photography 77.1
Grass 75.9
Font 75.4
Landscape 75.2
Beauty 75.1
City 74.4

Microsoft
created on 2022-01-15

outdoor 98.2
black and white 93.9
sky 65.9
playground 60.9
text 60.5

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 97.6%
Calm 78%
Sad 11%
Fear 5.1%
Angry 1.7%
Happy 1.7%
Disgusted 1.1%
Confused 1%
Surprised 0.5%

AWS Rekognition

Age 18-26
Gender Male, 99.4%
Calm 90.9%
Angry 5.3%
Fear 1.1%
Happy 1%
Sad 0.9%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 12-20
Gender Male, 68.7%
Calm 65.1%
Disgusted 23.4%
Angry 4%
Fear 2.2%
Surprised 1.9%
Sad 1.6%
Happy 1.4%
Confused 0.4%

AWS Rekognition

Age 19-27
Gender Female, 77%
Calm 92.9%
Sad 3%
Happy 1.8%
Surprised 0.9%
Angry 0.5%
Confused 0.4%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Female, 84.1%
Sad 97.7%
Calm 1.3%
Fear 0.5%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Bench 72.7%

Captions

Microsoft

a person sitting in front of a building 67.4%
a person sitting in front of a building 59.9%
a person standing in front of a building 59.8%

Text analysis

Amazon

48662

Google

KODVK --2VEEIA--EIT W
--2VEEIA--EIT
KODVK
W