Human Generated Data

Title

Untitled (couple on balcony overlooking ocean)
Date

c. 1960
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11756
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple on balcony overlooking ocean)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11756

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.1
Human 99.1
Balcony 98.5
Person 98.3
Railing 74.9
Handrail 56.1
Banister 56.1
Person 47.8

Clarifai
created on 2023-10-29

sunset 99.1
beach 97.8
chair 97.6
sea 97.1
ocean 95.9
sun 95.4
vacation 94.9
travel 94.7
light 94.7
dawn 93.5
water 92.8
table 92.6
hotel 91.8
summer 91.8
people 91.4
family 91.3
woman 88.2
girl 87.5
evening 87.3
couple 86

Imagga
created on 2022-02-05

percussion instrument 36.5
musical instrument 32.4
deck 30
structure 24.6
vibraphone 23.2
barrier 20.9
interior 20.3
architecture 20.3
device 19.4
sky 17.9
silhouette 17.4
city 16.6
building 15.7
modern 15.4
marimba 15.1
light 14.7
support 14.5
obstruction 14.3
bridge 13.4
table 13
man 12.8
pier 12.7
wall 12.7
sunset 12.6
house 12.5
chair 12.5
patio 12.5
urban 12.2
travel 12
room 11.3
office 11.2
evening 11.2
people 11.2
business 10.9
glass 10.9
water 10.7
night 10.7
inside 10.1
dark 10
sun 9.9
home 9.6
dusk 9.5
work 9.4
clouds 9.3
wood 9.2
ocean 9.1
balcony 9
landscape 8.9
gate 8.7
sunrise 8.4
grand piano 8.3
tourism 8.2
area 8.1
transportation 8.1
stringed instrument 7.9
sea 7.8
construction 7.7
skyline 7.6
floor 7.4
design 7.3
indoor 7.3
new 7.3
keyboard instrument 7.3
steel 7.1
life 7

Google
created on 2022-02-05

Water 95.7
Sky 90.1
Lighting 86.6
Chair 82.5
Rectangle 79.9
Morning 79.3
Wood 78.2
Tints and shades 77.1
Outdoor furniture 76.4
Horizon 71.9
Magenta 69.4
Design 68.5
Travel 68
Room 63.1
Handrail 62.7
Stock photography 62.3
Font 61.3
Evening 60.1
Ocean 58.8
Night 58.6

Microsoft
created on 2022-02-05

furniture 96.6
chair 95.8
text 91.4
table 87
sky 76.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 94.3%
Happy 79.5%
Angry 7.9%
Surprised 3.8%
Confused 2.8%
Sad 2.7%
Disgusted 1.3%
Calm 1.2%
Fear 0.7%

AWS Rekognition

Age 48-54
Gender Male, 95.7%
Sad 83.3%
Calm 12.5%
Confused 1.3%
Disgusted 0.7%
Happy 0.7%
Angry 0.6%
Fear 0.6%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.1%
Person 98.3%
Person 47.8%

Categories

Imagga

interior objects 94%
paintings art 3.3%

Captions

Text analysis

Amazon

FLORIDA
SARASOTA.
STEINMETZ. SARASOTA. FLORIDA
STEINMETZ.
825
KOOK 825
KOOK

Google

STEINMETZ. SARASOTA. FLORIDA
STEINMETZ.
SARASOTA.
FLORIDA