Human Generated Data

Title

Untitled (family standing on exterior staircase of large house)
Date

c. 1960
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8114
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family standing on exterior staircase of large house)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8114

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 97.8
Person 97.8
Military 97.1
Ship 97
Vehicle 97
Transportation 97
Person 96.1
Person 93.9
Person 93.1
Navy 92.5
Battleship 90.3
Person 86.8
Cruiser 84.7
Person 83
Face 71.5
Female 69.4
Photography 67.8
Portrait 67.8
Photo 67.8
Girl 62.8
People 62.1
Watercraft 60.5
Vessel 60.5
Dress 60.1
Apparel 60.1
Clothing 60.1
Water 59
Waterfront 55.9
Person 49.2

Clarifai
created on 2023-10-26

people 99.9
vehicle 98.8
group 98.7
man 98.5
adult 98.2
woman 98
group together 97.4
transportation system 97.2
railway 97.1
many 96.8
child 95.8
train 93.5
watercraft 93.5
seat 90.5
recreation 89.5
movie 88.6
monochrome 88.2
crowd 86.7
sit 86.4
administration 86

Imagga
created on 2022-01-15

billboard 34
newspaper 32.2
signboard 27.6
structure 26.1
product 25.2
sky 22.3
creation 20.8
water 18.7
travel 18.3
daily 15.4
architecture 14.2
tourism 14
people 13.9
landmark 13.5
tourist 13.4
city 13.3
man 12.8
money 12.8
financial 12.5
business 12.1
cash 11.9
old 11.8
clouds 11.8
sea 11.8
coast 11.7
history 11.6
cloud 11.2
landscape 11.2
bank 11.1
finance 11
beach 11
ocean 10.9
symbol 10.8
famous 10.2
banking 10.1
success 9.7
black 9.6
pay 9.6
capital 9.5
paper 9.5
day 9.4
dollar 9.3
currency 9
one 9
bills 8.7
urban 8.7
person 8.6
bay 8.6
statue 8.6
summer 8.4
outdoors 8.2
vacation 8.2
sun 8
bridge 8
light 8
river 8
market 8
male 7.8
facility 7.8
building 7.8
sculpture 7.7
loan 7.7
profit 7.7
exchange 7.6
relaxation 7.5
commerce 7.5
savings 7.5
rich 7.4
vintage 7.4
art 7.2
wealth 7.2
speedway 7.1
night 7.1
modern 7

Google
created on 2022-01-15

Black 89.6
Style 83.8
Black-and-white 82.3
Naval architecture 78.4
Font 75.3
Monochrome photography 75.2
Monochrome 70.8
Urban design 64.5
Room 64.5
Rectangle 64.4
Stock photography 61.9
Crew 59.6
Stairs 58.8
History 56.3
Recreation 55.8
Hat 54.9
Metal 51.2

Microsoft
created on 2022-01-15

boat 97
ship 96.7
text 96
black and white 85.5
people 58.1
person 51.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 97.6%
Calm 99%
Sad 0.7%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 50-58
Gender Male, 55.3%
Calm 52.8%
Sad 20.8%
Surprised 8.7%
Happy 7.8%
Angry 3.5%
Confused 2.6%
Disgusted 2.2%
Fear 1.7%

AWS Rekognition

Age 37-45
Gender Male, 60.7%
Calm 96%
Sad 1.5%
Confused 0.9%
Surprised 0.5%
Happy 0.5%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Male, 83.9%
Calm 95.5%
Happy 2.1%
Sad 1.6%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Calm 64.7%
Happy 22.1%
Sad 6.6%
Angry 2.4%
Surprised 2%
Fear 1.1%
Disgusted 0.7%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%

Captions

Microsoft
created on 2022-01-15

a group of people on a boat 49.1%
a group of people in a boat 49%
a group of people sitting on a boat 30.8%

Text analysis

Amazon

FLORIDA
STEINMETZ,
STEINMETZ, SARASOTA. FLORIDA
49219.
SARASOTA.
#8A
KODAKA-EITW

Google

u9219. STEINMETZ, SARASOTA, FLORIDA
u9219.
STEINMETZ,
SARASOTA,
FLORIDA