Human Generated Data

Title

Untitled (group playing backgammon on deck at Coral Beach Club, Florida)
Date

1948
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11694
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group playing backgammon on deck at Coral Beach Club, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.7
Human 99.7
Furniture 99.3
Person 99.2
Person 99.1
Person 97.9
Person 96.8
Person 96.3
Shoe 87.3
Footwear 87.3
Clothing 87.3
Apparel 87.3
Table 86.9
People 85.7
Outdoors 76.8
Dining Table 70.7
Nature 68.1
Photography 65.8
Photo 65.8
Porch 64.5
Female 64.2
Portrait 63.9
Face 63.9
Shelter 59.6
Countryside 59.6
Building 59.6
Rural 59.6
Plant 57.7
Dress 56.8
Room 56.2
Indoors 56.2
Chair 55.8
Standing 55.6

Imagga
created on 2022-01-15

sea 37.5
beach 35.6
water 34
ocean 32.1
chair 28.9
sky 26.8
summer 26.4
man 26.2
vacation 24.6
musical instrument 24.2
sand 23.6
relax 21.9
travel 21.8
sun 21.7
coast 21.6
holiday 21.5
percussion instrument 20.1
tropical 19.6
outdoors 19.4
people 18.4
tourism 18.1
shore 17.7
resort 16.8
relaxation 16.7
leisure 15.8
sitting 15.5
lifestyle 15.2
marimba 15
silhouette 14.9
waves 14.9
sunset 14.4
day 13.3
person 13.3
couple 12.2
seat 11.8
clouds 11.8
laptop 11.8
vacations 11.3
boat 11.2
tourist 11
relaxing 10.9
male 10.6
rocking chair 10.6
fun 10.5
sunny 10.3
active 10
tranquil 10
recreation 9.9
landscape 9.7
surf 9.6
wave 9.5
coastline 9.4
calm 9.1
freedom 9.1
horizon 9
smiling 8.7
men 8.6
idyllic 8.5
two 8.5
holidays 8.4
pedestrian 8.2
sport 8.2
island 8.2
activity 8.1
seller 8
business 7.9
furniture 7.8
recreational 7.7
outside 7.7
destinations 7.7
seascape 7.6
bay 7.5
work 7.5
paradise 7.5
sunrise 7.5
lake 7.5
attendant 7.3
board 7.2
color 7.2
romance 7.1
happiness 7.1
device 7

Google
created on 2022-01-15

Chair 81
Adaptation 79.3
Table 79.2
Smile 77.6
Monochrome 75.3
Suit 73.7
Art 73.5
Monochrome photography 73.4
Vintage clothing 72.2
Room 68.3
Event 65.9
Sitting 65.5
Recreation 62.9
History 62.6
Stock photography 62.2
Illustration 60.7
Conversation 60
Photographic paper 59.5
Visual arts 57.1
Musical instrument 55.3

Microsoft
created on 2022-01-15

text 99.4
outdoor 98.4
person 87.6
furniture 86.5
chair 78
clothing 70.7
old 52
man 51.2
posing 39.7

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Female, 73.9%
Calm 99.9%
Sad 0.1%
Surprised 0%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 98.5%
Happy 90.6%
Calm 7.3%
Sad 0.5%
Angry 0.5%
Surprised 0.4%
Confused 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Female, 78.8%
Happy 67.2%
Sad 22.8%
Calm 3.7%
Surprised 2%
Disgusted 1.2%
Angry 1.2%
Confused 1.1%
Fear 0.7%

AWS Rekognition

Age 39-47
Gender Male, 56.2%
Happy 70.5%
Sad 22.1%
Confused 3.5%
Disgusted 1.3%
Calm 1.2%
Surprised 0.6%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 54-64
Gender Male, 99.3%
Calm 92.6%
Sad 4.4%
Surprised 0.8%
Angry 0.6%
Happy 0.6%
Disgusted 0.5%
Confused 0.5%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Female, 88%
Happy 85.4%
Calm 8.3%
Sad 3.4%
Angry 0.8%
Confused 0.8%
Surprised 0.6%
Disgusted 0.5%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 87.3%
Chair 55.8%

Captions

Microsoft

a group of people posing for a photo 93.9%
a group of people sitting posing for the camera 93.7%
an old photo of a group of people posing for the camera 92.7%

Text analysis

Amazon

23748
YT37AS
YT37AS NACOX
NACOX

Google

23748
23748