Human Generated Data

Title

Untitled (crowd of people on sailboat with accordian)
Date

c. 1946
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10564
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people on sailboat with accordian)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 98.3
Person 98.3
Person 97.5
Boat 96.9
Transportation 96.9
Vehicle 96.9
Person 96.7
Interior Design 89.2
Indoors 89.2
Sunglasses 87.6
Accessory 87.6
Accessories 87.6
Person 86.4
Person 82.1
Person 80.7
Person 80.5
Leisure Activities 78.6
Musical Instrument 76.4
Person 75.3
Person 73.1
Person 71.9
Person 71.2
Face 70.7
Clothing 66.2
Apparel 66.2
Musician 65.4
Photography 62.6
Photo 62.6
Portrait 62.6
Waterfront 60.6
Water 60.6
People 60.4
Port 59.7
Dock 59.7
Pier 59.7
Building 57.8
Person 54.4

Imagga
created on 2022-01-09

sea 54.1
water 40
ocean 39.3
boat 34.5
vacation 31.1
beach 29.7
travel 29.6
summer 27
coast 26.9
tourism 23.1
sky 22.3
newspaper 22.1
boats 21.3
yacht 21
holiday 18.6
ship 17.9
marina 17.8
product 17.2
shore 16.7
island 16.5
harbor 16.4
tourist 15.6
luxury 15.4
port 15.4
sand 15.2
outdoors 15
sailing 14.6
sun 14.5
coastline 14.1
resort 14
people 13.9
sail 13.6
creation 13.4
leisure 13.3
bay 13.2
clothing 13
landscape 12.6
relax 12.6
vessel 11.8
dock 11.7
paradise 11.3
lake 11.3
swimsuit 11
pier 10.8
man 10.7
garment 10.5
vacations 10.3
sailboat 10.3
tropical 10.2
waves 10.2
relaxation 10
relaxing 10
cruise 9.7
nautical 9.7
scenic 9.7
fishing 9.6
seascape 9.6
day 9.4
destination 9.3
person 9.3
sport 9.3
calm 9.1
reflection 9.1
yachts 8.9
rock 8.7
destinations 8.6
swimming trunks 8.6
outdoor 8.4
peaceful 8.2
horizon 8.1
transportation 8.1
shop 7.8
wave 7.8
sunny 7.7
covering 7.7
clouds 7.6
adventure 7.6
rocks 7.5
journey 7.5
shoe shop 7.3
conch 7.2
scenery 7.2
deck 7.2
sunset 7.2
recreation 7.2

Google
created on 2022-01-09

Water 95.3
Black 89.9
Boat 87.3
Black-and-white 86.4
Naval architecture 85.3
Style 84
Boats and boating--Equipment and supplies 83.5
Vehicle 82.3
Monochrome photography 75.4
Monochrome 75.2
Watercraft 75.1
Crew 72.3
Ship 70.2
Water transportation 67.9
Recreation 67.8
Canoe 65.2
Room 64.9
Stock photography 64.2
Team 62.4
Sitting 60.7

Microsoft
created on 2022-01-09

text 98.7
ship 91.5
person 86.4
old 41.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 99.3%
Happy 99.5%
Surprised 0.2%
Calm 0.1%
Sad 0.1%
Fear 0%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 26-36
Gender Male, 57.2%
Calm 98.8%
Sad 0.5%
Angry 0.3%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 67.7%
Calm 87.5%
Confused 5.8%
Sad 2%
Happy 1.5%
Surprised 1.4%
Disgusted 0.9%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 35-43
Gender Female, 99.4%
Sad 75.2%
Calm 15.8%
Angry 2.3%
Happy 2%
Confused 1.4%
Surprised 1.4%
Disgusted 1%
Fear 0.9%

AWS Rekognition

Age 33-41
Gender Female, 91.4%
Disgusted 38.7%
Angry 27.6%
Surprised 14.6%
Calm 5.2%
Happy 5.2%
Confused 3.6%
Sad 2.6%
Fear 2.4%

AWS Rekognition

Age 37-45
Gender Male, 75.5%
Sad 30.7%
Happy 25.5%
Calm 22.2%
Confused 8.5%
Angry 7.2%
Surprised 2.8%
Disgusted 1.5%
Fear 1.5%

AWS Rekognition

Age 26-36
Gender Male, 87.4%
Surprised 61.5%
Sad 22.6%
Calm 12.3%
Confused 2.3%
Disgusted 0.7%
Angry 0.3%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 67.8%
Calm 37.9%
Confused 25.2%
Sad 23.2%
Angry 4.1%
Surprised 3.9%
Fear 2.4%
Disgusted 2.1%
Happy 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Boat 96.9%
Sunglasses 87.6%

Captions

Microsoft

a vintage photo of a group of people on a boat 65.5%
a group of people on a boat 65.4%
a vintage photo of a group of people in a boat 65.3%

Text analysis

Amazon

21671.
275

Google

21676
21676