Human Generated Data

Title

Untitled (adults and child sitting at table near beach)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4579
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (adults and child sitting at table near beach)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 99.5
Person 99.5
Person 99.5
Person 99.4
Person 99.1
Person 98.5
Person 98.3
Person 98
Person 97.7
Person 95.8
Furniture 91.3
Food 89.6
Meal 89.6
Person 89.4
Vacation 88.5
Person 88.3
Plant 88.3
Chair 83.7
Restaurant 82.2
Sitting 78.3
Table 73.9
People 71.6
Crowd 70.2
Person 70.1
Dining Table 66.8
Tree 66
Flower 62.8
Blossom 62.8
Apparel 59.8
Clothing 59.8
Face 59.4
Cafeteria 59.3
Leisure Activities 59.1
Tablecloth 57.8
Picnic 56.4
Flower Arrangement 55.3
Person 43.5

Imagga
created on 2022-02-05

bikini 48.8
beach 39.7
vacation 33.5
swimsuit 30.5
summer 27.6
resort 26.7
sea 25.9
holiday 22.9
ocean 22.6
travel 21.8
water 20.7
tropical 19.6
tourism 19
outdoors 17.9
sand 17.7
attractive 17.5
leisure 17.4
person 17.2
sun 16.9
garment 16.8
relaxation 16.7
people 16.2
sexy 16.1
chair 16
swimming 15.3
clothing 15
relaxing 14.5
pool 14.4
sitting 13.7
lifestyle 13.7
luxury 13.7
adult 13.6
women 13.4
idyllic 13.2
outdoor 13
slim 12.9
sky 12.7
happy 12.5
body 12
happiness 11.7
smiling 11.6
man 11.4
vacations 11.3
enjoyment 11.3
fun 11.2
day 11
relax 10.9
model 10.9
restaurant 10.6
pretty 10.5
shore 10.4
table 10.4
holidays 10.3
island 10.2
coast 9.9
sunbathing 9.8
lounge 9.8
landscape 9.7
couple 9.6
sunny 9.5
hot 9.2
exotic 9.1
portrait 9.1
group 8.9
chairs 8.8
outside 8.6
covering 8.5
male 8.5
tourist 8.3
tranquil 8.1
posing 8
umbrella 8
together 7.9
color 7.8
tan 7.7
turquoise 7.7
lifestyles 7.6
paradise 7.5
friends 7.5
palm 7.5
destination 7.5
spectator 7.3
peace 7.3
hall 7.3
lady 7.3
gorgeous 7.2
handsome 7.1
trees 7.1
attendant 7
scenic 7

Google
created on 2022-02-05

Table 96.5
Sky 96.1
Photograph 94.2
Furniture 94.1
Plant 92.7
Chair 92
Dress 90.4
Tree 86.7
People on beach 84.7
Body of water 84.6
Tableware 83.6
Outdoor furniture 81.6
Arecales 81.6
Landscape 81.1
Morning 80
Leisure 80
Travel 79.6
Summer 79.1
Beach 78.5
Outdoor table 77.3

Microsoft
created on 2022-02-05

sky 99.7
beach 96.6
person 96.2
outdoor 92.8
text 90.1
clothing 83.8
woman 81.4
table 76.6
chair 69.8
furniture 68.9
people 58.2
summer 51
crowd 0.7

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 100%
Sad 54.3%
Disgusted 12.5%
Confused 11.9%
Calm 8.9%
Happy 7.9%
Angry 1.7%
Surprised 1.4%
Fear 1.3%

AWS Rekognition

Age 29-39
Gender Male, 82.8%
Happy 97.8%
Calm 0.7%
Sad 0.4%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Female, 100%
Happy 96.4%
Sad 1%
Angry 0.6%
Fear 0.5%
Confused 0.5%
Disgusted 0.4%
Calm 0.3%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Male, 55.7%
Calm 40.6%
Surprised 25.3%
Happy 13.3%
Disgusted 12.9%
Confused 4.7%
Angry 2.3%
Sad 0.5%
Fear 0.4%

AWS Rekognition

Age 0-4
Gender Female, 75%
Sad 94.3%
Disgusted 2.1%
Angry 1.9%
Fear 0.7%
Calm 0.7%
Confused 0.2%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 48.3%
Happy 41.6%
Disgusted 4.4%
Angry 2.2%
Confused 1.5%
Surprised 0.9%
Sad 0.7%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Female, 99.9%
Disgusted 55.7%
Calm 24.9%
Surprised 5.2%
Happy 3.1%
Angry 3.1%
Sad 3%
Fear 2.9%
Confused 2.2%

AWS Rekognition

Age 33-41
Gender Male, 98%
Calm 57.1%
Sad 17.4%
Happy 11.4%
Disgusted 4.7%
Confused 3.8%
Angry 3.5%
Fear 1.2%
Surprised 0.9%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Disgusted 92%
Calm 2.3%
Confused 1.9%
Sad 1.2%
Angry 1%
Surprised 0.8%
Fear 0.5%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 80.6%
Fear 24.9%
Happy 23.7%
Disgusted 14.5%
Sad 14.4%
Calm 6.2%
Surprised 6%
Confused 5.8%
Angry 4.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 83.7%

Captions

Microsoft

a group of people sitting at a beach 86.8%
a group of people sitting posing for the camera 82.4%
a group of people sitting at a table 75.8%

Text analysis

Amazon

FLORIDA
STEINMETZ, SARASOTA. FLORIDA
STEINMETZ,
SARASOTA.
P.A.A
RAGO»
MJR--YT334°8 RAGO» P.A.A
MJR--YT334°8

Google

SARASOTA,
STEINMETZ, SARASOTA, FLORIDA
FLORIDA
STEINMETZ,