Human Generated Data

Title

Untitled (Sun-Debs, Sarasota, Florida)
Date

1949, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Sun-Debs, Sarasota, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-21

Person 99.7
Human 99.7
Person 99.7
Person 99.3
Person 99.1
Person 99.1
Clothing 98.7
Apparel 98.7
Person 96.5
Person 96.2
Person 95
Bench 94.4
Furniture 94.4
Person 93.5
Person 92.9
Outdoors 92.5
Nature 91.8
Female 87.3
Water 86.4
Swimwear 84.5
Sand 84.1
Vacation 83.9
Shorts 80.6
Chair 80.3
People 79.8
Sea 77.4
Ocean 77.4
Face 76.1
Bikini 73.1
Plant 70.2
Person 69.8
Woman 67.7
Portrait 67.4
Photography 67.4
Photo 67.4
Shoreline 67.2
Grass 64.5
Girl 64.3
Coast 62.1
Crowd 61.7
Sport 58.6
Sports 58.6
Field 56.9
Person 49.7

Imagga
created on 2022-05-21

people 21.8
man 19.3
person 16.5
men 16.3
male 16.3
group 15.3
adult 15.2
beach 14.5
outdoors 14.2
clothing 13.7
sea 13.3
sand 13.2
lifestyle 13
silhouette 12.4
sky 12.1
summer 11.6
water 11.3
leisure 10.8
travel 10.6
portrait 10.3
business 10.3
musical instrument 9.9
team 9.9
crowd 9.6
couple 9.6
women 9.5
relax 9.3
ocean 9.2
bathing cap 9.2
chair 9.1
equipment 9.1
fashion 9
suit 9
fun 9
sun 8.9
sport 8.8
life 8.7
light 8.7
party 8.6
waves 8.4
happy 8.1
cap 8.1
building 8
body 8
businessman 7.9
holiday 7.9
day 7.8
black 7.8
model 7.8
attractive 7.7
walking 7.6
human 7.5
vacation 7.4
music 7.2
sunset 7.2
smile 7.1
swimsuit 7.1
covering 7.1

Google
created on 2022-05-21

Smile 87.6
Swimwear 80.8
Brassiere 80.7
Happy 77.3
One-piece swimsuit 76.1
Boats and boating--Equipment and supplies 71.1
Underpants 70.7
Crew 70.7
Recreation 69.2
Leisure 68.9
Advertising 68.2
Room 67.5
Monochrome photography 66.7
Thigh 65.7
Fun 65.6
Team 63
Monochrome 62.7
Vintage clothing 62.5
Photo caption 61.9
Stock photography 61.8

Microsoft
created on 2022-05-21

text 94.9
person 89.1
clothing 78.8
footwear 72.7
beach 61
posing 58

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Female, 99.4%
Happy 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%
Calm 0.1%

AWS Rekognition

Age 43-51
Gender Female, 100%
Happy 82.1%
Surprised 7.3%
Confused 7.2%
Fear 6.1%
Calm 4.1%
Sad 2.8%
Angry 1.3%
Disgusted 0.7%

AWS Rekognition

Age 24-34
Gender Female, 100%
Happy 99.4%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Calm 0%

AWS Rekognition

Age 19-27
Gender Female, 99.1%
Happy 97.2%
Surprised 6.6%
Fear 6%
Sad 2.2%
Calm 0.7%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 13-21
Gender Female, 100%
Calm 95.6%
Surprised 6.6%
Fear 6%
Sad 2.5%
Confused 1.1%
Disgusted 0.7%
Angry 0.4%
Happy 0.2%

AWS Rekognition

Age 0-6
Gender Female, 99.7%
Sad 83.5%
Angry 48.8%
Surprised 7.3%
Fear 6.3%
Disgusted 3.8%
Calm 3.7%
Confused 2%
Happy 0.5%

AWS Rekognition

Age 26-36
Gender Male, 92.6%
Calm 55%
Sad 35.3%
Happy 14.3%
Surprised 6.5%
Fear 6.4%
Confused 3.2%
Disgusted 1.7%
Angry 1.4%

AWS Rekognition

Age 31-41
Gender Female, 99.7%
Happy 57.6%
Angry 35.3%
Surprised 7%
Fear 6.5%
Sad 2.3%
Calm 2.1%
Disgusted 1%
Confused 0.5%

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 81.4%
Angry 9.9%
Surprised 7.5%
Fear 6.3%
Sad 2.6%
Disgusted 1.9%
Calm 1.2%
Confused 0.5%

AWS Rekognition

Age 21-29
Gender Female, 98.4%
Happy 52.9%
Calm 32.3%
Fear 9.5%
Surprised 7%
Sad 2.6%
Angry 2.3%
Disgusted 1.1%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Male, 95.8%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.3%
Confused 0.2%
Happy 0.1%
Angry 0%

AWS Rekognition

Age 14-22
Gender Female, 86.3%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.9%
Disgusted 0.6%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 10-18
Gender Female, 80.6%
Angry 42.9%
Happy 32.3%
Calm 9.1%
Surprised 8.3%
Fear 6.7%
Sad 4.5%
Disgusted 3%
Confused 1.6%

AWS Rekognition

Age 18-24
Gender Male, 96.8%
Calm 87.8%
Fear 9.1%
Surprised 6.5%
Happy 2.6%
Sad 2.4%
Angry 0.5%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 28-38
Gender Female, 98.7%
Sad 97%
Calm 26.5%
Disgusted 16.1%
Surprised 7.7%
Fear 6.3%
Happy 1.2%
Confused 1%
Angry 0.6%

AWS Rekognition

Age 18-26
Gender Male, 89.2%
Calm 45.8%
Sad 45.4%
Fear 8.7%
Surprised 7.6%
Angry 7.3%
Confused 5.4%
Disgusted 4.3%
Happy 3%

AWS Rekognition

Age 29-39
Gender Female, 99.6%
Calm 63.8%
Disgusted 12.5%
Happy 12%
Surprised 6.7%
Fear 6.2%
Angry 6%
Sad 3.2%
Confused 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Bench 94.4%

Captions

Microsoft

a group of people posing for a photo 90.4%
a group of people posing for the camera 90.3%
a group of people posing for a picture 90.2%

Text analysis

Amazon

SARASOTA
SUN-DEBS

Google

SARASOTA SUN-DEBS
SARASOTA
-
SUN
DEBS