Human Generated Data

Title

Untitled (Sarasota Yacht Club posing in front of flags)
Date

1948
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8679
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Sarasota Yacht Club posing in front of flags)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.9
Apparel 99.9
Person 99.9
Human 99.9
Person 99.9
Person 99.8
Shorts 99.6
Person 99.5
Shoe 99.4
Footwear 99.4
Person 99.4
Person 98.7
Person 98.6
Person 98.4
Person 98.2
Shoe 97.8
Flag 96.6
Symbol 96.6
Shoe 95.4
Shoe 92.3
Shoe 89.6
Shoe 87.8
T-Shirt 72.2
Text 66.2
Door 66
American Flag 65.9
Cap 63.9
Hat 63.9
Face 63.3
Portrait 60.8
Photography 60.8
Photo 60.8
Kid 60.7
Child 60.7
Pants 60
Crowd 59.5
Potted Plant 56.7
Pottery 56.7
Jar 56.7
Vase 56.7
Plant 56.7
Boy 56.3
Baseball Cap 56.2
People 55.8
Person 48.1

Imagga
created on 2022-01-09

helmet 100
football helmet 100
headdress 76.2
clothing 55.2
covering 28.2
consumer goods 28.1
people 26.2
man 22.2
city 19.9
person 19.3
sport 19.2
adult 18.1
portrait 16.8
fashion 15.8
male 15.6
black 15
equipment 14.9
men 13.7
urban 13.1
weight 12.9
exercise 12.7
sports equipment 12.7
women 12.6
athlete 12.4
model 11.7
human 11.2
youth 11.1
dress 10.8
motion 10.3
outdoor 9.9
fitness 9.9
pretty 9.8
posing 9.8
fun 9.7
dumbbell 9.6
hair 9.5
happy 9.4
street 9.2
competition 9.1
modern 9.1
business 9.1
silhouette 9.1
sexy 8.8
two 8.5
strength 8.4
training 8.3
leisure 8.3
outdoors 8.2
style 8.2
night 8
body 8
smiling 8
lifestyle 7.9
couple 7.8
sitting 7.7
track 7.7
athletic 7.7
casual 7.6
lifestyles 7.6
teen 7.3
active 7.3
girls 7.3
group 7.3
pose 7.2
building 7.2
transportation 7.2
cool 7.1
day 7.1
together 7

Google
created on 2022-01-09

Sleeve 87.2
Style 83.8
Black-and-white 83.3
Font 78
Crew 72
Monochrome photography 70.6
Monochrome 69.3
Event 68.5
T-shirt 66.7
Hat 66.1
Stock photography 64
Uniform 63.9
Team 58
Personal protective equipment 55.6
Room 55.5
History 54.3
Peaked cap 53.9

Microsoft
created on 2022-01-09

text 98.9
clothing 97.5
person 92.7
man 83.4
footwear 82.3
black and white 63.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Happy 98.9%
Confused 0.3%
Calm 0.3%
Disgusted 0.2%
Sad 0.1%
Surprised 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Calm 56.5%
Happy 21.6%
Sad 14%
Confused 5.4%
Surprised 1%
Disgusted 0.6%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Calm 94.5%
Happy 2.5%
Surprised 2%
Confused 0.3%
Sad 0.2%
Disgusted 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Happy 37%
Calm 32.9%
Surprised 27.6%
Fear 0.9%
Angry 0.5%
Confused 0.4%
Sad 0.4%
Disgusted 0.3%

AWS Rekognition

Age 47-53
Gender Male, 96.6%
Calm 98.6%
Happy 0.5%
Sad 0.4%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 64.9%
Happy 80%
Calm 18.3%
Disgusted 0.6%
Sad 0.3%
Angry 0.3%
Confused 0.3%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Calm 58.7%
Sad 18.1%
Happy 11.2%
Confused 6.4%
Angry 2.3%
Disgusted 1.7%
Surprised 1.2%
Fear 0.6%

AWS Rekognition

Age 38-46
Gender Male, 97.5%
Happy 64.4%
Calm 34.5%
Surprised 0.4%
Confused 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Male, 56%
Happy 53.7%
Calm 30.7%
Surprised 10.4%
Sad 1.8%
Fear 1%
Angry 0.9%
Disgusted 0.9%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 99.4%

Captions

Microsoft

a group of people standing in front of a store 66.1%
a group of people standing outside of a store 66%
a group of people standing in a store 60.7%

Text analysis

Amazon

SARASOTA
CLUB
YACHT CLUB
YACHT
24282
HICHT CLUB
NIGHT CLUB
HICHT
NIGHT
AS

Google

YT3RA2-MAGO
SARASOTA
SARASONA
YACHT
CHT
ACHT
CLUB
24282
YT3RA2-MAGO SARASOTA SARASOTA SARASONA YACHT CLUB CHT CLUS ACHT CLUB SARASOTA SARASOTA SARASOTA ACHT CLUB YACHT T CLUB CLUB SARASOTA SARASOTA ACHT CLUB ACHT CLUB 24282
CLUS
T