Human Generated Data

Title

Untitled (Sarasota artist dressed in costumes for Beaux Art Ball)
Date

1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7586
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Sarasota artist dressed in costumes for Beaux Art Ball)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7586

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.6
Apparel 99.6
Person 99.5
Human 99.5
Person 99.4
Person 96.8
Person 96.5
Shorts 95.8
Person 95.6
Person 92.8
Female 88.9
Face 86.5
Person 84.2
People 80.7
Woman 72.2
Person 69.7
Portrait 66.7
Photography 66.7
Photo 66.7
Girl 64.8
Text 63.3
Outdoors 60.6
Advertisement 60.6
Crowd 60.5
Sleeve 58.6
Poster 58.4
Furniture 58.1
Person 56.3

Clarifai
created on 2023-10-25

people 100
many 99.1
adult 99
monochrome 98.9
group together 98.8
group 98.7
woman 97.4
wear 96.1
man 95.9
several 95.4
child 88.1
administration 87
street 86.3
recreation 80.6
leader 79
crowd 78
furniture 76.3
music 75.4
outfit 74.5
war 74.3

Imagga
created on 2022-01-08

person 34.1
people 32.4
groom 31.1
bride 27.8
couple 26.1
wedding 23.9
adult 22.6
dress 22.6
male 20.7
happy 20.7
love 19.7
man 19.5
patient 18
men 17.2
two 16.9
bouquet 16
family 16
new 15.4
married 15.3
happiness 14.9
life 14.5
women 14.2
fan 14.1
together 14
portrait 13.6
ceremony 13.6
marriage 13.3
world 13.1
teacher 12.3
room 12.1
church 12
husband 11.6
smiling 11.6
case 11.5
follower 11.4
hands 11.3
celebration 11.2
old 11.1
sick person 10.8
smile 10.7
kin 10.6
fashion 10.6
indoors 10.5
business 10.3
gown 10
romantic 9.8
bridal 9.7
group 9.7
home 9.6
senior 9.4
professional 9.3
elegance 9.2
mother 9
human 9
flowers 8.7
wife 8.5
hand 8.4
clothing 8.3
tradition 8.3
religion 8.1
newly 7.9
holiday 7.9
veil 7.8
face 7.8
educator 7.7
engagement 7.7
youth 7.7
formal 7.6
religious 7.5
future 7.4
holding 7.4
cheerful 7.3
girls 7.3
suit 7.2
romance 7.1

Google
created on 2022-01-08

Photograph 94.2
Black 89.8
Human 89.1
Shorts 86.8
Black-and-white 86.2
Style 84
Font 81.4
Adaptation 79.3
Monochrome 76.1
Snapshot 74.3
Monochrome photography 73.2
Art 72.7
Hat 72.4
Vintage clothing 72.4
Event 70.8
Room 70.7
Photo caption 68.2
Stock photography 66.9
Classic 66.7
T-shirt 66.5

Microsoft
created on 2022-01-08

text 99.6
clothing 96.3
person 94.2
dress 87.9
woman 78.3
footwear 61.4
man 50.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Calm 50.2%
Sad 25.8%
Confused 8.8%
Surprised 4.3%
Disgusted 4.3%
Happy 3.2%
Fear 2.1%
Angry 1.2%

AWS Rekognition

Age 37-45
Gender Male, 85.8%
Happy 80.3%
Calm 12%
Sad 2.9%
Confused 1.7%
Surprised 1.5%
Disgusted 0.8%
Angry 0.6%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Male, 97.4%
Sad 63.7%
Calm 29.4%
Angry 3.4%
Disgusted 0.9%
Surprised 0.9%
Confused 0.8%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 45-53
Gender Female, 60.6%
Calm 98.9%
Happy 0.3%
Confused 0.2%
Sad 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 60.1%
Sad 55.5%
Fear 22.2%
Calm 8.9%
Confused 6.9%
Surprised 2.6%
Angry 1.4%
Disgusted 1.3%
Happy 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft
created on 2022-01-08

text 66.7%

Text analysis

Amazon

COBALT
CADMIUM
&
CADMIUM RED
COBALT BLI
Newton
Winsor & Newton
Winsor
RED
insor
BLI
R
BOST
Artists
insor ONDON & Newton ENGLA
Cola
Artists OF Cola
8
ONDON
ENGLA
P.V
Text
OF

Google

COBALT BLI CADMIUM R 3A2-AGON
COBALT
BLI
CADMIUM
R
3A2-AGON