Human Generated Data

Title

Untitled (Mask & Wig performer dressed as woman talking to man)
Date

1938
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7466
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Mask & Wig performer dressed as woman talking to man)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.5
Apparel 99.5
Tie 98.1
Accessories 98.1
Accessory 98.1
Person 97
Human 97
Person 95.8
Suit 95.4
Overcoat 95.4
Coat 95.4
Text 80.2
Tuxedo 78.8
Sleeve 74.9
Door 62.6
Shorts 58.2
Shirt 57.7
Female 57.5
Evening Dress 56.9
Fashion 56.9
Gown 56.9
Robe 56.9

Imagga
created on 2022-01-08

person 33.6
man 30.9
male 28.4
adult 22.7
professional 19.6
people 19.5
businessman 19.4
business 17.6
nurse 17
clothing 16.8
men 15.4
portrait 14.9
teacher 14.5
planner 14.4
handsome 14.3
job 14.1
work 13.3
old 13.2
black 12
player 11.8
religion 11.6
contestant 11.3
patient 10.9
golfer 10.8
worker 10.8
medical 10.6
looking 10.4
doctor 10.3
statue 10.3
corporate 10.3
suit 10.2
casual 10.2
occupation 10.1
hand 10
uniform 9.6
standing 9.6
happy 9.4
religious 9.4
mature 9.3
holding 9.1
art 8.8
full length 8.7
guy 8.5
clothes 8.4
coat 8.2
human 8.2
team 8.1
educator 8
day 7.8
happiness 7.8
staff 7.8
profession 7.7
god 7.6
chart 7.6
adults 7.6
20s 7.3
industrial 7.3
success 7.2
catholic 7.2
smile 7.1
face 7.1

Google
created on 2022-01-08

Outerwear 95.4
Sleeve 87.2
Coat 85.6
Style 83.8
Collar 82.4
Blazer 78.3
Font 78.2
Formal wear 73.8
Duster 71
Overcoat 70.5
Monochrome photography 69.4
Fashion design 68.8
Monochrome 66.9
Suit 66.7
Vintage clothing 66.6
Uniform 64.4
Art 64.3
Eyewear 62.9
Stock photography 62.5
Advertising 60.5

Microsoft
created on 2022-01-08

text 99.4
outdoor 98.5
person 96.8
man 95.6
posing 92.8
standing 90.1
clothing 86.9
drawing 85.4
old 73.6
black 66.9

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Female, 65.3%
Calm 98.7%
Happy 0.5%
Sad 0.4%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Female, 56.7%
Calm 55.7%
Disgusted 16.3%
Angry 11.6%
Happy 8.9%
Surprised 3.2%
Fear 1.8%
Confused 1.6%
Sad 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.1%
Person 97%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.6%
a vintage photo of a man and woman posing for a picture 87.3%
a vintage photo of a group of people posing for a picture 87.2%

Text analysis

Amazon

UND
OF
OF P
P
NDW
8712
LIBERTY
UND T
NM
T
م
YT33A2
VANIA
A
UNIVER
YEA
OW YEA
MJI3 YT33A2 A30A
OW
FULL
MJI3
A30A

Google

MJI3 YT33A2 A3JA UND ERTY OM YEA. NDW OF P 8712 UNIVE ANIA 8712
MJI3
YT33A2
A3JA
UND
ERTY
OM
YEA.
NDW
OF
P
8712
UNIVE
ANIA