Human Generated Data

Title

Untitled (dubutante shaking hands with a man)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8525
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (dubutante shaking hands with a man)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 100
Apparel 100
Overcoat 99.7
Coat 99.7
Person 99.2
Human 99.2
Tie 98.2
Accessories 98.2
Accessory 98.2
Tuxedo 97.5
Person 96.9
Fashion 94.1
Gown 94.1
Person 94
Robe 93.8
Wedding 90.9
Female 89.6
Bridegroom 84.5
Dress 81.6
Wedding Gown 79.9
Bride 79.9
Suit 78.3
Woman 78.2
Suit 65.7
Face 61.5
Blossom 60.9
Flower 60.9
Plant 60.9
Man 60.2
Photography 59.4
Portrait 59.4
Photo 59.4
Chair 58.3
Furniture 58.3
Flower Arrangement 56.4
Person 46.5

Imagga
created on 2022-01-09

groom 73.1
man 47.7
person 43.1
male 39
people 35.2
patient 33.8
meeting 30.2
business 29.2
businessman 29.1
office 27.4
professional 26.7
adult 25.8
work 23.6
working 23
businesspeople 22.8
team 22.4
corporate 20.6
executive 20.5
worker 20.4
sitting 19.8
men 19.8
group 19.4
businesswoman 19.1
table 19.1
smiling 18.8
job 18.6
colleagues 18.5
case 18.4
room 18.3
medical 17.7
indoors 17.6
happy 17.6
couple 17.4
teamwork 16.7
sick person 16.7
talking 16.2
mature 15.8
occupation 15.6
lifestyle 15.2
desk 15.1
cheerful 14.6
women 14.2
doctor 14.1
senior 14.1
indoor 13.7
career 13.3
computer 12.8
confident 12.7
two 12.7
happiness 12.5
hospital 12.3
together 12.3
color 12.2
home 12
coworkers 11.8
40s 11.7
mid adult 11.6
busy 11.6
holding 11.6
health 11.1
suit 11.1
portrait 11
communication 10.9
employee 10.9
care 10.7
to 10.6
looking 10.4
education 10.4
casual 10.2
smile 10
coat 9.8
life 9.8
medicine 9.7
chair 9.6
presentation 9.3
face 9.2
successful 9.2
modern 9.1
laptop 9.1
attractive 9.1
success 8.9
associates 8.9
interior 8.8
conference 8.8
discussion 8.8
clothing 8.7
staff 8.6
boss 8.6
illness 8.6
manager 8.4
hand 8.4
clinic 8.3
necktie 8.3
20s 8.2
handsome 8
bow tie 8
love 7.9
businessmen 7.8
expertise 7.8
partner 7.7
hairdresser 7.7
corporation 7.7
laboratory 7.7
30s 7.7
elderly 7.7
uniform 7.6
showing 7.5
company 7.4
service 7.4
nurse 7.4
restaurant 7.3
day 7.1

Google
created on 2022-01-09

Photograph 94.2
Black 89.6
Coat 86.2
Black-and-white 85.7
Gesture 85.3
Style 83.9
Formal wear 76.1
Monochrome photography 75.1
Monochrome 74.4
Snapshot 74.3
Font 73.7
Event 73.4
Tie 72.4
Art 70.5
Fashion design 70.2
Suit 69.3
Vintage clothing 67.9
Stock photography 64.8
Room 61.6
White-collar worker 61.5

Microsoft
created on 2022-01-09

person 99.7
clothing 94
man 93.2
text 90.8
black and white 86.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 86%
Happy 45.4%
Sad 38.8%
Calm 7.1%
Confused 5.4%
Disgusted 1.2%
Angry 1%
Surprised 0.9%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Female, 94.7%
Calm 63.5%
Sad 11.8%
Angry 8.2%
Happy 8.1%
Surprised 3.9%
Disgusted 2%
Fear 1.3%
Confused 1.1%

AWS Rekognition

Age 26-36
Gender Male, 73.1%
Surprised 52.8%
Calm 32.3%
Fear 6.4%
Sad 4.4%
Disgusted 1.6%
Confused 0.9%
Happy 0.8%
Angry 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 98.2%
Suit 78.3%

Captions

Microsoft

a man and a woman standing in front of a window 83.5%
a man and woman standing in front of a window 76.4%
a man and a woman standing next to a window 76.3%

Text analysis

Amazon

12044
3