Human Generated Data

Title

Untitled (bride and groom walking down steps)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8330
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (bride and groom walking down steps)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Apparel 99.9
Clothing 99.9
Hat 99.6
Person 98.6
Human 98.6
Person 98.5
Person 96.4
Tie 89.3
Accessories 89.3
Accessory 89.3
Face 82.1
Costume 80.2
Coat 79.9
Suit 79.9
Overcoat 79.9
Person 75
Sun Hat 71.5
Advertisement 68.2
Cowboy Hat 67.5
Collage 67
Food 64.2
Meal 64.2
Photography 60.7
Photo 60.7
Mammal 60.4
Animal 60.4
Indoors 56.4
Poster 50.9

Imagga
created on 2022-01-09

hairdresser 54.5
salon 45.1
barbershop 37.1
people 36.8
man 36.3
shop 34.5
person 27.8
male 27.7
professional 23.1
mercantile establishment 22.9
adult 22.8
office 21.2
medical 21.2
work 19.6
happy 19.4
doctor 17.9
patient 17.6
indoors 17.6
portrait 17.5
business 17
men 16.3
place of business 15.2
smiling 15.2
job 15
working 15
room 14.9
worker 14.7
looking 14.4
home 14.4
occupation 13.7
indoor 13.7
hospital 13.7
women 13.4
businessman 13.2
lifestyle 12.3
couple 12.2
senior 12.2
clinic 12.2
sitting 12
two 11.9
team 11.6
care 11.5
medicine 11.4
face 11.4
modern 11.2
businesspeople 10.4
health 10.4
black 10.2
casual 10.2
smile 10
family 9.8
cheerful 9.7
to 9.7
coat 9.7
group 9.7
laboratory 9.6
color 9.5
corporate 9.4
mature 9.3
holding 9.1
interior 8.8
computer 8.8
mother 8.8
two people 8.7
lab 8.7
colleagues 8.7
mid adult 8.7
profession 8.6
desk 8.5
employee 8.4
attractive 8.4
teamwork 8.3
student 8.1
chair 8.1
science 8
happiness 7.8
scientist 7.8
standing 7.8
education 7.8
check 7.7
life 7.7
test 7.7
30s 7.7
illness 7.6
establishment 7.6
talking 7.6
meeting 7.5
manager 7.4
clothing 7.4
technology 7.4
style 7.4
glasses 7.4
nurse 7.4
treatment 7.3
girls 7.3
bright 7.1
handsome 7.1

Google
created on 2022-01-09

Photograph 94.2
Hat 92.5
Picture frame 90.6
Sun hat 87.1
Style 83.9
Black-and-white 83.4
Art 79.5
Vintage clothing 75.1
Snapshot 74.3
Suit 73.9
Monochrome photography 71.1
Monochrome 70.9
Room 69.3
Event 67.8
History 63.8
Victorian fashion 63.7
Stock photography 62.7
Costume hat 62
Classic 62
Formal wear 57.1

Microsoft
created on 2022-01-09

text 98.4
black and white 94
clothing 88.6
person 87.5
human face 87
fashion accessory 62.8
smile 58.1

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 96.4%
Sad 68.7%
Calm 29.5%
Angry 0.6%
Confused 0.5%
Happy 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Female, 88.6%
Calm 81.7%
Surprised 13.5%
Sad 2.8%
Fear 0.8%
Angry 0.5%
Happy 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 70%
Happy 13.7%
Sad 7.1%
Confused 4.1%
Disgusted 2.1%
Angry 1.5%
Surprised 0.8%
Fear 0.8%

AWS Rekognition

Age 29-39
Gender Male, 91.3%
Calm 99.3%
Happy 0.3%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 21-29
Gender Female, 68.6%
Calm 38.2%
Sad 24.1%
Fear 19.4%
Disgusted 5.1%
Angry 4.9%
Happy 3.3%
Surprised 2.5%
Confused 2.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.6%
Person 98.6%
Tie 89.3%
Poster 50.9%

Captions

Microsoft

a man and a woman standing in front of a mirror 68%
a person standing in front of a mirror posing for the camera 67.9%
a person standing in front of a mirror 67.8%

Text analysis

Amazon

9928.

Google

9928.
9928. 9928. nian 9928. 9928.
nian