Human Generated Data

Title

Untitled (two men and a woman with large dog)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8386
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men and a woman with large dog)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 97.1
Human 97.1
Person 96.7
Person 96.2
Clothing 94.4
Apparel 94.4
Tie 93.7
Accessories 93.7
Accessory 93.7
Canine 86.3
Mammal 86.3
Animal 86.3
Pet 81
Suit 80
Overcoat 80
Coat 80
Face 66.7
Indoors 60.7
Puppy 59.8
Dog 59.8
Couch 59.3
Furniture 59.3
Home Decor 58.1
Curtain 57.9
Chair 57.8
Photography 57.2
Photo 57.2
Door 56.5
Poster 56
Advertisement 56
Shirt 55.9

Imagga
created on 2022-01-09

lab coat 46.7
coat 41.4
man 38.3
vestment 37.6
male 33.3
clothing 31.8
person 31.4
ruler 31.2
gown 30.7
people 30.1
medical 24.7
professional 24.6
doctor 23.5
outerwear 22.6
adult 22
men 19.7
patient 19.6
work 18.8
garment 18.5
hospital 18.1
business 17
health 16
worker 15.1
businessman 15
medicine 15
occupation 14.7
job 14.1
indoors 14
portrait 13.6
face 13.5
profession 13.4
office 12.8
senior 12.2
corporate 12
happy 11.9
room 11.8
team 11.6
metropolitan 11.6
nurse 11.4
couple 11.3
looking 11.2
student 11.1
women 11.1
lab 10.7
hand 10.6
laboratory 10.6
old 10.4
education 10.4
clinic 10.3
smiling 10.1
covering 10
care 9.9
scientist 9.8
chemistry 9.7
day 9.4
color 8.9
white 8.9
surgery 8.8
uniform 8.7
happiness 8.6
illness 8.6
smile 8.5
adults 8.5
suit 8.4
inside 8.3
indoor 8.2
confident 8.2
consumer goods 8.1
working 7.9
surgeon 7.9
bright 7.9
sitting 7.7
attractive 7.7
exam 7.7
serious 7.6
casual 7.6
research 7.6
biology 7.6
desk 7.6
clothes 7.5
study 7.5
manager 7.4
technology 7.4
church 7.4
black 7.2
religion 7.2
to 7.1

Google
created on 2022-01-09

Black 89.5
Sleeve 86.4
Black-and-white 85.7
Gesture 85.3
Style 84
Hat 79.3
Monochrome photography 75.4
Snapshot 74.3
Formal wear 73.3
Monochrome 72.7
Font 72.6
Art 68.8
Event 68.5
Stock photography 65.4
Fashion design 65.1
Vintage clothing 64.4
Uniform 63.8
Eyewear 63
Photo caption 58.1
Room 58.1

Microsoft
created on 2022-01-09

text 99.1
black and white 91.7
clothing 91.3
person 86.2
man 80
cartoon 61.1

Face analysis

Amazon

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Happy 55.4%
Calm 34%
Surprised 6.8%
Confused 1.7%
Disgusted 1%
Angry 0.7%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Female, 98.7%
Calm 76.8%
Sad 10.3%
Surprised 3.4%
Fear 2.5%
Angry 2.1%
Happy 2.1%
Disgusted 2.1%
Confused 0.7%

AWS Rekognition

Age 23-31
Gender Female, 58.7%
Calm 83.1%
Happy 12.4%
Surprised 2.1%
Fear 1.1%
Confused 0.5%
Disgusted 0.4%
Sad 0.2%
Angry 0.1%

Feature analysis

Amazon

Person 97.1%
Tie 93.7%
Suit 80%

Captions

Microsoft

a group of people looking at a dog 74.9%
a man and a dog looking at the camera 68.1%
a group of people standing next to a dog 68%

Text analysis

Amazon

122
122 61.
61.
12261.
1

Google

122 61. 12 261·
122
61.
12
261·