Human Generated Data

Title

Untitled (seated man in suit petting dog)

Date

1936

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4762

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (seated man in suit petting dog)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.4
Apparel 99.4
Person 98.6
Human 98.6
Animal 96.3
Dog 96.3
Canine 96.3
Mammal 96.3
Pet 96.3
Furniture 95.2
Chair 95.2
Overcoat 89.3
Coat 89.3
Suit 89.3
Female 84.7
Jar 81.2
Vase 81.2
Plant 81.2
Pottery 81.2
Potted Plant 81.2
Accessories 79.2
Tie 79.2
Accessory 79.2
Face 76.5
Portrait 71.9
Photography 71.9
Photo 71.9
Shirt 66.9
Dress 66.5
Robe 66.2
Fashion 66.2
Woman 64.8
Cat 62.9
Gown 62.8
Doctor 62.4
Flower 61.1
Blossom 61.1
Flower Arrangement 60.8
Bed 59.6
Table 57.7

Imagga
created on 2022-01-29

lab coat 91.8
coat 76.6
man 39.7
person 39.1
male 36.9
garment 36.6
patient 31.7
adult 31.6
people 30.1
clothing 28.8
medical 28.3
doctor 27.3
professional 27.3
work 23.6
hospital 22.7
specialist 21.3
job 21.3
office 20.9
smiling 20.3
computer 19.3
clinic 18.7
businessman 18.6
indoors 18.5
home 18.4
health 18.1
men 18
worker 17.7
business 17.6
happy 17.6
occupation 17.4
medicine 16.7
room 15.4
working 15
senior 15
laboratory 14.5
looking 14.4
portrait 14.2
case 14.2
indoor 12.8
laptop 12.8
women 12.7
lab 12.6
team 12.6
sick person 12.5
desk 12.3
bright 12.2
smile 12.1
mature 12.1
corporate 12
sitting 12
casual 11.9
scientist 11.8
color 11.7
science 11.6
30s 11.6
exam 11.5
uniform 11.4
businesspeople 11.4
education 11.3
modern 11.2
practitioner 11
two 11
20s 11
40s 10.7
care 10.7
chemistry 10.6
serious 10.5
illness 10.5
couple 10.5
kitchen 10.4
teacher 10.4
lifestyle 10.1
student 10.1
businesswoman 10
nurse 10
face 10
interior 9.7
together 9.6
angle 9.6
research 9.5
adults 9.5
day 9.4
focus 9.3
treatment 9.2
attractive 9.1
technology 8.9
group 8.9
to 8.9
examination 8.8
colleagues 8.8
standing 8.7
table 8.7
profession 8.6
talking 8.6
clothes 8.4
study 8.4
manager 8.4
teamwork 8.4
associates 7.9
examining 7.9
brunette 7.8
diagnosis 7.8
25 30 years 7.8
businessmen 7.8
busy 7.7
test 7.7
biology 7.6
meeting 7.5
horizontal 7.5
inside 7.4
cheerful 7.3
alone 7.3
stethoscope 7.1
happiness 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 98.8
black and white 79.4

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Happy 85%
Calm 6.2%
Surprised 3%
Confused 2.5%
Sad 1.2%
Angry 0.9%
Disgusted 0.7%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Dog 96.3%
Tie 79.2%

Captions

Microsoft

a man standing next to a cat 79.9%
a man with a cat in front of a mirror posing for the camera 71.6%
a man with a cat in front of a mirror 71.5%

Text analysis

Amazon

33
-
EE

Google

C
C