Human Generated Data

Title

Untitled (man standing by glass case pointing)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4823

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man standing by glass case pointing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 97.3
Human 97.3
Apparel 96.3
Clothing 96.3
Person 88.6
Bird 83.3
Animal 83.3
Clinic 79.8
Sleeve 76.7
Bird 71.8
Accessories 67.1
Accessory 67.1
Tie 67.1
Coat 66.2
Suit 64
Overcoat 64
Shirt 59.5
Hat 59.1
Finger 57.8

Imagga
created on 2022-01-29

man 50.4
specialist 43
person 41.2
male 39
office 38.2
laptop 37.6
computer 36.2
adult 35.5
people 33.5
businessman 31.8
executive 30.9
senior 30
business 27.9
home 27.1
desk 26.9
sitting 26.6
professional 24
happy 23.8
mature 23.2
looking 23.2
elderly 23
indoors 22
businesspeople 21.8
smiling 21.7
working 21.2
work 21.2
worker 20.5
meeting 19.8
job 19.5
portrait 19.4
patient 18.2
table 17.6
couple 17.4
corporate 17.2
men 17.2
horizontal 16.7
old 16.7
technology 16.3
retirement 16.3
team 16.1
casual 16.1
room 15.8
indoor 15.5
handsome 15.2
face 14.9
manager 14.9
modern 14.7
businesswoman 14.5
glasses 13.9
camera 13.9
lifestyle 13.7
notebook 13.4
nurse 13.2
together 13.1
retired 12.6
one person 12.2
smile 12.1
alone 11.9
clothing 11.8
surgeon 11.7
40s 11.7
colleagues 11.7
1 11.6
medical 11.5
formal 11.5
group 11.3
doctor 11.3
teamwork 11.1
occupation 11
businessperson 10.7
older 10.7
mid adult 10.6
health 10.4
education 10.4
case 10.4
company 10.2
happiness 10.2
inside 10.1
suit 10.1
successful 10.1
color 10
confident 10
hospital 10
cheerful 9.8
corporation 9.6
busy 9.6
using 9.6
husband 9.5
women 9.5
wife 9.5
career 9.5
sick person 9.4
day 9.4
keyboard 9.4
teacher 9.4
bright 9.3
communication 9.2
coat 9.2
aged 9
clinic 8.9
lady 8.9
attire 8.9
gray hair 8.9
coworkers 8.8
discussion 8.8
concentration 8.7
leader 8.7
lab coat 8.6
illness 8.6
tie 8.5
expression 8.5
chair 8.5
student 8.5
iron lung 8.4
house 8.4
holding 8.3
human 8.2
pensioner 8.2
classroom 8.2
gray 8.1
interior 8
medicine 7.9
associates 7.9
appointment 7.8
paper 7.8
60s 7.8
class 7.7
attractive 7.7
leadership 7.7
monitor 7.7
boss 7.7
only 7.6
workplace 7.6
talking 7.6
writing 7.5
document 7.5
care 7.4
book 7.3
secretary 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

person 96.6
man 96.5
text 95.9
black and white 87.6
clothing 82
human face 55
old 54.7
posing 53.5

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 99.1%
Surprised 55.3%
Calm 10.7%
Confused 8.3%
Disgusted 8%
Happy 7.8%
Angry 4.4%
Sad 3.5%
Fear 2%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Sad 92.4%
Angry 2.8%
Calm 1.2%
Fear 1.1%
Disgusted 1%
Happy 0.6%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Male, 58.9%
Calm 78.6%
Sad 13.2%
Confused 3.5%
Happy 2.5%
Angry 0.8%
Disgusted 0.5%
Fear 0.5%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Bird 83.3%
Tie 67.1%
Hat 59.1%

Captions

Microsoft

an old photo of a man 93.1%
old photo of a man 92.3%
a man and woman posing for a photo 70.5%