Human Generated Data

Title

Untitled (doctors in room with x-rays)
Date

1954
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8868
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (doctors in room with x-rays)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.1
Human 99.1
Person 99
Person 98.3
Clothing 95.4
Apparel 95.4
Person 95
Coat 81.5
Tie 75.7
Accessories 75.7
Accessory 75.7
Sleeve 66.4
Person 65.2
Poster 59.6
Advertisement 59.6
Overcoat 59
Leisure Activities 58.8
People 58.7
Clinic 56.3

Imagga
created on 2022-01-15

man 47
male 44.7
businessman 41.5
person 37.8
people 35.1
business 34.6
office 34.6
executive 28.1
adult 26.8
professional 26.3
desk 24.7
meeting 24.5
group 22.6
corporate 21.5
happy 21.3
job 21.2
working 21.2
laptop 21.2
businesspeople 20.9
men 20.6
team 20.6
room 20
businesswoman 20
indoors 19.3
computer 19.3
sitting 18.9
work 18.8
senior 18.7
portrait 18.1
newspaper 18
colleagues 17.5
manager 16.8
planner 16.7
smiling 16.6
mature 15.8
classroom 15.8
table 15.7
face 15.6
suit 15.6
indoor 15.5
worker 15.4
horizontal 15.1
teamwork 14.8
patient 14.2
product 13.4
handsome 13.4
talking 13.3
coworkers 12.8
casual 12.7
together 12.3
education 12.1
smile 12.1
success 12.1
looking 12
40s 11.7
color 11.7
discussion 11.7
cheerful 11.4
couple 11.3
camera 11.1
20s 11
communication 10.9
creation 10.7
businessmen 10.7
retired 10.7
mid adult 10.6
home 10.4
necktie 10.3
doctor 10.3
lifestyle 10.1
occupation 10.1
successful 10.1
old 9.8
medical 9.7
30s 9.6
four 9.6
happiness 9.4
inside 9.2
bow tie 9.1
ruler 9.1
aged 9
associates 8.9
discussing 8.8
conference 8.8
clinic 8.8
corporation 8.7
busy 8.7
retirement 8.6
workplace 8.6
career 8.5
finance 8.4
teacher 8.4
health 8.3
student 8.3
confident 8.2
employee 8.2
document 8.1
women 7.9
explaining 7.9
day 7.8
good mood 7.8
black 7.8
modern 7.7
elderly 7.7
illness 7.6
jacket 7.6
two 7.6
tie 7.6
females 7.6
glasses 7.4
baron 7.4
to 7.1
paper 7.1

Google
created on 2022-01-15

Outerwear 95.3
Shirt 94.2
Coat 92.7
Smile 88
Black-and-white 84.6
Style 83.9
Suit 78
Eyewear 75.6
Hat 75.5
Monochrome photography 74.9
Monochrome 74.8
Snapshot 74.3
Event 72.5
Font 70.8
White-collar worker 70.4
Sitting 68.6
Tie 68.2
Room 66.9
Picture frame 65.7
Stock photography 64.1

Microsoft
created on 2022-01-15

text 99.7
person 97.9
clothing 97.6
man 94.4
smile 83.7
posing 82.2
human face 68.2
computer 63.8

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 55.1%
Happy 38.6%
Surprised 4%
Sad 0.7%
Angry 0.6%
Disgusted 0.4%
Confused 0.3%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 93.2%
Calm 74.1%
Surprised 15.7%
Happy 3.9%
Fear 1.8%
Disgusted 1.3%
Sad 1.3%
Confused 1.2%
Angry 0.7%

AWS Rekognition

Age 40-48
Gender Male, 100%
Happy 98.6%
Surprised 0.8%
Calm 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 49-57
Gender Male, 99.7%
Surprised 47.3%
Calm 25.2%
Happy 24.7%
Angry 0.9%
Sad 0.5%
Confused 0.5%
Fear 0.5%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 75.7%

Captions

Microsoft

a group of people posing for a photo 96.8%
a group of people posing for the camera 96.7%
a group of people posing for a picture 96.6%

Text analysis

Amazon

IN
WHITE
DROEGE
COAT
CROP
ON
KOFF
39914.
CROP KOFF DR DROEGE IN WHITE COAT ON RT
DOCTORS.
39914. DOCTORS. IFUSED
RT
IFUSED
Vanderbill
DR
University
adidas
are
Sanderbic

Google

39914. DOCTORS. AF USED
39914.
DOCTORS.
AF
USED