Human Generated Data

Title

Untitled (man standing behind desk with gavel)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15626.2

Human Generated Data

Title

Untitled (man standing behind desk with gavel)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 99
Person 99
Person 98.8
Person 98.7
Apparel 96.9
Clothing 96.9
Accessories 94.4
Accessory 94.4
Tie 94.4
Coat 88.7
Crowd 74.4
Lab Coat 74
Person 69.7
Overcoat 69.6
Suit 69.6
Text 60.8
Face 60.4
Portrait 60.4
Photography 60.4
Photo 60.4

Imagga
created on 2022-02-05

lab coat 100
coat 100
garment 48.2
man 46.4
people 35.7
professional 34.8
male 34.8
person 32.1
office 31.5
clothing 30.3
doctor 30.1
medical 29.1
work 27.5
adult 25.9
hospital 24
desk 23.6
men 22.3
businessman 22.1
computer 20.8
clinic 20.5
job 20.3
indoors 20.2
health 19.5
business 19.4
medicine 19.4
worker 19.4
looking 19.2
portrait 18.8
sitting 18
working 17.7
happy 17.5
occupation 17.4
table 17.3
team 17
smiling 16.6
patient 16
senior 15.9
indoor 15.5
room 15
nurse 14.9
student 14.8
care 14.8
laptop 14.6
laboratory 14.5
businesspeople 14.2
teamwork 13.9
glasses 13.9
lab 13.6
colleagues 13.6
casual 13.6
mature 13
color 12.8
home 12.8
handsome 12.5
elderly 12.4
profession 12.4
education 12.1
smile 12.1
group 12.1
face 12.1
corporate 12
scientist 11.8
stethoscope 11.7
serious 11.4
bright 11.4
research 11.4
practitioner 11.4
associates 10.8
assistant 10.7
chemical 10.7
chemistry 10.6
concentration 10.6
busy 10.6
uniform 10.6
meeting 10.4
suit 10.2
businesswoman 10
specialist 9.8
attractive 9.8
science 9.8
to 9.7
technology 9.7
exam 9.6
lifestyle 9.4
two 9.3
horizontal 9.2
treatment 9.2
confident 9.1
old 9.1
human 9
coworkers 8.8
clinical 8.8
together 8.8
scientific 8.7
test 8.7
staff 8.6
biology 8.5
modern 8.4
hand 8.4
inside 8.3
20s 8.2
equipment 8.1
day 7.8
happiness 7.8
businessmen 7.8
examination 7.8
expertise 7.8
1 7.7
30s 7.7
workplace 7.6
illness 7.6
surgeon 7.6
one person 7.5
study 7.5
light 7.4
successful 7.3
cheerful 7.3
success 7.2
women 7.1
case 7.1

Google
created on 2022-02-05

Coat 90.9
Black-and-white 83.1
Suit 79.6
Table 76.7
Art 74
Vintage clothing 73.1
Monochrome photography 72
Curtain 70.5
Monochrome 70.4
Event 70.1
Classic 69.3
Hat 67.7
Formal wear 66.9
Font 65.6
History 64.9
Uniform 64
Room 62.7
Stock photography 62
Sitting 53.4
Retro style 52.7

Microsoft
created on 2022-02-05

text 99.1
clothing 94.1
person 91.9
drawing 89.7
man 85.5
human face 70.9
sketch 68.6
old 57.9
posing 40.2

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 65.4%
Calm 43.4%
Happy 24.9%
Confused 8.6%
Angry 7.1%
Surprised 7.1%
Disgusted 5.1%
Sad 2.1%
Fear 1.6%

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Calm 31.7%
Sad 30.5%
Happy 15.5%
Surprised 9.8%
Angry 4.1%
Disgusted 3.7%
Confused 2.8%
Fear 1.9%

AWS Rekognition

Age 48-56
Gender Male, 99.6%
Happy 54.2%
Calm 35%
Confused 4.9%
Fear 2.6%
Sad 1.4%
Angry 0.7%
Surprised 0.6%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 94.4%
Suit 69.6%

Captions

Microsoft

an old photo of a man 93%
a group of people posing for a photo 86.5%
an old photo of a group of people posing for the camera 86.4%