Human Generated Data

Title

Untitled (man standing behind desk with gavel)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15626

Human Generated Data

Title

Untitled (man standing behind desk with gavel)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Human 99.6
Person 99.6
Person 98.9
Person 98.3
Accessories 95.6
Tie 95.6
Accessory 95.6
Furniture 93.3
Crowd 92.4
Apparel 87.5
Coat 87.5
Clothing 87.5
Suit 87.5
Overcoat 87.5
Person 86.4
Food 86.4
Meal 86.4
Table 86.2
Dish 79.8
Suit 76
Sitting 65.7
People 63.6
Glass 59.8
Dining Table 59
Tablecloth 58.6
Speech 58.4
Audience 58.4
Home Decor 58
Press Conference 57.7
Art 56.6
Drawing 56.6

Imagga
created on 2022-03-25

businessman 51.2
office 49.6
man 48.6
business 46.2
male 40.4
meeting 38.6
businesswoman 37.3
businesspeople 35.1
people 34
colleagues 34
adult 33
desk 32.7
person 31.6
corporate 30.1
team 29.6
laptop 27.6
computer 27.4
table 27.1
group 26.6
executive 26.4
professional 24.7
indoors 24.6
work 24.3
men 23.2
working 23
smiling 22.4
happy 21.9
coworkers 21.6
sitting 21.5
manager 20.5
teamwork 20.4
30s 20.2
job 18.6
suit 17.7
associates 17.7
20s 17.4
lifestyle 17.3
casual 16.9
horizontal 16.8
together 16.6
discussion 16.6
indoor 16.4
portrait 16.2
talking 16.2
looking 16
worker 15.9
mature 15.8
discussing 15.7
successful 15.6
confident 15.5
career 15.1
communication 15.1
jacket 14.9
attractive 14.7
40s 14.6
corporation 14.5
mid adult 14.5
handsome 14.3
boardroom 13.8
collaboration 13.8
cooperation 13.5
busy 13.5
company 13
color 12.8
partners 12.6
room 12.2
smile 12.1
success 12.1
home 12
modern 11.9
25 30 years 11.7
conference 11.7
boss 11.5
workplace 11.4
clothing 11.1
camera 11.1
paper 11
employee 10.9
crew 10.8
30 35 years 10.8
businessmen 10.7
face 10.7
adults 10.4
senior 10.3
women 10.3
presentation 10.2
glasses 10.2
explaining 9.8
good mood 9.8
males 9.8
consultant 9.7
notebook 9.7
partnership 9.6
four 9.6
couple 9.6
education 9.5
tie 9.5
happiness 9.4
expression 9.4
cheerful 8.9
cooperating 8.9
appointment 8.8
conversation 8.7
formal 8.6
bright 8.6
planner 8.6
two 8.5
learning 8.5
keyboard 8.4
kin 8.4
classroom 8.4
technology 8.2
necktie 8
coat 7.9
four people 7.9
lab coat 7.9
student 7.7
baron 7.7
elderly 7.7
staff 7.7
finance 7.6
pen 7.5
document 7.5
blond 7.2
speaker 7.1

Google
created on 2022-03-25

Coat 91.8
Table 91.7
Tie 90
Suit 84.7
Black-and-white 83.6
Tableware 80.3
Curtain 80.3
Blazer 76.7
Event 74.4
Monochrome photography 72.6
Monochrome 72.5
White-collar worker 72.2
Formal wear 70.8
History 65
Room 63.4
Stock photography 62.7
Chair 61.9
Management 61.1
Vintage clothing 60.7
Official 60.4

Microsoft
created on 2022-03-25

text 98.2
man 95.5
person 92.8
clothing 92.1
bottle 89.1
human face 79
tableware 70.6
suit 66
posing 63.3
people 56.8
table 55

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 58-66
Gender Male, 100%
Confused 41.9%
Calm 27.7%
Surprised 17.7%
Disgusted 5%
Angry 2.6%
Sad 2%
Happy 1.7%
Fear 1.5%

AWS Rekognition

Age 57-65
Gender Male, 100%
Happy 99.8%
Surprised 0%
Fear 0%
Calm 0%
Confused 0%
Angry 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 57-65
Gender Male, 100%
Calm 55.4%
Confused 20.2%
Sad 10.7%
Disgusted 4.4%
Angry 4.3%
Surprised 1.9%
Happy 1.7%
Fear 1.4%

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 95.6%
Suit 87.5%

Captions

Microsoft

a group of people posing for a photo 96.1%
a group of people sitting at a table posing for a photo 95.5%
a group of people posing for a photo on a table 95.4%