Human Generated Data

Title

John Llewellyn Lewis (1880-1969) and Philip Murray (1886-1952)
Date

1952
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.48

Human Generated Data

Title

John Llewellyn Lewis (1880-1969) and Philip Murray (1886-1952)

People

Artist: Unidentified Artist,

Date

1952

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.48

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Apparel 99.7
Clothing 99.7
Human 99.1
Sitting 99.1
Overcoat 98.9
Coat 98.9
Suit 98.9
Person 93.3
Suit 91.5
Person 90.1
Furniture 88.5
Tuxedo 86
Wood 80.7
Chair 75.3
Accessory 69.3
Tie 69.3
Accessories 69.3
Plywood 66.5
Shirt 66.3
Table 64.9
Man 62.7
Photography 62.4
Photo 62.4
Portrait 62
Face 62
Couch 56.4
Room 55.9
Indoors 55.9
Court 55.9

Clarifai
created on 2018-03-23

people 99.9
adult 98.3
sit 98.1
leader 97.7
administration 97.6
two 97.4
man 96.8
chair 96.6
group 95.4
three 95
furniture 94.4
outfit 92.8
dinner jacket 92.6
wear 91.3
group together 91.2
menswear 89.7
seat 89.1
actor 87
room 83.6
musician 82.4

Imagga
created on 2018-03-23

executive 100
businessman 65.4
business 54.8
office 49.1
man 47.8
secretary 45.1
corporate 43.9
male 43.3
meeting 41.5
suit 38.1
businesspeople 37.1
businesswoman 36.4
people 35.8
person 34.4
team 34.1
laptop 33.8
professional 32.5
work 32.2
group 28.3
table 26.9
sitting 25.8
men 25.8
happy 25.7
working 25.7
colleagues 25.3
adult 25
computer 24.9
communication 24.4
manager 24.3
teamwork 24.1
confident 22.8
desk 21.8
businessmen 21.5
handsome 21.4
smiling 19.6
looking 19.2
together 18.4
corporation 18.4
talking 18.1
successful 17.4
worker 17.4
busy 17.4
job 16.8
discussing 16.7
discussion 16.6
workplace 16.2
smile 15.7
conference 15.7
success 15.3
mature 14.9
indoor 14.6
partners 14.6
formal 14.4
modern 14
company 14
speaker 13.8
room 13.8
entrepreneur 13.6
conversation 13.6
career 13.3
portrait 13
partnership 12.5
boss 12.5
tie 12.4
cheerful 12.2
presentation 12.1
coworkers 11.8
businesswomen 11.8
scholar 11.6
jacket 11.6
diversity 11.5
indoors 11.4
couple 11.3
attractive 10.5
employee 10.4
senior 10.3
women 10.3
paper 10.2
happiness 10.2
two 10.2
face 10
seminar 9.9
40s 9.8
articulator 9.7
employment 9.7
partner 9.7
30s 9.6
collar 9.6
staff 9.6
building 9.5
lawyer 9.4
notebook 9.4
coffee 9.3
horizontal 9.2
judge 9.2
20s 9.2
baron 9.2
color 8.9
diverse 8.8
businessperson 8.8
mid adult 8.7
leader 8.7
leadership 8.7
day 8.6
reading 8.6
adults 8.5
casual 8.5
contemporary 8.5
intellectual 8.5
black 8.4
holding 8.3
occupation 8.3
friendly 8.2
lifestyle 8
associates 7.9
25 30 years 7.8
standing 7.8
males 7.8
education 7.8
agreement 7.8
cooperation 7.7
hand 7.6
alone 7.3
communicator 7.3

Google
created on 2018-03-23

suit 95.1
gentleman 86
black and white 85
sitting 80
standing 77.9
furniture 73.3
monochrome photography 69.2
conversation 67.5
formal wear 65.9
communication 63.5
professional 63.2
human behavior 63.1
tuxedo 60.4
table 60
monochrome 54
businessperson 50.3

Microsoft
created on 2018-03-23

person 99.8
sitting 97.8
man 97.5
suit 74.7
older 33.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.7%
Disgusted 1.9%
Sad 20.4%
Confused 63.4%
Angry 5%
Surprised 1.6%
Calm 6.6%
Happy 1.2%

AWS Rekognition

Age 48-68
Gender Male, 99.7%
Confused 6.7%
Disgusted 5.5%
Surprised 3.6%
Sad 6.9%
Angry 4.8%
Happy 54.6%
Calm 17.8%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Suit 98.9%
Person 93.3%
Tie 69.3%