Human Generated Data

Title

Untitled (Gordon Gahan presenting photograph from National Geographic story to President Richard Nixon)
Date

1972
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.169

Human Generated Data

Title

Untitled (Gordon Gahan presenting photograph from National Geographic story to President Richard Nixon)

People

Artist: Unidentified Artist,

Date

1972

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Accessories 98.5
Tie 98.5
Accessory 98.5
Person 95.7
Human 95.7
Person 95.2
Sitting 85.2
Apparel 84.8
Clothing 84.8
Overcoat 81.7
Coat 81.7
Suit 79.7
Suit 70.9
Furniture 59.5
Table 59.5
Face 59
Plant 58.6
Leisure Activities 56.9
Tuxedo 56.4
Performer 55.2

Clarifai
created on 2019-03-22

people 99.9
two 99.5
adult 99.2
administration 98.4
man 97.5
group 96.7
woman 95.8
leader 94.5
three 94.2
wear 92.5
furniture 91.3
room 86.9
sit 86.7
outfit 85
side view 83.6
one 81.4
chair 79.4
group together 75.2
home 74.9
four 74.3

Imagga
created on 2019-03-22

businessman 67.2
office 57.1
business 56
man 52.5
meeting 50
businesswoman 48.2
suit 47.9
corporate 44.7
executive 44.4
team 43.1
male 41.9
teamwork 41.8
professional 39.4
businesspeople 38
people 34.1
group 33.1
person 32.4
work 32.2
communication 30.3
colleagues 30.2
happy 28.9
laptop 28.3
job 26.6
successful 26.6
confident 26.4
together 26.3
manager 26.1
success 25.8
working 25.7
adult 23.9
table 23.4
partnership 22.1
groom 20.9
entrepreneur 20.8
smiling 20.3
computer 20.1
looking 20
workplace 19.1
talking 19
men 18.9
discussion 18.5
women 18.2
tie 18.1
building 17.9
conference 17.6
attractive 17.5
portrait 17.5
businessmen 16.6
partners 16.5
sitting 16.3
handsome 16.1
worker 16.1
discussing 15.7
smile 15.7
partner 15.5
modern 15.4
career 15.2
desk 15.1
company 14.9
conversation 14.6
secretary 14.5
employee 14.4
two 14.4
coworkers 13.8
diverse 13.7
corporation 13.5
diversity 13.5
boss 13.4
formal 13.4
occupation 12.9
cooperation 12.6
busy 12.6
staff 12.5
lifestyle 11.6
planning 11.6
collar 11.5
happiness 11
speaker 11
interaction 10.8
cheerful 10.6
ethnic 10.5
room 10.4
presentation 10.3
paper 10.2
phone 10.2
indoor 10.1
holding 9.9
explaining 9.9
businesswomen 9.8
workers 9.7
project 9.6
leadership 9.6
talk 9.6
communicate 9.6
reading 9.5
life 9.3
20s 9.2
friendly 9.2
technology 8.9
indoors 8.8
couple 8.7
30s 8.7
confidence 8.6
notebook 8.5
plan 8.5
mobile 8.5
environment 8.2
guy 8.2
articulator 8.2
boardroom 7.9
documents 7.9
standing 7.8
paperwork 7.8
cellphone 7.8
employment 7.7
mid adult 7.7
director 7.7
call 7.7
sales 7.7
expression 7.7
casual 7.6
finance 7.6
horizontal 7.5
contemporary 7.5
showing 7.5
black 7.3
necktie 7.2
pretty 7

Google
created on 2019-03-22

Gentleman 65.1
History 62.6
White-collar worker 61.1
Black-and-white 56.4

Microsoft
created on 2019-03-22

person 99.9
indoor 94.9
black 72.2
black and white 11.2
art 8.1
music 5.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 97.4%
Disgusted 3.7%
Calm 39.1%
Confused 11%
Angry 6.3%
Sad 29.6%
Surprised 3.4%
Happy 6.8%

AWS Rekognition

Age 26-43
Gender Female, 58.7%
Confused 1.8%
Happy 1.8%
Angry 2.8%
Disgusted 0.7%
Calm 13.7%
Sad 78%
Surprised 1.2%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.5%
Person 95.7%
Suit 79.7%

Captions

Microsoft

a black and white photo of a person 83.9%
a man and a woman standing in front of a table 67.6%
a person standing in front of a table 67.5%