Human Generated Data

Title

Untitled (Ron Erhardt, North Dakota State University football coach)
Date

1966-72
People

Artist: Gordon W. Gahan, American 1945 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.87

Human Generated Data

Title

Untitled (Ron Erhardt, North Dakota State University football coach)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1966-72

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Human 98.3
Person 98.3
Apparel 98.2
Overcoat 98.2
Suit 98.2
Clothing 98.2
Coat 98.2
Person 97.9
Accessory 90.2
Tie 90.2
Accessories 90.2
Trophy 85.9
Tie 66.9
Crowd 62.7
Text 58.7

Clarifai
created on 2019-03-22

people 99.9
administration 99.4
two 99.4
group 98.2
adult 97.7
leader 97.5
man 97.2
three 97.1
four 89.4
one 88.6
chair 87.9
five 86.5
wear 86.5
group together 85.6
several 83.6
portrait 83
home 81.8
scientist 78.5
outfit 77.1
war 76.8

Imagga
created on 2019-03-22

businessman 62.7
office 59.5
man 55.1
business 50.4
male 46.8
laptop 44.4
computer 40.1
person 37.4
executive 35.4
people 35.2
meeting 33.9
sitting 33.5
desk 33.2
work 33
businesswoman 32.7
corporate 31.8
working 30.9
team 30.5
professional 29.2
table 28.7
adult 28.7
suit 28.5
happy 27.6
businesspeople 27.5
manager 27
smiling 26.1
group 25
looking 24
handsome 23.2
men 22.3
job 22.1
communication 21
teamwork 20.4
successful 20.1
colleagues 19.4
entrepreneur 18.8
confident 18.2
portrait 18.1
talking 18.1
technology 17.8
success 16.9
indoors 16.7
discussion 16.6
engineer 16.4
worker 16
notebook 16
senior 15
face 14.9
together 14.9
discussing 14.7
indoor 14.6
partners 14.6
conversation 14.6
home 14.4
scholar 13.5
boss 13.4
formal 13.4
serious 13.4
workplace 13.3
tie 13.3
career 13.3
generator 13.1
glasses 13
smile 12.8
conference 12.7
consultant 12.7
corporation 12.5
busy 12.5
company 12.1
businessmen 11.7
jacket 11.7
lifestyle 11.6
keyboard 11.3
mature 11.2
room 11.1
women 11.1
coworkers 10.8
director 10.8
intellectual 10.8
30s 10.6
cheerful 10.6
one 10.5
education 10.4
contemporary 10.3
expression 10.2
paper 10.2
casual 10.2
two 10.2
finance 10.1
inside 10.1
horizontal 10.1
black 9.6
talk 9.6
pen 9.4
happiness 9.4
coffee 9.3
camera 9.2
occupation 9.2
modern 9.1
attractive 9.1
couple 8.7
partner 8.7
mid adult 8.7
partnership 8.6
student 8.6
elderly 8.6
thinking 8.5
sit 8.5
showing 8.4
shirt 8.4
presentation 8.4
house 8.4
20s 8.2
teacher 8
wind instrument 7.9
associates 7.9
employment 7.7
1 7.7
planning 7.7
using 7.7
reading 7.6
learning 7.5
book 7.4
planner 7.3
life 7.2
lawyer 7

Google
created on 2019-03-22

Photograph 95.7
Snapshot 82
Gentleman 81.9
Art 62.5
Vintage clothing 53.5
Illustration 50.4

Microsoft
created on 2019-03-22

person 99.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 97.5%
Happy 34.9%
Surprised 8.7%
Calm 9%
Angry 15.8%
Confused 5.9%
Sad 18.6%
Disgusted 7%

AWS Rekognition

Age 45-66
Gender Male, 98.6%
Sad 6.1%
Confused 12.2%
Calm 38.5%
Disgusted 14.4%
Happy 7.1%
Surprised 12.5%
Angry 9.2%

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Suit 98.2%
Tie 90.2%

Captions

Microsoft

a man wearing a suit and tie 97.3%
a man in a suit and tie 97.2%
a man in a suit standing in front of a window 96.1%