Human Generated Data

Title

Hank, 76, and Samm, 67, North Little Rock, AR
Date

2015
People

Artist: Jess T. Dugan, American born 1986
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Lisa Rich, 2019.191
Copyright

© Jess T. Dugan

Human Generated Data

Title

Hank, 76, and Samm, 67, North Little Rock, AR

People

Artist: Jess T. Dugan, American born 1986

Date

2015

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Clothing 99.4
Apparel 99.4
Person 99.2
Human 99.2
Person 98.5
Hat 94.6
Wood 80.8
Pants 75.9
Cap 72.4
Military 72
Officer 67.1
Military Uniform 67.1
Baseball Cap 67.1
Police 59.2
Sitting 57.7
Tree 57.6
Plant 57.6
Hat 57
Finger 56.9
Crowd 56.4
Head 56.3

Clarifai
created on 2021-04-03

portrait 97.1
competition 96.5
race 96.4
family 95.8
child 95.6
championship 95.3
man 94.3
people 94.1
fun 91.9
boy 90.9
wear 87.7
race (competition) 87.1
woman 86.5
recreation 86.4
leisure 86.2
enjoyment 85.5
baseball 84.5
girl 83.6
safety 82.9
football 82.7

Imagga
created on 2021-04-03

man 51.7
male 45.7
sport 41.3
people 31.8
uniform 30.4
person 28.7
helmet 28.5
occupation 26.6
hat 26.4
adult 24.6
job 23
worker 21.4
happy 21.3
outdoors 20.3
safety 20.2
smiling 19.5
men 18.9
portrait 18.8
professional 18.6
active 17.2
work 16.5
spectator 15.9
equipment 14.9
mature 14.9
clothing 14.9
guy 14.5
collar 14.4
black 13.8
construction 13.7
foreman 13.2
outdoor 13
smile 12.8
player 12.6
activity 12.5
military uniform 12.4
fun 12
industry 11.9
one 11.9
middle aged 11.7
team 11.6
summer 11.6
vehicle 11.3
couple 11.3
boy 11.3
travel 11.3
trainer 11.2
industrial 10.9
working 10.6
looking 10.4
day 10.2
engineer 10.2
lifestyle 10.1
athlete 10
leisure 10
backpack 9.8
contractor 9.7
businessman 9.7
adventure 9.5
outside 9.4
friends 9.4
senior 9.4
business 9.1
cheerful 8.9
sheriff 8.9
group 8.9
officer 8.9
police 8.8
driver 8.7
badge 8.7
standing 8.7
hiking 8.7
profession 8.6
youth 8.5
manager 8.4
car 8.3
20s 8.2
protection 8.2
recreation 8.1
handsome 8
building 7.9
enforcement 7.9
hardhat 7.8
ballplayer 7.8
law 7.8
builder 7.7
elderly 7.7
two 7.6
teamwork 7.4
park 7.4
service 7.4
glasses 7.4
street 7.4
baseball 7.3
road 7.2
women 7.1
grass 7.1

Google
created on 2021-04-03

Plant 91.5
Gesture 85.3
Cap 79.2
Recreation 74.4
Military person 73.2
Baseball cap 72.5
Event 72.4
Competition event 71.5
Hat 67.3
Uniform 65.8
Team 65.3
Official 65.3
Grass 64.8
Military officer 63.9
Racing 62.7
Logo 61.5
Law enforcement 59.9
Public event 57.7
Security 57.3
Military uniform 56.9

Microsoft
created on 2021-04-03

person 99.9
outdoor 99.8
clothing 96
hat 92.8
fashion accessory 92.1
human face 91.2
smile 73.6
man 61.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Male, 79.2%
Calm 99.5%
Angry 0.2%
Happy 0.1%
Sad 0.1%
Fear 0%
Confused 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 52-70
Gender Female, 98.4%
Calm 99%
Sad 0.5%
Happy 0.2%
Angry 0.2%
Disgusted 0%
Fear 0%
Confused 0%
Surprised 0%

Microsoft Cognitive Services

Age 63
Gender Female

Microsoft Cognitive Services

Age 60
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Hat 94.6%

Captions

Microsoft

a group of people sitting around a baseball field 52%
a group of people in uniform 51.9%
a group of men sitting around a baseball field 48.9%

Text analysis

Amazon

ARMY
9
U.S.A
ST
ARMY U.S.AR
8
U.S.AR
A
US. ARN
ARMY 'ON:
'ON:
Ish

Google

VETERAN
RM
DISA VETERAN ON RM U.S.AR AHK! HK! ARMY ST ARMY S U.S. A U.S, ARM
ARMY
S
U.S,
ARM
DISA
ST
A
AHK!
HK!
ON
U.S.AR
U.S.