Human Generated Data

Title

Untitled (man in cowboy hat seated on fence on ranch)
Date

1970s
People

Artist: Ken Whitmire Associates, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1356

Human Generated Data

Title

Untitled (man in cowboy hat seated on fence on ranch)

People

Artist: Ken Whitmire Associates, American

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 100
Apparel 100
Person 98.7
Human 98.7
Footwear 94.3
Hat 91.2
Boot 79
Wood 67.4
Shoe 64.1
Sun Hat 61.2

Imagga
created on 2022-01-22

person 45.8
man 38.3
builder 36.2
farmer 33.7
male 33.3
work 25.4
people 24.5
adult 23.4
carpenter 20.9
sitting 20.6
business 20
worker 19.7
job 18.6
outdoors 17.9
working 17.7
portrait 17.5
lifestyle 17.3
men 17.2
building 16
senior 15.9
smiling 15.2
happy 15
businessman 15
professional 14.7
outside 14.5
looking 14.4
construction 13.7
home 13.6
casual 13.6
handsome 13.4
occupation 12.8
smile 12.8
scholar 12.7
happiness 12.5
laptop 11.8
serious 11.4
couple 11.3
site 11.3
computer 11.2
attractive 11.2
intellectual 11.1
old 11.1
industry 11.1
successful 11
suit 11
brick 10.8
engineer 10.7
cheerful 10.6
office 10.4
guy 10.3
house 10
holding 9.9
hand 9.9
hat 9.7
wooden 9.7
success 9.7
standing 9.6
corporate 9.4
outdoor 9.2
confident 9.1
human 9
group 8.9
table 8.7
day 8.6
desk 8.5
relaxed 8.4
mature 8.4
wood 8.3
park 8.2
technology 8.2
student 8.1
hair 7.9
education 7.8
architect 7.7
elderly 7.7
reading 7.6
enjoying 7.6
one person 7.5
leisure 7.5
shirt 7.5
manager 7.4
relaxing 7.3
businesswoman 7.3
romance 7.1
wall 7.1
face 7.1
love 7.1
interior 7.1
summer 7.1
paper 7.1
indoors 7
modern 7

Google
created on 2022-01-22

Clothing 98.7
Hat 90.5
Dress shirt 90.3
Sleeve 87.2
Flash photography 87.1
Wood 86.6
Happy 84.3
Collar 84
Eyewear 82.7
Street fashion 81.4
Landscape 76.8
People in nature 71.1
Fence 70.3
Sitting 70
Denim 69.7
Formal wear 69.4
Sun hat 67.7
Vintage clothing 67.2
Soil 66.3
Travel 64.8

Microsoft
created on 2022-01-22

fence 100
outdoor 99.7
clothing 98.8
person 97.2
man 81.3
hat 76
fashion accessory 73.3
wooden 63
human face 61.8
railing 31.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 99.8%
Confused 0.1%
Angry 0%
Sad 0%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Hat 91.2%

Captions

Microsoft

a man sitting on top of a wooden fence 85.8%
a man sitting on a bench next to a fence 74.9%
a man sitting on a bench 74.8%