Human Generated Data

Title

Untitled (boy smoking)
Date

1969
People

Artist: Julius Neeley, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Robert M. Sedgwick II Fund, 2.2002.1423

Human Generated Data

Title

Untitled (boy smoking)

People

Artist: Julius Neeley, American 20th century

Date

1969

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 97.1
Person 97.1
Jacket 96.5
Clothing 96.5
Coat 96.5
Apparel 96.5
Smoke 95.7
Smoking 84.9
Finger 71.9
Car 71.2
Transportation 71.2
Vehicle 71.2
Automobile 71.2
Car 68.1
Overcoat 66.7
Nature 65.4
Man 64.9
Fog 59.6
Portrait 56
Photography 56
Face 56
Photo 56
Pollution 55.9

Imagga
created on 2022-01-22

suit 72.5
businessman 58.4
person 58.3
man 50.5
male 49.9
business 47.5
handsome 44.7
professional 42.9
executive 41
adult 40.9
corporate 38.8
office 37.2
confident 36.5
portrait 34.4
people 33
tie 28.5
garment 28.1
phone 27.7
smile 26.4
success 25
manager 24.3
guy 23.4
attractive 23.1
adolescent 22.3
happy 22
clothing 21.7
looking 21.6
job 21.3
successful 21.1
one 20.9
work 20.5
outdoors 20.2
call 19.6
smiling 19.6
worker 19.4
face 19.2
confidence 19.2
men 18.9
outside 18.9
communication 18.5
juvenile 18.4
modern 18.3
businesspeople 18.1
necktie 18
career 18
mobile 18
casual 17.8
cellphone 17.5
standing 17.4
cell 17.2
expression 17.1
telephone 16.8
building 16.7
formal 16.3
serious 16.2
talking 16.2
lifestyle 15.9
day 14.9
look 14.9
20s 14.7
alone 14.6
businesswoman 14.6
outdoor 14.6
smart 14.2
friendly 13.8
cellular 13.7
thinking 12.4
cheerful 12.2
shirt 12.2
company 12.1
happiness 11.8
employee 11.7
consumer goods 11.6
covering 11.5
bow tie 11.4
sitting 11.2
mature 11.2
entrepreneur 11.1
indoor 11
holding 10.8
conversation 10.7
hand 10.7
urban 10.5
elegant 10.3
performer 10.2
positive 10.2
city 10
scholar 9.8
businessmen 9.8
businessperson 9.8
human 9.8
indoors 9.7
technology 9.7
talk 9.6
communicate 9.6
only 9.6
workplace 9.6
focus 9.3
pretty 9.1
star 8.8
life 8.6
boss 8.6
single 8.2
planner 8.1
determined 7.9
good looking 7.8
intellectual 7.8
model 7.8
actor 7.8
employment 7.8
1 7.7
black 7.6
desk 7.6
fashion 7.6
meeting 7.6
color 7.2
entertainer 7.2

Google
created on 2022-01-22

Eye 93.4
Human 89.2
Flash photography 88.3
Black-and-white 85.9
Style 84
Beard 82.2
Motor vehicle 80.4
Street fashion 79.6
Eyewear 79.3
Happy 77.5
Tints and shades 76.8
Monochrome photography 76.4
Jacket 76.4
Monochrome 76
Travel 74.1
Road 71.5
Vintage clothing 71
White-collar worker 70
Car 69.5
Facial hair 69.2

Microsoft
created on 2022-01-22

person 99.8
outdoor 99.7
text 92.9
jacket 88.3
black and white 86.2
human face 85.3
clothing 85
cellphone 80.8
street 72.7
man 66.1
sky 66
fog 56.2
portrait 55.4
monochrome 54

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Female, 85.6%
Confused 74.6%
Angry 8.1%
Disgusted 7.5%
Sad 5.6%
Fear 1.9%
Calm 1.5%
Surprised 0.5%
Happy 0.2%

Microsoft Cognitive Services

Age 19
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Jacket 96.5%
Car 71.2%

Captions

Microsoft

a person talking on a cell phone 70.5%
a person wearing a suit and tie talking on a cell phone 70.4%
a person is talking on a cell phone 67.8%