Human Generated Data

Title

Tuesday Night at Nathan's, Oceanside
Date

1978
People

Artist: Peter Schlessinger, American born 1946
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1553

Human Generated Data

Title

Tuesday Night at Nathan's, Oceanside

People

Artist: Peter Schlessinger, American born 1946

Date

1978

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.5
Human 99.5
Person 98.4
Person 98.1
Machine 97
Person 96.3
Motor 91.7
Apparel 91.5
Clothing 91.5
Vehicle 90.3
Motorcycle 90.3
Transportation 90.3
Person 88.8
Person 87.1
Wheel 78.6
Motorcycle 75.7
Coat 66.5
Engine 65.7
Jacket 61.4
Spoke 57.3
Person 45

Imagga
created on 2022-01-09

brass 39
wind instrument 32.4
man 32.2
person 30.5
television camera 28.5
male 26.2
trombone 25.7
equipment 24.4
people 24
television equipment 22.8
musical instrument 21.2
cornet 19.8
bicycle 18.9
adult 18.8
professional 18.6
bike 17.6
electronic equipment 17.1
black 16.8
outdoors 15.8
photographer 15.8
engineer 15.7
repair 15.3
worker 15.1
job 15
work 14.9
camera 14.3
sax 14.1
planner 13.8
occupation 13.7
men 13.7
cycle 13.7
active 12.5
sport 12.4
device 12.1
industry 11.9
happy 11.9
cycling 11.8
portrait 11.6
standing 11.3
helmet 11
lifestyle 10.8
smile 10.7
smiling 10.1
recreation 9.9
mountain 9.8
business 9.7
sexy 9.6
horn 9.6
safety 9.2
outdoor 9.2
profession 8.6
tools 8.5
music 8.5
hot 8.4
service 8.3
fit 8.3
silhouette 8.3
industrial 8.2
cyclist 8
working 7.9
biking 7.9
riding 7.8
outside 7.7
clothing 7.7
electrical 7.7
studio 7.6
hand 7.6
fun 7.5
holding 7.4
style 7.4
transport 7.3
danger 7.3
exercise 7.3
fitness 7.2
home 7.2
summer 7.1

Google
created on 2022-01-09

Clothing 98.7
Tire 94.6
Wheel 93.9
White 92.2
Automotive tire 91.5
Vehicle 91.1
Black 89.7
Motorcycle 89.5
Motor vehicle 88.7
Gesture 85.3
Automotive design 84.5
Black-and-white 84.4
Style 84
Street fashion 82.9
Flash photography 82.2
Happy 79.1
Rim 77.8
T-shirt 77.8
Automotive lighting 76.2
Font 74.8

Microsoft
created on 2022-01-09

text 98.9
person 98.2
clothing 95.5
man 79.1
black and white 77.8
posing 72.1
vehicle 62.8
bicycle 55
land vehicle 50.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 98.8%
Calm 44%
Confused 21.2%
Sad 15.7%
Angry 10.2%
Happy 4.4%
Disgusted 1.8%
Surprised 1.6%
Fear 1.2%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Motorcycle 90.3%
Wheel 78.6%

Captions

Microsoft

a group of people posing for a photo 82.5%
a group of people standing in front of a mirror posing for the camera 62.2%
a group of people posing for the camera 62.1%

Text analysis

Amazon

HIGHW
collis
СПИВИССКИ