Human Generated Data

Title

Untitled (man with trophy standing next to old car)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16063

Human Generated Data

Title

Untitled (man with trophy standing next to old car)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Human 99.1
Person 99.1
Clothing 96.7
Apparel 96.7
Hat 81.4
Overcoat 75
Coat 75
Spoke 69.4
Machine 69.4
Vehicle 66.2
Transportation 66.2
Sleeve 64.2
Suit 64
Tire 63.3
Alloy Wheel 57.6
Wheel 57.6
Face 56.9
Door 55.1

Imagga
created on 2022-03-25

person 28
man 24.2
people 22.3
adult 18.8
male 18.5
percussion instrument 17.2
smile 17.1
steel drum 16.3
musical instrument 16.2
happy 15.7
seller 15.1
one 14.2
chair 13.9
car 13.7
sitting 13.7
lifestyle 13.7
happiness 12.5
work 12.4
smiling 12.3
portrait 12.3
business 11.5
wheelchair 11
outdoors 10.4
worker 10.3
street 10.1
old 9.7
home 9.6
seat 9.5
drive 9.5
senior 9.4
joy 9.2
employee 9.1
fashion 9
waiter 9
vehicle 9
building 8.8
working 8.8
looking 8.8
outside 8.6
casual 8.5
hat 8.4
attractive 8.4
clothing 8.3
city 8.3
leisure 8.3
holding 8.2
cheerful 8.1
lady 8.1
kitchen 8
computer 8
indoors 7.9
child 7.9
men 7.7
pretty 7.7
industry 7.7
room 7.7
elderly 7.7
hand 7.6
wheel 7.5
office 7.5
clothes 7.5
fun 7.5
care 7.4
dining-room attendant 7.2
black 7.2
transportation 7.2
hospital 7.2
little 7.1

Google
created on 2022-03-25

Vehicle 93.2
Hood 90.6
Hat 90.1
Car 87.1
Motor vehicle 86.8
Automotive tire 85.8
Wheel 84.6
Automotive lighting 83.9
Sun hat 82.4
Fender 80.8
Classic 76.4
Automotive exterior 72.6
Vintage clothing 72.4
Automotive design 71.6
Automotive wheel system 70
Monochrome 67.9
Classic car 67.7
Monochrome photography 66.7
Antique car 66.6
Kit car 66.2

Microsoft
created on 2022-03-25

person 96.6
black and white 93.3
text 91.3
outdoor 90.6
window 89.4
clothing 84
man 69.2
vehicle 68.4
land vehicle 65.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 59-69
Gender Male, 100%
Calm 96.8%
Confused 1.1%
Happy 1%
Sad 0.5%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 81.4%

Captions

Microsoft

a man and a woman standing in front of a window 84.8%
a person standing in front of a window 84.7%
a man and a woman standing next to a window 84.5%

Text analysis

Amazon

4
C

Google

MODS
MODS