Human Generated Data

Title

Untitled (children on firetruck)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16654

Human Generated Data

Title

Untitled (children on firetruck)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-18

Human 99.7
Person 99.7
Person 99.6
Person 99.1
Person 98.8
Wheel 96.4
Machine 96.4
Person 96.2
Person 96.2
Person 95.9
Person 92.9
Person 92.8
Transportation 88.5
Vehicle 88.5
Clothing 88.1
Apparel 88.1
Person 83.7
Car 71.8
Automobile 71.8
Person 71.5
Person 66.1
Person 65.2
Truck 64.9
Bumper 63.6
Female 60
Fire Truck 59.2
Shorts 56.5
Art 56.3
Person 49.1
Person 41.8

Imagga
created on 2022-02-18

truck 62.3
fire engine 54.5
motor vehicle 34
vehicle 27.9
transportation 21.5
old 19.5
transport 19.2
container 19.1
road 19
ashcan 18.7
machine 18.5
car 17.7
wheeled vehicle 15.1
bin 14.9
industrial 14.5
automobile 13.4
street 12.9
industry 12.8
auto 12.4
building 12.2
washer 11.9
wheel 11.3
snow 11.2
work 11.1
white goods 10.8
vintage 10.7
box 10.6
engine 10.6
travel 10.6
tree 10
dirty 9.9
machinery 9.7
outdoors 9.7
antique 9.6
move 9.6
people 9.5
drive 9.5
architecture 9.4
winter 9.4
male 9.3
city 9.1
landscape 8.9
rural 8.8
urban 8.7
man 8.7
home appliance 8.7
heavy 8.6
black 8.4
outdoor 8.4
danger 8.2
tractor 8
yellow 7.9
business 7.9
day 7.8
driving 7.7
appliance 7.7
construction 7.7
person 7.7
decoration 7.7
sky 7.6
dirt 7.6
equipment 7.4
safety 7.4
holiday 7.2
tire 7.1

Google
created on 2022-02-18

Wheel 96.2
Car 95.1
Vehicle 93.9
Motor vehicle 92.1
Tire 87.5
Fender 79.6
Plant 77.6
Classic 76.9
Vintage clothing 75.6
Classic car 75.1
Automotive tire 74.3
Automotive exterior 73
Art 70.2
Antique car 67.5
Family car 67
Automotive wheel system 66.9
Tree 66.9
Automotive design 66.5
Headlamp 64
Monochrome 62.8

Microsoft
created on 2022-02-18

vehicle 97.1
land vehicle 96.7
text 94.4
wheel 90.7
outdoor 85.4
white 73.1
car 65.6
person 65.5
tire 52.1

Face analysis

Amazon

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Sad 99.1%
Calm 0.3%
Confused 0.2%
Happy 0.1%
Fear 0.1%
Angry 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 16-24
Gender Female, 91.3%
Sad 62.1%
Calm 30%
Happy 2.5%
Disgusted 1.7%
Angry 1.2%
Confused 1%
Fear 0.9%
Surprised 0.6%

AWS Rekognition

Age 26-36
Gender Female, 51.6%
Calm 65.7%
Sad 31.6%
Confused 0.9%
Disgusted 0.5%
Surprised 0.4%
Angry 0.4%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Female, 52.5%
Calm 99.4%
Confused 0.3%
Sad 0.2%
Happy 0.1%
Fear 0%
Surprised 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 23-33
Gender Male, 53.1%
Calm 59.3%
Confused 18.9%
Sad 11.2%
Happy 4.5%
Surprised 2.1%
Angry 1.9%
Disgusted 1.7%
Fear 0.4%

AWS Rekognition

Age 19-27
Gender Female, 58.3%
Calm 99.1%
Happy 0.5%
Sad 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 18-24
Gender Male, 99.7%
Calm 78.2%
Happy 16.1%
Surprised 1.5%
Disgusted 1.3%
Sad 1.1%
Angry 1.1%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Male, 51.9%
Disgusted 81.2%
Calm 10.8%
Confused 3.7%
Sad 2.5%
Angry 0.7%
Happy 0.4%
Surprised 0.4%
Fear 0.4%

Feature analysis

Amazon

Person 99.7%
Wheel 96.4%
Truck 64.9%

Captions

Microsoft

a group of people riding on the back of a truck 57%
an old photo of a truck 56.9%
a group of people in a vehicle 56.8%

Text analysis

Amazon

FIRE
FIRE DE
DE
WAYZ
6
NO 6
NO
MACO
017

Google

WAY N 6 FIRE DE
6
WAY
N
FIRE
DE