Human Generated Data

Title

Untitled (one boy pulling another boy on wagon, both smiling)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16376

Human Generated Data

Title

Untitled (one boy pulling another boy on wagon, both smiling)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 99.5
Person 99.5
Person 96
Vehicle 90.4
Transportation 90.4
Buggy 90.1
Grass 89.4
Plant 89.4
Kart 81
Sports 75.6
Skateboard 75.6
Sport 75.6
Clothing 61.2
Apparel 61.2
Field 57.5
People 55.1

Imagga
created on 2022-02-11

lawn mower 88.6
garden tool 70.1
tool 58.9
sport 37.4
man 27.6
outdoors 22.4
male 18.6
people 18.4
outdoor 18.4
sprinkler 17.6
exercise 17.3
leisure 16.6
grass 16.6
active 16.3
summer 16.1
mechanical device 15
golf 14.3
activity 14.3
ball 14.1
adult 13.6
outside 12.8
playing 12.8
fitness 12.7
person 12.5
course 12.4
lifestyle 12.3
action 12.1
men 12
competition 11.9
running 11.5
play 11.2
mechanism 11.1
golfer 10.9
recreation 10.8
park 10.7
rake 10.6
couple 10.5
walking 10.4
club 10.4
sports 10.2
wheeled vehicle 10.1
field 10
vacation 9.8
game 9.8
boy 9.6
athlete 9.5
device 9.2
speed 9.2
sky 8.9
child 8.9
putt 8.9
swing 8.9
women 8.7
tricycle 8.6
player 8.6
senior 8.4
street 8.3
fun 8.2
one 8.2
healthy 8.2
road 8.1
vehicle 7.8
golfing 7.8
old 7.7
health 7.6
pedestrian 7.6
hobby 7.6
relax 7.6
enjoy 7.5
happy 7.5
joy 7.5
training 7.4
dress 7.2

Google
created on 2022-02-11

Wheel 96.6
Tire 95.1
Vehicle 91.9
Window 90.7
Mower 85.7
Motor vehicle 84.2
Grass 79
Lawn mower 77.9
Toddler 77.1
Asphalt 76.3
Water 75.1
Car 73.7
Monochrome 72.9
Edger 70.5
Child 67.8
Flooring 67.3
Automotive wheel system 64.5
Stock photography 64.4
Monochrome photography 63.9
Driveway 61.9

Microsoft
created on 2022-02-11

outdoor 97.1
text 93.9
child 86.4
black and white 81.7
toddler 71.1
person 70
playground 63.7
boy 59.7
house 53.7

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Male, 82.1%
Happy 64.9%
Calm 33.4%
Surprised 1.1%
Sad 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Male, 97.6%
Calm 67.3%
Happy 16.7%
Surprised 11.3%
Sad 1.5%
Disgusted 1.4%
Confused 0.8%
Fear 0.5%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Skateboard 75.6%

Captions

Microsoft

a person standing in front of a building 76.6%
a person riding a motorcycle in front of a building 32.7%
a little boy that is standing in front of a building 31%

Text analysis

Amazon

SUPER
RA SUPER
see
RA

Google

RADiO SUPER
SUPER
RADiO