Human Generated Data

Title

Untitled (photograph of young boy standing next to piano)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3628

Human Generated Data

Title

Untitled (photograph of young boy standing next to piano)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 98.5
Person 98.5
Apparel 91
Clothing 91
Shoe 91
Footwear 91
People 74.4
Sport 63.8
Sports 63.8
Cricket 63.8
Tower 63.4
Clock Tower 63.4
Architecture 63.4
Building 63.4
Photo 62.1
Face 62.1
Photography 62.1
Portrait 62.1
Helmet 56.1
Team Sport 55.5
Softball 55.5
Baseball 55.5
Team 55.5
Athlete 55.5
Ballplayer 55.5

Clarifai
created on 2019-06-01

people 99.8
adult 99.2
one 98.9
wear 98.1
man 96.4
portrait 92.6
woman 90.7
actor 90.3
outfit 89.9
two 86
facial expression 82
sports equipment 81.9
athlete 78.7
administration 78.5
retro 78.2
vehicle 77.3
music 77
group together 76
recreation 73.8
military 72

Imagga
created on 2019-06-01

person 32.3
male 29.1
man 28.9
people 24
adult 22.2
sport 20.8
player 19.8
happy 19.4
action 18.6
exercise 18.2
studio 17.5
teenager 16.4
jump 16.3
weapon 16.2
athlete 15.9
sword 15.3
portrait 14.9
lifestyle 14.5
fitness 14.5
active 14.4
success 13.7
pose 13.6
fashion 13.6
jumping 13.5
stick 13.5
business 13.4
posing 13.3
professional 13
smile 12.8
clothing 12.3
boy 12.3
motion 12
attractive 11.9
happiness 11.8
guy 11.4
handsome 10.7
cool 10.7
businessman 10.6
human 10.5
fun 10.5
body 10.4
style 10.4
club 10.4
healthy 10.1
silhouette 9.9
one 9.7
jeans 9.6
life 9.5
shirt 9.5
ballplayer 9.4
smiling 9.4
dancer 9.4
casual 9.3
teen 9.2
occupation 9.2
leisure 9.1
dance 9
activity 9
worker 8.9
hip hop 8.9
aerobics 8.8
golfer 8.8
dancing 8.7
men 8.6
model 8.6
contestant 8.5
uniform 8.5
outdoor 8.4
joy 8.4
health 8.3
instrument 8.2
equipment 8.2
confident 8.2
game 8
looking 8
astronaut 8
job 8
hair 7.9
standing 7.8
play 7.8
summer 7.7
expression 7.7
fly 7.5
suit 7.4
executive 7.4
student 7.3
black 7.2
work 7.1
sky 7
modern 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

drawing 82.4
black and white 81.5
sketch 77.6
person 70.9
clothing 70.2
footwear 51.5
old 44.4
posing 41.1

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Male, 71.3%
Angry 7.1%
Happy 12.2%
Confused 6.3%
Calm 40.7%
Surprised 14.6%
Sad 8.8%
Disgusted 10.3%

Feature analysis

Amazon

Person 98.5%
Shoe 91%
Clock Tower 63.4%

Captions

Microsoft

a black and white photo of a person 74.2%
a black and white photo of a person 74.1%
a person standing in front of a building 73.2%