Human Generated Data

Title

Untitled (boy in cowboy outfit at amusement park)

Date

1947

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14986

Human Generated Data

Title

Untitled (boy in cowboy outfit at amusement park)

People

Artist: Jack Gould, American

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 97.2
Human 97.2
Person 96.9
Person 96.7
Person 95.5
Person 93.9
Person 91.1
Apparel 90
Clothing 90
Face 87.2
Person 83.2
Meal 78.5
Food 78.5
People 72.9
Female 70.8
Kid 70.6
Child 70.6
Furniture 70.4
Chair 66.9
Girl 63.7
Text 63.6
Person 63.4
Photography 63.3
Photo 63.3
Person 61.4
Indoors 61
Person 60.9
Room 56.4
Play 55.8
Advertisement 55.6

Imagga
created on 2022-03-05

newspaper 34.8
product 26.2
creation 20.3
man 18.1
people 17.3
male 15
sculpture 13.6
office 11.8
old 11.8
person 11.8
vintage 11.6
business 11.5
art 11.1
world 11
room 11
house 10.9
black 10.8
history 10.7
salon 10.6
building 10.6
adult 10.5
statue 10.5
window 9.7
architecture 9.5
happy 9.4
portrait 9.1
hair 8.7
marble 8.7
child 8.7
lifestyle 8.7
ancient 8.6
men 8.6
face 8.5
monument 8.4
historic 8.2
human 8.2
computer 8
memorial 8
looking 8
home 8
working 8
balcony 7.7
head 7.6
joy 7.5
outdoors 7.5
famous 7.4
jacket 7.4
back 7.3
alone 7.3
body 7.2
smile 7.1
love 7.1
happiness 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

window 90.9
person 86.8
text 85.6
drawing 84.4
black and white 80
clothing 79.4
sketch 75
human face 74.9
statue 67.7
gallery 51.8
old 50.9

Face analysis

Amazon

AWS Rekognition

Age 11-19
Gender Female, 98%
Calm 76.5%
Confused 11.2%
Happy 5%
Sad 2.3%
Surprised 1.8%
Angry 1.5%
Fear 0.8%
Disgusted 0.8%

AWS Rekognition

Age 40-48
Gender Male, 94.8%
Surprised 53.5%
Happy 39%
Disgusted 1.9%
Confused 1.5%
Fear 1.5%
Sad 1.3%
Calm 0.8%
Angry 0.5%

AWS Rekognition

Age 19-27
Gender Male, 98.2%
Sad 58.3%
Happy 15.4%
Calm 9%
Disgusted 7.8%
Angry 2.9%
Confused 2.9%
Surprised 2.1%
Fear 1.5%

AWS Rekognition

Age 30-40
Gender Male, 83.2%
Calm 59%
Happy 19.6%
Fear 9.2%
Sad 4.4%
Disgusted 3%
Angry 2.4%
Surprised 1.6%
Confused 0.8%

AWS Rekognition

Age 18-24
Gender Female, 60.2%
Calm 31.8%
Happy 30.3%
Fear 18%
Sad 7.1%
Disgusted 6.2%
Angry 2.7%
Surprised 2.5%
Confused 1.4%

AWS Rekognition

Age 22-30
Gender Male, 93.1%
Calm 44.9%
Confused 21.7%
Sad 14%
Happy 13.8%
Angry 2.9%
Surprised 1.5%
Disgusted 1.1%
Fear 0.2%

AWS Rekognition

Age 34-42
Gender Female, 90.3%
Disgusted 50.5%
Happy 42.3%
Confused 1.7%
Calm 1.4%
Sad 1.3%
Surprised 1.2%
Angry 1%
Fear 0.6%

AWS Rekognition

Age 23-33
Gender Male, 98.5%
Calm 38.7%
Sad 16.6%
Disgusted 12.9%
Happy 11.8%
Angry 5.5%
Fear 5.4%
Confused 5.2%
Surprised 4%

AWS Rekognition

Age 10-18
Gender Male, 99.1%
Calm 95.2%
Sad 1.9%
Angry 1.4%
Confused 0.7%
Happy 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

Feature analysis

Amazon

Person 97.2%

Captions

Microsoft

a group of people in an old photo of a girl 60.1%
a group of people standing next to a window 60%
a group of people standing in front of a window 59.9%