Human Generated Data

Title

Parade Boston St. (group photo)

Date

before 1920

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the Massachusetts Bay Transportation Authority, Boston Transit Collection, 5.2002.590

Human Generated Data

Title

Parade Boston St. (group photo)

People

Artist: Unidentified Artist,

Date

before 1920

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the Massachusetts Bay Transportation Authority, Boston Transit Collection, 5.2002.590

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Human 96.6
Grass 94.4
Plant 94.4
People 94
Bird 92.4
Animal 92.4
Person 91.2
Person 89.7
Clothing 87.7
Apparel 87.7
Person 87.2
Bird 83.2
Person 82.8
Building 80.9
Housing 80.9
Person 77.8
Nature 76.8
Outdoors 76.8
Yard 76.8
Tree 76.6
Couch 73.7
Furniture 73.7
Bird 72.9
Person 72
Person 71.6
Face 70.8
Person 67.7
Coat 67.4
Suit 67.4
Overcoat 67.4
Bird 67.3
Kid 66.8
Child 66.8
Shorts 66.5
Person 65.1
Person 63.3
Female 62.2
Crowd 61.7
Photography 60
Photo 60
Villa 59.3
House 59.3
Dress 58.5
Family 58.2
Chair 57.8
Bird 57
Room 56.5
Indoors 56.5
Person 47.9

Imagga
created on 2022-06-04

old 20.2
structure 18.4
fountain 16.6
vintage 15.7
decoration 15
grunge 14.5
architecture 14.2
travel 14.1
building 13.2
stone 12.8
art 11.9
history 11.6
black 10.8
vacation 10.6
antique 10.4
retro 9.8
texture 9.7
people 9.5
culture 9.4
dark 9.2
outdoor 9.2
sculpture 9.1
attractive 9.1
aged 9
summer 9
ranch 8.7
rock 8.7
water 8.7
ancient 8.6
historical 8.5
gravestone 8.5
design 8.4
graffito 8.4
tourism 8.2
park 8.2
dress 8.1
man 8.1
snow 7.9
grass 7.9
artistic 7.8
portrait 7.8
house 7.6
memorial 7.6
kin 7.5
traditional 7.5
brown 7.4
sand 7.3
landmark 7.2
textured 7

Google
created on 2022-06-04

Microsoft
created on 2022-06-04

grass 99.9
outdoor 89.1
text 79.1
house 78.9
black and white 69.5
child 59.4
person 58.6
old 54.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 16-22
Gender Female, 86.5%
Happy 48.6%
Calm 36.8%
Surprised 8.6%
Fear 6.6%
Confused 3.6%
Sad 2.9%
Disgusted 1.6%
Angry 1.5%

AWS Rekognition

Age 11-19
Gender Male, 59.6%
Calm 78.3%
Fear 13.1%
Surprised 6.5%
Happy 2.9%
Sad 2.6%
Angry 1.9%
Disgusted 0.9%
Confused 0.9%

AWS Rekognition

Age 25-35
Gender Female, 52.8%
Calm 24.1%
Fear 21.6%
Angry 21%
Disgusted 12%
Happy 10.4%
Surprised 8.5%
Sad 3.4%
Confused 3.3%

AWS Rekognition

Age 18-26
Gender Female, 92.3%
Calm 85.2%
Disgusted 11.8%
Surprised 6.7%
Fear 6%
Sad 2.2%
Happy 0.8%
Confused 0.5%
Angry 0.2%

AWS Rekognition

Age 18-26
Gender Male, 76.7%
Calm 32.2%
Happy 23.5%
Confused 21.9%
Surprised 10.7%
Fear 7.7%
Sad 4.6%
Disgusted 3.8%
Angry 2%

AWS Rekognition

Age 13-21
Gender Male, 59.3%
Calm 61.9%
Sad 26.6%
Surprised 9.1%
Fear 8.3%
Disgusted 3.3%
Happy 1.6%
Angry 1.6%
Confused 1.6%

AWS Rekognition

Age 18-24
Gender Female, 81.2%
Calm 52.7%
Fear 48.2%
Surprised 7%
Sad 2.7%
Confused 1.5%
Disgusted 1.1%
Happy 1%
Angry 0.5%

AWS Rekognition

Age 25-35
Gender Male, 98.6%
Calm 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 1.5%
Confused 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 13-21
Gender Male, 91.6%
Happy 43.4%
Fear 19.7%
Surprised 11.3%
Disgusted 8.3%
Calm 7.8%
Angry 5.6%
Sad 3.5%
Confused 3.4%

AWS Rekognition

Age 20-28
Gender Male, 67.2%
Calm 92.3%
Surprised 9.9%
Fear 6%
Sad 2.2%
Confused 0.5%
Disgusted 0.4%
Happy 0.3%
Angry 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.1%
Calm 71.1%
Surprised 9.5%
Happy 9.5%
Fear 6.5%
Sad 4%
Confused 3%
Angry 2.8%
Disgusted 2.3%

AWS Rekognition

Age 16-22
Gender Male, 82.5%
Sad 69.4%
Calm 45.2%
Fear 7.8%
Disgusted 7.7%
Surprised 7.1%
Confused 3.6%
Happy 3%
Angry 1.9%

AWS Rekognition

Age 18-24
Gender Male, 61.7%
Calm 48.2%
Happy 24.3%
Fear 11.2%
Surprised 8.1%
Sad 6.5%
Confused 3.3%
Angry 1.7%
Disgusted 0.9%

AWS Rekognition

Age 18-24
Gender Female, 99.9%
Happy 59.9%
Surprised 14.9%
Fear 8.6%
Confused 8.2%
Calm 4.8%
Angry 4.5%
Sad 3.6%
Disgusted 1.6%

AWS Rekognition

Age 26-36
Gender Male, 75.7%
Fear 66.9%
Angry 21.8%
Surprised 12.4%
Calm 4.3%
Sad 4%
Confused 3.1%
Disgusted 3.1%
Happy 2.7%

AWS Rekognition

Age 40-48
Gender Male, 65.3%
Sad 96.8%
Calm 19.6%
Fear 9.6%
Confused 8.4%
Surprised 6.9%
Disgusted 6.2%
Angry 4%
Happy 2%

AWS Rekognition

Age 26-36
Gender Male, 98.6%
Calm 37.9%
Disgusted 31.3%
Sad 14.7%
Fear 7.5%
Surprised 7.1%
Angry 6.8%
Happy 2.9%
Confused 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Bird 92.4%
Person 91.2%

Text analysis

Google

1