Human Generated Data

Title

Untitled (children riding on toy train)

Date

c. 1951

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15615

Human Generated Data

Title

Untitled (children riding on toy train)

People

Artist: Jack Gould, American

Date

c. 1951

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15615

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 98.5
Human 98.5
Person 95
Person 93.9
Person 87
Handrail 76.4
Banister 76.4
Furniture 75.8
Person 75.6
Crib 73.4
Crowd 72
Person 68.9
Room 65.5
Indoors 65.5
Person 65.1
People 62.3
Audience 60.5
Clinic 57.6
LCD Screen 55.6
Electronics 55.6
Screen 55.6
Monitor 55.6
Display 55.6
Person 46.4
Person 44.7
Person 41.7

Clarifai
created on 2023-10-29

people 99.7
woman 98.8
man 97.5
group 97.4
adult 97.1
child 95.5
wedding 92.9
girl 92.1
indoors 91.6
portrait 89.5
retro 89.3
family 89.2
step 86.6
vintage 85.9
sit 85.3
art 84.8
music 83.4
son 81.6
group together 80.1
wear 78.7

Imagga
created on 2022-02-05

graffito 67.7
grunge 51.1
decoration 50.5
old 44.6
vintage 40.5
retro 38.5
antique 36.4
aged 33.5
texture 33.3
container 27.7
ancient 26.8
paper 26.7
envelope 26.4
wall 25.5
frame 21.6
material 21.4
freight car 20.3
art 20.2
dirty 19
wallpaper 18.4
decay 18.3
border 17.2
pattern 17.1
design 16.3
box 15.7
floral 15.3
car 15.1
textured 14.9
grime 14.7
flower 14.6
graphic 14.6
blank 14.6
parchment 14.4
damaged 14.3
grungy 14.2
structure 14
page 13.9
empty 13.7
stain 13.5
textures 13.3
space 13.2
backgrounds 13
grain 12.9
fracture 12.7
brown 12.5
worn 12.4
canvas 12.3
wheeled vehicle 12.2
decorative 11.7
binding 11.5
text 11.4
paint 10.9
mottled 10.7
torn 10.6
stained 10.6
rusty 10.5
artistic 10.4
leaf 10.1
symbol 10.1
letter 10.1
rough 10
distressed 9.8
crack 9.7
style 9.6
carton 9.6
aging 9.6
old fashioned 9.5
card 9.4
building 9.2
backdrop 9.1
history 8.9
painterly 8.9
detail 8.8
crumpled 8.7
detailed 8.7
architecture 8.6
painted 8.6
weathered 8.5
plants 8.3
element 8.3
effect 8.2
painting 8.1
decor 8
surface 7.9
stamp 7.9
smudged 7.9
postage 7.9
ragged 7.8
album 7.8
stains 7.8
faded 7.8
messy 7.7
edge 7.7
vehicle 7.7
obsolete 7.7
mail 7.7
note 7.4
ornate 7.3
drawing 7.3
black 7.2

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

clothing 97.4
text 95.5
person 92.2
man 76.2
old 73.8
people 57.6
posing 48.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Female, 100%
Calm 97.5%
Fear 0.9%
Confused 0.4%
Disgusted 0.4%
Sad 0.3%
Surprised 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 16-24
Gender Male, 98.4%
Calm 52.9%
Confused 17%
Sad 16.7%
Angry 3.6%
Disgusted 3.6%
Fear 2.4%
Surprised 2.2%
Happy 1.6%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 41.8%
Disgusted 20.6%
Angry 15.2%
Sad 8.2%
Confused 4.9%
Surprised 4.9%
Happy 3.2%
Fear 1.3%

AWS Rekognition

Age 4-10
Gender Female, 100%
Calm 78.7%
Sad 13.5%
Fear 6.2%
Disgusted 0.5%
Angry 0.4%
Surprised 0.3%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 2-10
Gender Female, 99.6%
Sad 58.6%
Calm 22%
Fear 11.4%
Angry 2.5%
Disgusted 2.4%
Surprised 1.6%
Confused 1.1%
Happy 0.4%

AWS Rekognition

Age 0-4
Gender Female, 94%
Calm 67.9%
Sad 29%
Confused 1.3%
Angry 0.7%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 2-10
Gender Female, 99.8%
Calm 97.9%
Surprised 0.7%
Sad 0.5%
Fear 0.3%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 47-53
Gender Female, 99.3%
Calm 95%
Sad 2.8%
Surprised 0.5%
Angry 0.4%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 31-41
Gender Female, 100%
Calm 69.2%
Fear 12.2%
Disgusted 7%
Confused 3.7%
Surprised 2.7%
Angry 2.2%
Happy 1.8%
Sad 1.3%

AWS Rekognition

Age 0-6
Gender Male, 95.4%
Calm 73%
Fear 6.7%
Sad 6%
Confused 5.1%
Surprised 4.4%
Angry 3%
Happy 1.1%
Disgusted 0.8%

AWS Rekognition

Age 1-7
Gender Female, 99.7%
Calm 82.3%
Sad 14.8%
Angry 0.9%
Disgusted 0.6%
Confused 0.5%
Fear 0.4%
Surprised 0.3%
Happy 0.3%

AWS Rekognition

Age 6-12
Gender Female, 84.1%
Calm 99.8%
Sad 0.1%
Angry 0%
Surprised 0%
Confused 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 0-6
Gender Male, 94.1%
Calm 94.2%
Confused 2.7%
Sad 1.9%
Surprised 0.4%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 2-8
Gender Male, 99.4%
Calm 90.9%
Sad 5.3%
Confused 1.9%
Fear 1.1%
Disgusted 0.4%
Surprised 0.2%
Happy 0.2%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Male, 55.6%
Calm 43.5%
Surprised 15.9%
Disgusted 14.4%
Sad 10.6%
Angry 8.6%
Confused 2.7%
Fear 2.3%
Happy 2%

AWS Rekognition

Age 4-10
Gender Male, 99.6%
Happy 86.3%
Sad 11.6%
Calm 0.7%
Angry 0.6%
Confused 0.5%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 42-50
Gender Female, 100%
Calm 71%
Happy 16.1%
Angry 4.1%
Confused 2.5%
Sad 2.1%
Disgusted 1.5%
Surprised 1.5%
Fear 1.2%

AWS Rekognition

Age 4-12
Gender Female, 100%
Calm 71.9%
Confused 12.4%
Sad 7.7%
Angry 5.4%
Happy 0.8%
Disgusted 0.7%
Surprised 0.6%
Fear 0.4%

AWS Rekognition

Age 2-10
Gender Female, 99.4%
Calm 63.2%
Happy 15.8%
Confused 7.7%
Sad 5.8%
Disgusted 2.5%
Angry 2.4%
Surprised 1.6%
Fear 0.9%

AWS Rekognition

Age 6-12
Gender Female, 98.7%
Calm 35.3%
Sad 27.5%
Fear 21.8%
Surprised 8.6%
Disgusted 2.9%
Happy 1.5%
Angry 1.3%
Confused 1.2%

AWS Rekognition

Age 6-14
Gender Female, 63.8%
Calm 42.9%
Angry 28.9%
Fear 10.6%
Sad 8.1%
Confused 4.6%
Surprised 3.7%
Disgusted 0.8%
Happy 0.4%

AWS Rekognition

Age 0-6
Gender Male, 99.2%
Calm 70.2%
Sad 14.5%
Confused 8.5%
Angry 2.6%
Surprised 1.8%
Fear 1.4%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 45-51
Gender Female, 100%
Calm 99.1%
Sad 0.3%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.8%
Calm 70.7%
Happy 23.1%
Sad 2.2%
Angry 1.9%
Surprised 0.9%
Disgusted 0.6%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 74.2%
Calm 84.3%
Disgusted 7.1%
Happy 2.7%
Sad 2.4%
Angry 1.1%
Confused 0.9%
Fear 0.9%
Surprised 0.5%

AWS Rekognition

Age 6-12
Gender Female, 75.6%
Calm 97.8%
Happy 1.2%
Sad 0.5%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 6-12
Gender Male, 83.5%
Calm 97.5%
Sad 0.9%
Surprised 0.5%
Confused 0.4%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Female, 56.7%
Sad 81.1%
Fear 8%
Disgusted 6.2%
Calm 1.5%
Happy 1.2%
Surprised 0.9%
Angry 0.7%
Confused 0.3%

AWS Rekognition

Age 38-46
Gender Female, 100%
Happy 93.8%
Disgusted 2.4%
Surprised 1.3%
Calm 0.7%
Angry 0.6%
Fear 0.5%
Sad 0.4%
Confused 0.3%

AWS Rekognition

Age 12-20
Gender Female, 73.3%
Calm 96.4%
Sad 1%
Happy 0.8%
Confused 0.8%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%
Angry 0.1%

AWS Rekognition

Age 25-35
Gender Male, 92.1%
Calm 81.6%
Angry 7.9%
Disgusted 4.1%
Sad 2.3%
Surprised 1.3%
Fear 1.2%
Confused 0.9%
Happy 0.8%

AWS Rekognition

Age 2-10
Gender Male, 77.9%
Calm 96.4%
Surprised 1.7%
Sad 0.6%
Fear 0.5%
Happy 0.3%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 9-17
Gender Female, 98.8%
Calm 99%
Happy 0.3%
Sad 0.3%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 1-7
Gender Male, 87.3%
Calm 99.3%
Surprised 0.4%
Sad 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 23-31
Gender Male, 78%
Sad 77.1%
Calm 7.7%
Happy 3.6%
Confused 3.2%
Disgusted 2.9%
Angry 2.5%
Fear 2.1%
Surprised 0.9%

AWS Rekognition

Age 23-31
Gender Male, 62%
Calm 94.4%
Sad 1.8%
Happy 1.2%
Confused 0.8%
Angry 0.6%
Surprised 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 6-12
Gender Male, 80.2%
Calm 93.6%
Sad 3.9%
Happy 0.6%
Disgusted 0.5%
Confused 0.4%
Angry 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 13-21
Gender Female, 99.5%
Calm 92.9%
Disgusted 3.8%
Confused 1%
Sad 0.6%
Happy 0.5%
Surprised 0.4%
Fear 0.4%
Angry 0.3%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 41
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person
Crib
Person 98.5%
Person 95%
Person 93.9%
Person 87%
Person 75.6%
Person 68.9%
Person 65.1%
Person 46.4%
Person 44.7%
Person 41.7%
Crib 73.4%

Categories

Text analysis

Amazon

CITY OF ST.
CITY OF ST. LOUIS
LOUIS

Google

TY SE S
TY
SE
S