Human Generated Data

Title

Boardwalk Bench Spectators, Santa Monica, CA
Date

1954
People

Artist: Larry Silver, American born 1934
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bruce Silverstein, 2018.395

Human Generated Data

Title

Boardwalk Bench Spectators, Santa Monica, CA

People

Artist: Larry Silver, American born 1934

Date

1954

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bruce Silverstein, 2018.395

Machine Generated Data

Tags

Amazon
created on 2023-06-15

Restaurant 100
Indoors 100
Cafeteria 99.8
Cafe 99.6
Shoe 99.6
Clothing 99.6
Footwear 99.6
Shoe 99.4
Shoe 99.4
Person 99.2
Bag 99.2
Handbag 99.2
Accessories 99.2
Male 99
Adult 99
Person 99
Man 99
Shoe 98.8
Handbag 98.7
Male 98.7
Adult 98.7
Person 98.7
Man 98.7
Person 98.6
Person 98.6
Person 98.6
Person 98.5
Male 98.4
Adult 98.4
Person 98.4
Man 98.4
Person 98.4
Person 98.3
Shoe 98.3
Shoe 98.3
Person 97.9
Person 97.8
Person 97.6
Hat 97.4
Person 97.4
Person 97.2
Shoe 97.2
Person 97
Shoe 96.8
Person 96.7
Architecture 96.6
Outdoors 96.6
Shelter 96.6
Hat 96.3
Shoe 95.4
Hat 93.6
Glasses 93.2
Neighborhood 93
Shoe 92.3
Person 92.3
Glasses 92.1
Shoe 89.8
Hat 89.7
Shoe 89.5
Coat 89.2
Person 89.1
Shoe 88.4
High Heel 88.4
Person 88
Handbag 87.6
Person 87.6
Shoe 87.5
Formal Wear 86.9
Tie 86.9
Person 86.4
Handbag 85.1
Hat 84.5
Glasses 82.9
Shoe 82.8
Hat 81.5
Shoe 80.7
Building 80.4
Shoe 78.5
Furniture 77.9
Shoe 76.7
Tie 75.9
Person 70.2
Suit 68.9
Urban 68.9
Shoe 64.8
City 63.1
Handbag 60.6
Bench 57.8
People 57.6
Pants 57.5
Hat 56.8
Bus Stop 56.1
Overcoat 55.6
Canopy 55.4
Food 55.3
Path 55.3
Sidewalk 55.3
Diner 55.3
Kiosk 55.2

Clarifai
created on 2023-10-13

people 99.9
street 98.9
monochrome 98.7
group together 98.5
group 98.5
adult 97.8
many 97.5
woman 96.5
man 95.3
child 88.9
wear 88.4
vehicle 86.9
recreation 86.6
several 86
music 85.1
commerce 84.5
city 75.1
transportation system 74.2
crowd 73.9
administration 70.8

Imagga
created on 2023-06-15

city 26.6
building 22.6
architecture 18.2
old 18.1
people 17.8
street 17.5
statue 15.3
man 14.8
pedestrian 12.2
urban 12.2
monument 12.1
person 11.9
sculpture 11.5
black 11.4
travel 11.3
men 11.2
landmark 10.8
tourism 10.7
musical instrument 9.9
adult 9.8
shop 9.8
world 9.7
window 9.4
stone 9.3
male 9.3
outdoor 9.2
tourist 9
religion 9
walking 8.5
famous 8.4
art 8.4
vintage 8.3
historic 8.2
road 8.1
women 7.9
day 7.8
scene 7.8
sepia 7.8
portrait 7.8
winter 7.7
kin 7.6
decoration 7.6
barbershop 7.6
house 7.5
town 7.4
transportation 7.2
facade 7

Google
created on 2023-06-15

Photograph 94.2
White 92.2
Black 89.9
Infrastructure 89.3
Window 87.4
Black-and-white 86.5
Standing 86.4
Neighbourhood 84.1
Style 83.9
Building 82.3
Road 78.6
Monochrome photography 78.1
City 77.8
Monochrome 77.4
Urban area 73.5
Crowd 72.5
Motor vehicle 71.5
Pedestrian 71.1
Street 69.7
House 68.9

Microsoft
created on 2023-06-15

building 100
outdoor 99.7
street 97.6
person 93.7
black and white 93.5
text 91.6
clothing 85.1
man 78.6
monochrome 74.1
group 69.7
old 66
people 57.2
posing 38.4
store 31.4
several 10.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Angry 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Calm 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 43-51
Gender Male, 100%
Happy 93.2%
Surprised 6.5%
Fear 6%
Calm 2.9%
Sad 2.6%
Confused 0.7%
Angry 0.7%
Disgusted 0.5%

AWS Rekognition

Age 38-46
Gender Male, 100%
Confused 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.3%
Angry 0.2%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Disgusted 51.6%
Angry 38%
Surprised 6.6%
Fear 6%
Confused 6%
Sad 2.3%
Calm 2.3%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Female, 99.7%
Calm 98.6%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.4%
Angry 0.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 66-76
Gender Male, 100%
Calm 86.5%
Surprised 6.6%
Fear 6%
Disgusted 4.3%
Confused 4.3%
Sad 2.5%
Happy 1.5%
Angry 1.3%

AWS Rekognition

Age 43-51
Gender Female, 99.9%
Happy 37%
Fear 28%
Calm 25.6%
Surprised 7.3%
Disgusted 2.8%
Sad 2.8%
Angry 2.6%
Confused 1%

AWS Rekognition

Age 57-65
Gender Male, 99.6%
Calm 73.7%
Angry 8.7%
Disgusted 8.2%
Surprised 7%
Fear 6.3%
Confused 3.5%
Sad 3%
Happy 0.8%

AWS Rekognition

Age 56-64
Gender Female, 99.8%
Angry 51.1%
Confused 39.9%
Surprised 6.5%
Fear 6.2%
Sad 3.3%
Disgusted 2%
Calm 2%
Happy 0.6%

AWS Rekognition

Age 53-61
Gender Male, 84.8%
Fear 36.7%
Surprised 17.9%
Confused 13.3%
Calm 12.1%
Disgusted 10.9%
Sad 8.4%
Angry 5.6%
Happy 1.2%

AWS Rekognition

Age 35-43
Gender Male, 93.3%
Angry 97%
Surprised 6.4%
Fear 6%
Sad 2.2%
Calm 1.1%
Disgusted 0.6%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 45-53
Gender Male, 98.5%
Calm 98.6%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Calm 75.6%
Confused 13.4%
Surprised 6.6%
Fear 6.3%
Happy 3.1%
Sad 2.8%
Angry 2.1%
Disgusted 2%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 97.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 1.3%
Angry 1.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 29-39
Gender Male, 100%
Sad 100%
Fear 7.3%
Surprised 6.4%
Disgusted 4.3%
Confused 2.6%
Calm 1%
Angry 0.9%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 97.7%
Surprised 6.8%
Fear 5.9%
Sad 2.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Female, 50.1%
Sad 98.1%
Calm 34.5%
Surprised 7.4%
Fear 6.5%
Angry 3.4%
Happy 3%
Disgusted 0.7%
Confused 0.6%

AWS Rekognition

Age 6-16
Gender Male, 95%
Fear 97.2%
Surprised 6.3%
Calm 4.2%
Sad 2.3%
Happy 0.5%
Disgusted 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 4-12
Gender Male, 65%
Calm 62%
Sad 14%
Surprised 13.4%
Fear 7.1%
Disgusted 5.1%
Angry 3.7%
Confused 1.6%
Happy 0.8%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.6%
Person 99.2%
Handbag 99.2%
Male 99%
Adult 99%
Man 99%
Hat 97.4%
Glasses 93.2%
High Heel 88.4%
Tie 86.9%
Building 80.4%
Suit 68.9%

Categories

Imagga

paintings art 99.2%

Text analysis

Amazon

Malts
Jumbo
FOUNTAIN
FOUNTAIN SERVICE
CUP
SERVICE
CAFE
FROSTY
SPEEDY
LEO'S
Jumbo Malts 25°
DRINK
Coca-Cola
KHOURY'S
BOUNCE
your
TO
TO THE
THE
MORE BOUNCE
R
Here's
OUNCE!
MORE
25°
silent LEO'S
silent
NFH
PC
RED.US.PAT.

Google

Here's your LEDSTILL FROSTY CUP 1:07 mgom KHOURY'S DRINK Silent LEO'S FOUNTAIN SERVICE Jumbo Malts 25 MORE BOUNCE TO THE OUNCE! Coca-Cola SPEEDY CAFE Jinx C R
Here's
your
LEDSTILL
FROSTY
CUP
1:07
mgom
KHOURY'S
DRINK
Silent
LEO'S
FOUNTAIN
SERVICE
Jumbo
Malts
25
MORE
BOUNCE
TO
THE
OUNCE
!
Coca
-
Cola
SPEEDY
CAFE
Jinx
C
R