Human Generated Data

Title

Occupying Wall Street, January 31, 2012
Date

2012
People

Artist: Accra Shepp, American born 1962
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2019.314.14
Copyright

© Accra Shepp

Human Generated Data

Title

Occupying Wall Street, January 31, 2012

People

Artist: Accra Shepp, American born 1962

Date

2012

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2019.314.14

Copyright

© Accra Shepp

Machine Generated Data

Tags

Amazon
created on 2023-07-07

Clothing 99.8
Footwear 99.8
Shoe 99.8
Sitting 99.7
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
Accessories 99.5
Bag 99.5
Handbag 99.5
Shoe 98.6
Person 98.2
Coat 97.9
Person 94.8
Person 93.9
Person 93.3
Adult 93.3
Male 93.3
Man 93.3
Handbag 91.1
Hat 89.9
Person 85.8
Handbag 81.7
Head 81.3
Face 81.3
Body Part 78.3
Finger 78.3
Hand 78.3
Jewelry 77
Ring 77
Chair 73.1
Furniture 73.1
Chess 60.4
Game 60.4
Cap 57.3
Overcoat 56.8
Photography 56.3

Clarifai
created on 2023-10-13

people 99.8
street 99.7
monochrome 98.2
adult 96.8
two 96.1
man 94.8
one 93.8
portrait 93.3
bench 91.9
vehicle 88
music 87.1
wear 86.9
black and white 85.5
road 84.2
rangefinder 84.1
three 83.4
woman 82.4
city 82.3
urban 81.7
furniture 81.5

Imagga
created on 2023-07-07

person 36.4
man 30.9
people 26.2
male 22.8
adult 22
wheelchair 21.6
city 19.1
vehicle 19
worker 18.7
chair 18.5
street 17.5
portrait 17.5
work 17.3
youth 17
lifestyle 16.6
device 16.1
outdoor 16.1
scholar 15.7
wheeled vehicle 15.6
building 15.1
working 15
outdoors 14.6
women 14.2
one 14.2
seat 14
happy 13.8
equipment 13.5
attractive 13.3
job 13.3
urban 13.1
safety 12.9
men 12.9
occupation 12.8
smile 12.8
casual 12.7
intellectual 12.6
repair 12.5
tricycle 12.2
exercise bike 11.7
helmet 11.7
smiling 10.9
labor 10.7
sexy 10.4
construction 10.3
industry 10.2
tool 9.9
park 9.9
fashion 9.8
pretty 9.8
looking 9.6
home 9.6
tools 9.5
exercise device 9.3
lawn mower 9.2
bench 9.2
alone 9.1
student 9.1
road 9
backpack 8.9
builder 8.7
couple 8.7
grass 8.7
sitting 8.6
walking 8.5
active 8.5
teenager 8.2
bag 8.2
school 8.1
foreman 7.9
education 7.8
conveyance 7.8
model 7.8
outside 7.7
old 7.7
university 7.6
jeans 7.6
wheel 7.5
vacuum 7.5
holding 7.4
furniture 7.4
lady 7.3
business 7.3
industrial 7.3
black 7.2
music 7.2
cute 7.2
activity 7.2

Google
created on 2023-07-07

Shoe 95.7
Leg 91
Black-and-white 86.5
Style 84.2
Road surface 83
Musician 82.7
Building 82
Tree 81.7
People 78
Sidewalk 77.8
Luggage and bags 77.1
Sneakers 76.2
Road 75.3
Hat 74.6
Monochrome 74.4
Monochrome photography 74
Bag 74
Human leg 73.3
Knee 73
Sitting 72.3

Microsoft
created on 2023-07-07

outdoor 99.8
person 99
street 98.6
black and white 96.8
ground 95.8
clothing 94.7
man 88.8
monochrome 87.5
footwear 81.7
musical instrument 77.2
park 72.4
waste container 68

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-65
Gender Female, 99.8%
Sad 100%
Surprised 6.6%
Fear 6.4%
Calm 2%
Angry 1.2%
Disgusted 0.8%
Happy 0.6%
Confused 0.4%

Microsoft Cognitive Services

Age 71
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.8%
Person 99.7%
Adult 99.7%
Male 99.7%
Man 99.7%
Handbag 99.5%
Hat 89.9%
Ring 77%
Chair 73.1%

Categories

Imagga

paintings art 44.2%
people portraits 28.6%
streetview architecture 22.7%
cars vehicles 1.3%

Captions

Microsoft
created on 2023-07-07

a man sitting on a bench 83.8%
a man sitting on a park bench 68.1%
a man sitting on a bench in a park 61.7%

Text analysis

Amazon

AM
AM A
OBCREATOR
EAM
I
A
NYC
TUMERIC-
VEGAN
-

Google

1959 EAM OBAMA TUMERIC- MASALT CAYENNE VEGAN ELIXIR CLEANSING FORMULA NYC 18 AM A DBCREATOR GAS
EAM
MASALT
CAYENNE
CLEANSING
FORMULA
18
AM
DBCREATOR
1959
OBAMA
TUMERIC
VEGAN
ELIXIR
NYC
A
GAS