Human Generated Data

Title

Occupying Wall Street, January 31, 2012

Date

2012

People

Artist: Accra Shepp, American born 1962

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2019.314.14

Copyright

© Accra Shepp

Human Generated Data

Title

Occupying Wall Street, January 31, 2012

People

Artist: Accra Shepp, American born 1962

Date

2012

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2019.314.14

Copyright

© Accra Shepp

Machine Generated Data

Tags

Amazon
created on 2023-07-07

Clothing 99.8
Footwear 99.8
Shoe 99.8
Sitting 99.7
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
Accessories 99.5
Bag 99.5
Handbag 99.5
Shoe 98.6
Person 98.2
Coat 97.9
Person 94.8
Person 93.9
Person 93.3
Adult 93.3
Male 93.3
Man 93.3
Handbag 91.1
Hat 89.9
Person 85.8
Handbag 81.7
Face 81.3
Head 81.3
Body Part 78.3
Finger 78.3
Hand 78.3
Jewelry 77
Ring 77
Chair 73.1
Furniture 73.1
Chess 60.4
Game 60.4
Cap 57.3
Overcoat 56.8
Photography 56.3

Clarifai
created on 2023-10-13

people 99.8
street 99.7
monochrome 98.2
adult 96.8
two 96.1
man 94.8
one 93.8
portrait 93.3
bench 91.9
vehicle 88
music 87.1
wear 86.9
black and white 85.5
road 84.2
rangefinder 84.1
three 83.4
woman 82.4
city 82.3
urban 81.7
furniture 81.5

Imagga
created on 2023-07-07

person 36.4
man 30.9
people 26.2
male 22.8
adult 22
wheelchair 21.6
city 19.1
vehicle 19
worker 18.7
chair 18.5
street 17.5
portrait 17.5
work 17.3
youth 17
lifestyle 16.6
device 16.1
outdoor 16.1
scholar 15.7
wheeled vehicle 15.6
building 15.1
working 15
outdoors 14.6
women 14.2
one 14.2
seat 14
happy 13.8
equipment 13.5
attractive 13.3
job 13.3
urban 13.1
safety 12.9
men 12.9
occupation 12.8
smile 12.8
casual 12.7
intellectual 12.6
repair 12.5
tricycle 12.2
exercise bike 11.7
helmet 11.7
smiling 10.9
labor 10.7
sexy 10.4
construction 10.3
industry 10.2
tool 9.9
park 9.9
fashion 9.8
pretty 9.8
looking 9.6
home 9.6
tools 9.5
exercise device 9.3
lawn mower 9.2
bench 9.2
alone 9.1
student 9.1
road 9
backpack 8.9
builder 8.7
couple 8.7
grass 8.7
sitting 8.6
walking 8.5
active 8.5
teenager 8.2
bag 8.2
school 8.1
foreman 7.9
education 7.8
conveyance 7.8
model 7.8
outside 7.7
old 7.7
university 7.6
jeans 7.6
wheel 7.5
vacuum 7.5
holding 7.4
furniture 7.4
lady 7.3
business 7.3
industrial 7.3
black 7.2
music 7.2
cute 7.2
activity 7.2

Google
created on 2023-07-07

Shoe 95.7
Leg 91
Black-and-white 86.5
Style 84.2
Road surface 83
Musician 82.7
Building 82
Tree 81.7
People 78
Sidewalk 77.8
Luggage and bags 77.1
Sneakers 76.2
Road 75.3
Hat 74.6
Monochrome 74.4
Monochrome photography 74
Bag 74
Human leg 73.3
Knee 73
Sitting 72.3

Microsoft
created on 2023-07-07

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-65
Gender Female, 99.8%
Sad 100%
Surprised 6.6%
Fear 6.4%
Calm 2%
Angry 1.2%
Disgusted 0.8%
Happy 0.6%
Confused 0.4%

Microsoft Cognitive Services

Age 71
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe
Person
Adult
Male
Man
Handbag
Hat
Ring
Chair
Shoe 99.8%
Shoe 98.6%
Person 99.7%
Person 98.2%
Person 94.8%
Person 93.9%
Person 93.3%
Person 85.8%
Adult 99.7%
Adult 93.3%
Male 99.7%
Male 93.3%
Man 99.7%
Man 93.3%
Handbag 99.5%
Handbag 91.1%
Handbag 81.7%
Hat 89.9%
Ring 77%
Chair 73.1%

Categories

Captions

Microsoft
created by unknown on 2023-07-07

a man sitting on a bench 83.8%
a man sitting on a park bench 68.1%
a man sitting on a bench in a park 61.7%

Clarifai
created by general-english-image-caption-blip on 2025-05-02

a photograph of a man sitting on a chair with a suitcase -100%

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image shows an older person, likely a man, sitting in a wheelchair on a city street. The person is bundled up in winter clothing, wearing a hat, coat, and boots. The person has a serious expression on their face and appears to be holding something, possibly a snack or other small item. There is a sign in front of the person that says "I am a Dobcreator".

Created by claude-3-opus-20240229 on 2025-01-01

The black and white image shows an elderly man sitting outdoors in what appears to be a public park or square during wintertime, based on the bare trees and lack of leaves. The man is bundled up in a heavy coat, knit hat, and pants as he sits in a folding chair next to a sign that says "I am a dbscreator". In front of him is a bottle, likely containing some kind of beverage. The setting suggests an urban environment, with buildings visible in the background. The man's facial expression and body language convey a sense of solemnity or thoughtfulness as he sits alone in the cold weather.

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This is a black and white photograph taken in what appears to be a city park or public square. In the image, someone is sitting in a folding chair, dressed warmly in a winter coat, knit hat, and jeans with boots. They appear to be doing some kind of handiwork or craft while seated. In the background, you can see chess tables, bare winter trees, and urban buildings. There's a water bottle and some other personal items on the ground next to the chair, along with what looks like a sign. The scene has a distinctly urban, possibly New York City feel to it, with the characteristic mix of public space and city architecture in the background.

Google Gemini

Created by gemini-2.0-flash on 2025-05-04

The black and white portrait features an elderly woman sitting in a folding chair in what appears to be a public square. She is wearing a knit cap, a quilted vest, and a dark coat, and her legs are crossed. She is knitting, her hands occupied with needles and yarn.

Beside her chair, on the ground, there is a black bag, a bottle of water, a small vase with flowers, and a cardboard sign that reads "I AM A JOBCREATOR." The sign suggests that she is perhaps selling her handiwork.

In the background, there are tables set up with chess boards, and people can be seen strolling around the square. The backdrop includes buildings and bare trees, indicating that it may be winter or early spring. The overall scene captures a moment of everyday life, highlighting the woman's presence and activity in this urban setting.

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression:

The image is a black and white photograph of an elderly woman sitting on a folding chair in what appears to be a city park. The photograph has a candid, documentary feel.

Subject:

  • The woman is the clear focus. She's wearing a knitted hat, a puffy vest, and what looks like a long coat. She's sitting with her legs crossed, and she's holding knitting needles and yarn in her hands.
  • She appears to be gazing directly at the camera.
  • Her posture is relaxed, yet she has a slightly serious or contemplative expression.

Setting:

  • The photograph seems to be taken outdoors in an urban environment. Buildings and trees are visible in the background, suggesting a city park or public space.
  • A few people are strolling in the background.

Objects in the Frame:

  • A black bag is next to her feet, as well as a bottle of water and a small sign that reads "I AM A JOB CREATOR."
  • A small vase of flowers is on the ground.

Composition:

  • The photograph is well-composed, with the woman positioned centrally in the frame.
  • The use of black and white enhances the texture and detail in the shot.
  • The depth of field isn't very deep, which focuses attention on the woman.

Overall Mood:

The image evokes a feeling of quiet observation, perhaps reflecting the day-to-day life of someone in an urban environment. It might suggest economic hardships, the dignity of work or the simple act of creating. The monochrome style gives it a timeless quality.

Text analysis

Amazon

AM
AM A
OBCREATOR
EAM
I
A
NYC
TUMERIC-
VEGAN
-

Google

1959 EAM OBAMA TUMERIC- MASALT CAYENNE VEGAN ELIXIR CLEANSING FORMULA NYC 18 AM A DBCREATOR GAS
1959
EAM
OBAMA
TUMERIC
MASALT
CAYENNE
VEGAN
ELIXIR
CLEANSING
FORMULA
NYC
18
AM
A
DBCREATOR
GAS