Human Generated Data

Title

Occupying Wall Street, January 24, 2012

Date

2012

People

Artist: Accra Shepp, American born 1962

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2019.314.13

Copyright

© Accra Shepp

Human Generated Data

Title

Occupying Wall Street, January 24, 2012

People

Artist: Accra Shepp, American born 1962

Date

2012

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2019.314.13

Copyright

© Accra Shepp

Machine Generated Data

Tags

Amazon
created on 2023-07-06

Clothing 100
Footwear 99.7
Shoe 99.7
Shoe 99.7
Shoe 99.4
Adult 99.4
Female 99.4
Person 99.4
Woman 99.4
Adult 99.1
Person 99.1
Male 99.1
Man 99.1
Shoe 98.9
Adult 98.9
Person 98.9
Male 98.9
Man 98.9
People 98.8
Body Part 98.7
Finger 98.7
Hand 98.7
Jacket 97.7
Jacket 97.7
Shoe 97.6
Shoe 97.3
Person 96.8
Jeans 96.4
Pants 96.4
Photography 96.3
Accessories 95.9
Bracelet 95.9
Jewelry 95.9
Jeans 90
Face 88.2
Head 88.2
Coat 86.6
Glove 80.3
Cap 75.7
Shoe 70.2
Car 62.4
Transportation 62.4
Vehicle 62.4
Shoe 61.2
Portrait 57.9
Photographer 56.9
Leather Jacket 55.6
Bag 55.3
Handbag 55.3
Hat 55.3
Pedestrian 55.2
Walking 55

Clarifai
created on 2023-10-13

people 99.6
street 98.1
military 96.4
adult 95
group 95
police 94.1
administration 93.9
group together 93.5
wear 92.4
portrait 92.3
war 91.7
woman 91.2
many 90.7
man 88.6
offense 87.1
child 87.1
outfit 86
soldier 85.9
law enforcement 84.4
uniform 84.3

Imagga
created on 2023-07-06

uniform 62.8
military uniform 49.6
clothing 47.2
helmet 42.6
mask 41.2
covering 37.3
man 32.9
soldier 32.3
military 31.9
protection 27.3
male 24.8
consumer goods 24.3
war 24.2
gun 23.4
weapon 22.8
people 21.8
army 21.5
sport 20.8
protective covering 20.5
person 19.4
equipment 18.8
danger 18.2
adult 18.1
camouflage 18
safety 16.6
warrior 15.6
men 14.6
portrait 13.6
football helmet 12.7
battle 11.7
fight 11.6
game 11.6
urban 11.4
rifle 11.2
training 11.1
street 11
warfare 10.8
armor 10.8
armed 10.8
city 10.8
disaster 10.7
headdress 10.7
protective 10.7
outdoor 10.7
human 10.5
black 10.4
commodity 10.3
security 10.1
armor plate 10.1
photographer 9.9
forces 9.8
conflict 9.8
guard 9.7
breastplate 9.5
play 9.5
player 9.3
action 9.3
private 9.2
competition 9.2
team 9
hockey stick 8.9
shield 8.9
toxic 8.8
defense 8.8
chemical 8.7
gas 8.7
football 8.6
special 8.6
walking 8.5
athlete 8.4
fire 8.4
holding 8.3
to 8
back 7.9
radioactive 7.9
radiation 7.8
standing 7.8
stick 7.8
accident 7.8
backpack 7.8
ready 7.7
athletic 7.7
head 7.6
power 7.6
pedestrian 7.4
looking 7.2
active 7.2
women 7.1
travel 7

Google
created on 2023-07-06

Microsoft
created on 2023-07-06

person 100
clothing 98.9
military uniform 93.6
man 91
outdoor 89.8
standing 88.7
footwear 81.4
black and white 80.7
group 78.6
jacket 72.9
posing 66.3
text 58.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 92.4%
Surprised 6.7%
Fear 6%
Sad 2.7%
Confused 2.2%
Angry 2%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 97%
Surprised 6.4%
Fear 6%
Sad 2.3%
Angry 0.7%
Happy 0.6%
Confused 0.5%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 31.6%
Confused 21.4%
Surprised 13.7%
Fear 11.5%
Sad 10.7%
Angry 9%
Disgusted 3.6%
Happy 1.5%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Shoe
Adult
Female
Person
Woman
Male
Man
Jacket
Jeans
Bracelet
Coat
Glove
Car
Hat
Shoe 99.7%
Shoe 99.7%
Shoe 99.4%
Shoe 98.9%
Shoe 97.6%
Shoe 97.3%
Shoe 70.2%
Shoe 61.2%
Adult 99.4%
Adult 99.1%
Adult 98.9%
Female 99.4%
Person 99.4%
Person 99.1%
Person 98.9%
Person 96.8%
Woman 99.4%
Male 99.1%
Male 98.9%
Man 99.1%
Man 98.9%
Jacket 97.7%
Jacket 97.7%
Jeans 96.4%
Jeans 90%
Bracelet 95.9%
Coat 86.6%
Glove 80.3%
Car 62.4%
Hat 55.3%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-13

a photograph of a group of men standing next to each other -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The black-and-white image features three individuals standing outdoors in an urban environment, possibly near a busy street or plaza, as suggested by the blurred background with buildings, pedestrians, and vehicles. The individuals are wearing layered clothing suitable for cooler weather, including jackets, hoodies, and scarves. Their outfits feature accessories such as chains, pins, and backpacks, indicating a casual or alternative style. One person positions their arm forward in a gesture, while two others stand with arms relaxed at their sides. A folded jacket or bag is visible on the ground near them.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a black-and-white photograph featuring three individuals standing on a city street. The person on the left is wearing a leather jacket, dark pants, and black shoes. This individual is also wearing a hood or scarf over their head. The person in the middle is dressed in a buttoned-up jacket with various pins, lighter-colored pants, and shoes, and is making a fist gesture with one hand. The person on the right is wearing a long-sleeved sweater, jeans, and dark shoes. This individual has their arms crossed in front. In the background, there are tall buildings and blurry, moving vehicles, suggesting an urban setting. There is also a soft focus on the background creating a sense of depth.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-01

The image shows three young men standing on a city street. They appear to be wearing street clothes, with one wearing a leather jacket, another wearing a hooded jacket, and the third wearing a long jacket. The men have serious expressions on their faces and are standing together, suggesting some kind of group or association. The background shows buildings and a street, indicating an urban setting.

Created by claude-3-opus-20240229 on 2025-01-01

The image shows three Black men standing together on a city sidewalk. They are all wearing leather jackets, with two in black jackets and one in a brown jacket. The man in the center is also wearing a button-up shirt and jeans, while the men on either side are wearing dark pants. They have serious expressions on their faces as they pose for the photo. Based on their attire and the urban setting, the image appears to be from the late 20th century, likely the 1970s or 1980s. The men project a tough, unified presence as they stand shoulder-to-shoulder on the street.

Created by claude-3-5-sonnet-20241022 on 2025-01-01

This is a black and white street photograph showing three young men standing together on what appears to be a city sidewalk. Each has a distinct style of dress: the person on the left wears a leather jacket and hood/head covering, the person in the middle wears a light-colored jacket with some pins or badges, and the person on the right wears a knitted hoodie. They all wear casual pants and shoes, creating an urban streetwear aesthetic. The image appears to be taken in an urban setting with buildings visible in the background. The composition is straightforward and documentary in style, capturing what seems to be a candid moment on the street.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of three men standing on a city sidewalk. The man on the left wears a black leather jacket, black pants, and a black headscarf, with his right hand clenched into a fist. The man in the middle sports a backpack, a dark jacket with a white collar, and light-colored pants, with his left hand resting on his shoulder. The man on the right is dressed in a dark sweater, jeans, and a backpack, with his hands clasped in front of him.

In the background, a city street is visible, featuring buildings, a trash can, and a white vehicle. The overall atmosphere suggests a daytime setting, possibly during a protest or demonstration, given the men's attire and postures.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image depicts three men standing on a city sidewalk, with the man in the middle making a fist. The man on the left is wearing a leather jacket, a scarf, and a backpack, while the man in the middle is dressed in a jacket with a hood, a backpack, and a pin on his chest. The man on the right is wearing a sweater, a backpack, and a watch. In the background, there are buildings and people walking around, suggesting that the photo was taken in an urban setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

Three men are standing on the sidewalk, probably posing for a photo. The man on the left is wearing a leather jacket and a scarf around his neck. The man in the middle is wearing a jacket with a hood and a scarf around his neck. The man on the right is wearing a sweater and a scarf. They are all wearing shoes. Behind them, there is a blurry background of people and buildings.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The black-and-white photo shows three men standing close together on a concrete pavement. The man on the left is wearing a leather jacket, a plaid shirt, and pants. The man in the middle is wearing a jacket, pants, and sneakers. The man on the right is wearing a sweater, pants, and shoes. He is also wearing a bracelet. Behind them are blurry images of people, buildings, and vehicles.

Google Gemini

Created by gemini-2.0-flash on 2025-05-31

Here is a description of the image:

This black and white medium shot features three men in urban clothing standing on a city sidewalk. The man on the left is wearing a leather jacket, a dark scarf wrapped around his head, black pants, and loafers. He has a chain hanging from his pocket and is making a fist. The man in the center wears a button-up jacket, a hooded sweatshirt underneath, light-colored jeans, and sneakers. He has a backpack and a chain hanging from his pocket, and he is also making a fist. The man on the right is wearing a sweater, a dark scarf, jeans, and sneakers. He has a backpack and his arms are crossed.

The background is blurred, but it appears to be a busy city street with buildings and pedestrians. The image has a gritty, urban feel to it.

Created by gemini-2.0-flash-lite on 2025-05-31

Here's a description of the image:

Overall Impression:

The image is a black and white photograph featuring three young Black men standing on a sidewalk. The composition has a gritty, documentary feel, capturing a moment in time.

Detailed Description:

  • Subject: The three men are the focal point. They are dressed in casual, urban attire. The man on the left wears a leather jacket and a head covering, the man in the middle is wearing a utility jacket and the man on the right has on a sweater and a hoody.
  • Setting: The photograph appears to be taken on a city sidewalk, with buildings and what appear to be other people blurred in the background. The lighting suggests it might be an overcast day.
  • Composition: The men are positioned closely together in a row, facing the camera. They have a distinct posture, adding to their serious gaze.
  • Tone: The photograph has a somewhat serious and contemplative mood. The black and white palette gives the image a timeless quality.

In summary, the image is a striking portrait of three young men in an urban setting. The photograph has a strong visual impact, giving the viewer a glimpse into a particular moment in time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The black-and-white photograph depicts three young men standing on a city sidewalk. The setting appears to be urban, with buildings and possibly a street scene in the background.

  1. Man on the Left:

    • He is wearing a leather jacket over a hooded sweatshirt.
    • He has a scarf wrapped around his head and neck.
    • His pants are dark, and he is wearing dark shoes.
    • He has a chain hanging from his pants and is holding gloves in his left hand.
  2. Man in the Center:

    • He is wearing a light-colored jacket over a hooded sweatshirt.
    • His pants are light-colored and slightly rolled up at the bottom.
    • He has a chain hanging from his pants and is making a gesture with his right hand, pointing towards the camera.
    • He is wearing dark shoes.
  3. Man on the Right:

    • He is wearing a dark, ribbed sweater over a hooded sweatshirt.
    • His pants are light-colored and baggy.
    • He has a chain hanging from his pants and is standing with his arms crossed.
    • He is wearing dark shoes.

The overall mood of the photograph is casual yet assertive, with the individuals appearing confident and relaxed in their urban environment. The black-and-white tone adds a timeless quality to the image.

Text analysis

Amazon

140

Google

140 7
140
7