Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Asphalt 100
Tarmac 100
Person 99.8
Human 99.8
Road 99.8
Pedestrian 99.7
Person 99.5
Person 99.2
Person 98.8
Clothing 98.4
Footwear 98.4
Apparel 98.4
Shoe 98.4
Zebra Crossing 96.6
Jeans 96.5
Pants 96.5
Denim 96.5
Shoe 96.5
Person 94.1
Person 93.2
Person 93.1
Shoe 89.9
Shoe 86.8
Shoe 84.8
Person 69
Urban 68.8
City 68.4
Town 68.4
Building 68.4
Person 66.4
Architecture 59
Person 41.6

Clarifai
created on 2019-11-16

street 99.5
road 99.4
city 98.9
people 98.6
police 97.2
group 96.9
battle 95.9
action 95.7
many 95.7
drag race 95.6
offense 93.1
landscape 92.3
crowd 91.8
woman 91.4
flag 90.5
school 90.4
man 89.6
urban 89.3
rebellion 88.5
adult 88.3

Imagga
created on 2019-11-16

city 39.9
street 29.5
building 27.9
wheeled vehicle 26
architecture 25.9
road 24.4
skateboard 24.4
urban 22.7
sidewalk 20.6
pedestrian 20.4
vehicle 19.8
board 18.8
travel 18.3
park 18.2
tourist 18
tree 17.9
trees 17.8
intersection 17.6
sport 17.5
people 17.3
sky 16.6
buildings 16.1
outdoors 16
skate 14.7
outdoor 14.5
structure 14.4
grass 13.4
summer 12.9
landscape 12.6
day 12.6
person 12.5
conveyance 12.5
house 11.7
old 11.1
town 11.1
monument 10.3
famous 10.2
tourism 9.9
tower 9.8
history 9.8
traffic 9.5
path 9.5
center 9.4
brick 9.4
clouds 9.3
landmark 9
life 9
recreation 9
cars 8.8
area 8.8
man 8.7
sunny 8.6
fountain 8.5
cityscape 8.5
traveler 8.5
square 8.1
cloud 7.8
resort area 7.7
real 7.6
capital 7.6
walking 7.6
sign 7.5
light 7.5
exterior 7.4
world 7.1
spring 7.1
snow 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

road 99.9
outdoor 99.8
tree 99.6
footwear 98.1
clothing 97.3
person 93.5
jeans 90.7
street 87.8
man 86.2
woman 85.9
way 76.5
sky 68
people 59.6
sidewalk 54.2
city 52

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 28-44
Gender Male, 50.3%
Fear 49.5%
Disgusted 49.5%
Calm 49.7%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Sad 50.3%
Confused 49.5%

AWS Rekognition

Age 10-20
Gender Female, 50.1%
Calm 49.8%
Fear 49.5%
Sad 50%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.2%
Angry 49.5%
Calm 50%
Happy 49.5%
Sad 49.9%
Fear 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.6%

AWS Rekognition

Age 15-27
Gender Male, 50.1%
Sad 50.3%
Fear 49.5%
Disgusted 49.6%
Angry 49.6%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-40
Gender Female, 50.4%
Calm 50.2%
Surprised 49.5%
Disgusted 49.5%
Happy 49.6%
Angry 49.5%
Confused 49.5%
Sad 49.6%
Fear 49.5%

Feature analysis

Amazon

Person
Shoe
Jeans
Person 99.8%
Person 99.5%
Person 99.2%
Person 98.8%
Person 94.1%
Person 93.2%
Person 93.1%
Person 69%
Person 66.4%
Person 41.6%
Shoe 98.4%
Shoe 96.5%
Shoe 89.9%
Shoe 86.8%
Shoe 84.8%
Jeans 96.5%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-04

The image depicts a lively public park scene in an urban setting, possibly Union Square in New York City. Several people are sitting on the steps and benches, engaging in conversations and leisure activities. One woman is seen kneeling and using a video camera to film a group of people seated on the steps. The group consists of individuals casually dressed, some holding drinks and snacks. Another person is walking past in the foreground, wearing a red and black jacket. There are prominent street lamps with round globes, green leafy trees providing a canopy, and historic buildings in the background. A statue is also visible in the distance, indicating the park's public and historic nature. Additionally, there is a sign in the center that reads, "Actions Speak Louder Than Words."

Created by gpt-4 on 2024-02-06

The image depicts an urban park setting with various individuals engaged in different activities. Several people are seated on the steps, with some looking at reading materials. A person in red pants is squatting while holding a camera, possibly framing a photo. There are multiple lampposts with spherical lights, trash bins, and a statue on a pedestal surrounded by trees. In the foreground, an individual carrying a backpack is walking across the scene. A sign with the words "Actions Speak Louder Than Words" is partially visible in the background, indicating some form of event or protest may be taking place. The atmosphere suggests a lively, public space in a city with a mix of leisure and active engagement.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image shows a public square or plaza in an urban setting. There are several people sitting on the steps, some of whom appear to be engaged in conversation or activities. In the background, there are tall buildings and trees, and there are several decorative lampposts with globe-shaped lights. One person in the plaza is holding up a sign with text that is not clearly visible. The overall scene appears to depict a lively and vibrant public space within a city.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a bustling city square, with a prominent sign held by a person in the center that reads "Actions Speak Louder Than Words." The scene is set against a backdrop of trees and buildings, with people engaged in various activities such as sitting on steps, walking, and taking photographs. The overall atmosphere suggests a lively and vibrant urban environment.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-02

The image depicts a bustling city square, with a diverse group of people gathered in the foreground. The scene is set against a backdrop of trees and buildings, with a prominent statue visible in the distance. In the foreground, a group of five individuals sit on the steps, engaged in conversation. One person stands behind them, holding a sign that reads "Actions Speak Louder Than Words." To the left, a woman sits on the ground, taking a photograph with her camera. On the right, a person walks by, carrying a bag and a cup of coffee. The atmosphere appears relaxed, with people enjoying the outdoors and each other's company. The presence of the sign suggests that the group may be participating in some kind of protest or awareness campaign, but the overall mood remains peaceful and casual. In the background, the cityscape provides a vibrant and dynamic setting, with towering buildings and lush greenery creating a sense of depth and texture. The statue adds a touch of elegance and sophistication, while the people in the foreground bring a sense of humanity and connection to the scene. Overall, the image captures a moment of everyday life in the city, where people from all walks of life come together to enjoy the outdoors and each other's company.

Text analysis

Amazon

Actions
Words
Louder
Sceak Louder
Than Words
Sceak
Than
NO
rrtrerir
rrrrce

Google

FL CEE EE
FL
CEE
EE