Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.9
Person 99.9
Person 99.8
Person 99.8
Apparel 99.8
Footwear 99.8
Clothing 99.8
Shoe 99.8
Pants 99.8
Jeans 99.8
Denim 99.8
Pedestrian 99.6
Person 99.6
Person 99.6
Person 99.4
Person 99.2
Person 99.1
Person 98.1
Person 96.7
Text 91.2
Crowd 88.6
Shoe 88.3
Town 79.6
Urban 79.6
City 79.6
Building 79.6
Person 73.9
Downtown 73.6
Shoe 68.7
Coat 68.4
Parade 68.2
Road 67.9
Street 67.9
Person 65.8
Overcoat 63.8
Advertisement 61.7
Banner 58.6
People 56.4
Poster 55.9

Clarifai
created on 2019-11-16

people 98.9
police 98.5
many 98
crowd 97.9
drag race 97.7
battle 97.5
group 97.3
offense 96.6
street 96.3
city 96
road 96
rally 94.4
election 92.6
rebellion 90.9
picket 90.8
man 89.7
action 89.6
force 88.8
competition 87.8
sports fan 87

Imagga
created on 2019-11-16

stage 26.4
pedestrian 26
city 25.8
signboard 24.7
billboard 23.7
building 22.1
people 21.2
platform 19
structure 18.8
street 18.4
urban 18.3
business 18.2
man 18.1
sky 17.8
architecture 17.3
male 17
person 16.8
road 16.2
travel 14.1
office 13.6
adult 13.1
men 12
transportation 11.6
tourist 11.5
businessman 11.5
outdoor 11.5
traffic 11.4
work 10.2
modern 9.8
sign 9.8
new 9.7
truck 9.7
crowd 9.6
cityscape 9.5
outside 9.4
board 9.3
car 9.2
center 9.2
day 8.6
university 8.6
buildings 8.5
vehicle 8.5
casual 8.5
old 8.4
outdoors 8.3
transport 8.2
vacation 8.2
technology 8.2
spectator 8.1
computer 8.1
looking 8
to 8
job 8
scoreboard 7.7
industry 7.7
walk 7.6
walking 7.6
lights 7.4
equipment 7.4
water 7.3
lake 7.3
industrial 7.3
group 7.2
lifestyle 7.2

Google
created on 2019-11-16

Pedestrian 87.2
Crowd 84.3
Event 79.2
Metropolitan area 69.1
City 59.6
Advertising 58.1
Street 57.4

Microsoft
created on 2019-11-16

outdoor 99.1
person 98.8
clothing 96.3
man 94
text 93.5
people 90.5
street 83.1
footwear 80.7
city 79.8
jeans 74.3
group 66
woman 53
crowd 1.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 54.8%
Sad 45.4%
Disgusted 45.1%
Confused 45.1%
Surprised 45%
Happy 45%
Fear 45%
Angry 45.2%
Calm 54.1%

AWS Rekognition

Age 35-51
Gender Male, 50.9%
Calm 45.3%
Fear 45.5%
Happy 52.6%
Angry 45.9%
Surprised 45.2%
Disgusted 45.2%
Sad 45.2%
Confused 45.1%

AWS Rekognition

Age 15-27
Gender Male, 53.2%
Calm 48.2%
Disgusted 45.1%
Happy 45%
Fear 45.1%
Surprised 45%
Sad 51.1%
Confused 45.2%
Angry 45.3%

AWS Rekognition

Age 28-44
Gender Male, 51.7%
Fear 45.2%
Calm 47.2%
Disgusted 45%
Happy 45%
Sad 52.4%
Confused 45.1%
Surprised 45.1%
Angry 45.1%

AWS Rekognition

Age 46-64
Gender Male, 50%
Sad 49.9%
Happy 49.6%
Fear 49.5%
Calm 49.8%
Angry 49.5%
Disgusted 49.6%
Confused 49.6%
Surprised 49.5%

AWS Rekognition

Age 20-32
Gender Female, 50.1%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Sad 50%
Disgusted 49.5%
Angry 50%
Calm 49.5%
Fear 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Fear 49.6%
Surprised 49.6%
Angry 49.5%
Calm 50%
Sad 49.7%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.4%
Happy 49.5%
Angry 49.5%
Fear 49.5%
Surprised 49.6%
Calm 49.9%
Sad 49.5%
Disgusted 49.5%
Confused 49.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Jeans
Person 99.9%
Person 99.8%
Person 99.8%
Person 99.6%
Person 99.6%
Person 99.4%
Person 99.2%
Person 99.1%
Person 98.1%
Person 96.7%
Person 73.9%
Person 65.8%
Shoe 99.8%
Shoe 88.3%
Shoe 68.7%
Jeans 99.8%

Captions

OpenAI GPT

Created by gpt-4 on 2024-02-06

The image depicts an outdoor setting with multiple individuals engaged in various activities. A sizable globe sculpture is installed atop a pedestal in the background, indicating a public square or similar urban space. The foreground shows people walking in different directions, some closely observing their surroundings. Metal barriers and a stage with a sign that reads "Continental Airlines New York City Marathon" suggest preparations for a public event. A sign being held up by an individual draws attention to a politicized message, adding a dimension of activism or protest to the scene. The overall atmosphere appears bustling and lively, typical of an urban environment preparing for a significant public gathering.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image shows a group of protesters gathered in an urban setting, likely in New York City. There is a person in the center of the image holding a sign that reads "Who Approved THE WAR - Vietnam?". The protesters appear to be demonstrating against the Vietnam War, with some people wearing red shirts and others gathered around. The scene captures a moment of public dissent and political activism taking place in a busy city environment.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a crowd of people gathered in a city street, with a prominent sign held by a man in the foreground. The sign reads "Who Approved THE WAR in -Vietnam??". The man is dressed in a dark blue shirt and jeans, while another individual beside him wears a red shirt and blue jacket. In the background, a stage is set up, featuring a blue banner that reads "Continental Airlines" in white letters. A large screen is positioned on the right side of the stage, and a metal barricade separates the stage from the crowd. The atmosphere appears to be one of protest or demonstration, with the sign and stage suggesting a public event or rally.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-02

The image depicts a protest scene in New York City, with a crowd of people gathered in front of a stage. The stage features a blue banner with the Continental Airlines logo and the words "Continental Airlines" in white text, accompanied by a smaller white banner below it that reads "New York City Marathon." In the foreground, a man stands out holding a sign that reads "Who Approved THE WAR IN - VIETNAM??" in blue handwriting. He is dressed in a dark blue shirt and jeans, with his arms raised above his head. To his right, another man stands with his hands raised, wearing a red shirt and a blue jacket tied around his waist. The background of the image shows a bustling city street with tall buildings and a green sign that reads "CENTRAL PARK WEST" in white letters. The overall atmosphere of the image suggests a sense of protest and activism, with the crowd of people gathered in front of the stage and the man holding the sign drawing attention to the issue of the Vietnam War.

Text analysis

Amazon

CENTRAL
PARK
PARK WEST
Airlines
Continental
WEST
WAR
THE
Marathon
THE WAR ork City Marathon
City
INGA
ork
Who
56t
Approued
INGA 2aN Airlines 56t
Viow?1
ISDO IT.
NUKE
2aN

Google

CENTRAL PARK WEST Continental Airlines ING ZAZSAYZA Who Apmrovd THE WAR -Vinwe ork City Marathon ST DO IT
CENTRAL
PARK
WEST
Continental
Airlines
ING
ZAZSAYZA
Who
Apmrovd
THE
WAR
-Vinwe
ork
City
Marathon
ST
DO
IT