Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.9
Pedestrian 99.9
Road 99.9
Tarmac 99.9
Asphalt 99.9
Person 99.9
Person 99.8
Person 99.8
Person 99.8
Footwear 99.8
Apparel 99.8
Clothing 99.8
Shoe 99.8
Person 99.8
Person 99.7
Person 99.7
Person 99.7
Person 99.6
Person 99.6
Shoe 99.5
Shoe 99.3
Denim 98.7
Jeans 98.7
Pants 98.7
Shoe 97.7
Shoe 97.6
Shoe 97
Zebra Crossing 95.1
Shoe 86.2
Person 84.9
Automobile 84.4
Car 84.4
Vehicle 84.4
Transportation 84.4
Path 84.2
City 75.8
Building 75.8
Urban 75.8
Town 75.8
Metropolis 75.8
Car 73.3
Machine 72.9
Wheel 72.9
Street 61.6
Text 57.5
Sidewalk 56.2
Pavement 56.2
Neighborhood 56
People 55.1

Clarifai
created on 2019-11-16

street 99.1
road 97.9
city 97.4
drag race 96.7
police 95.6
people 95.3
rally 95
battle 94.6
pavement 93.4
offense 93.2
picket 92.7
crowd 92.1
many 90.8
group 89.6
shopping 88.6
woman 88
commerce 86.5
motion 86.3
austerity 86.2
man 85.7

Imagga
created on 2019-11-16

pedestrian 78.6
sidewalk 38.2
people 31.8
city 31.6
street 30.4
man 28.9
person 28.3
building 25.5
outdoor 24.5
tourist 24.4
business 23.7
male 22
attractive 21
urban 21
adult 19.4
happy 18.8
corporate 18.1
men 18
job 17.7
businessman 16.8
outside 16.3
walking 16.1
pretty 16.1
traveler 15.8
architecture 15.1
college 15
university 14.5
professional 14.4
suit 14.4
women 14.2
work 14.1
success 13.7
businesswoman 13.6
office 13.3
smile 12.8
worker 12.6
executive 12.2
group 12.1
black 12
travel 12
lifestyle 11.6
casual 11
successful 11
road 10.8
walk 10.5
standing 10.4
portrait 10.4
day 10.2
town 10.2
outdoors 10
life 9.9
student 9.7
bag 9.7
buildings 9.5
smiling 9.4
fashion 9.1
team 9
electrical device 8.8
looking 8.8
education 8.7
cute 8.6
career 8.5
two 8.5
tree 8.5
manager 8.4
company 8.4
summer 8.4
holding 8.3
occupation 8.3
school 8.3
couple 7.8
face 7.8
talking 7.6
device 7.4
lady 7.3
confident 7.3
handsome 7.1

Google
created on 2019-11-16

Pedestrian 93.7
Snapshot 86.7
Street 86.3
Walking 67.9
Photography 67.8
Event 67
City 65.9
Road 52.7
Crowd 50.7

Microsoft
created on 2019-11-16

clothing 99.2
person 98.2
footwear 97.7
road 95.5
woman 95.3
outdoor 95
man 93.4
jeans 92.7
street 91.6
text 87.2
people 75.1
walking 75
trousers 74.4
presentation 65.3
jacket 65.1
pedestrian 63.3
city 58.1
coat 50.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 55%
Disgusted 45%
Happy 45%
Angry 45%
Fear 45%
Calm 55%
Confused 45%
Surprised 45%
Sad 45%

AWS Rekognition

Age 22-34
Gender Female, 50.1%
Fear 48.3%
Sad 48.6%
Confused 45.1%
Angry 45.7%
Happy 45%
Calm 47.2%
Surprised 45.2%
Disgusted 45%

AWS Rekognition

Age 9-19
Gender Female, 50%
Calm 49.6%
Sad 49.7%
Happy 49.5%
Angry 49.6%
Fear 49.9%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 23-35
Gender Female, 50%
Sad 49.6%
Calm 49.6%
Happy 49.6%
Surprised 49.7%
Disgusted 49.5%
Confused 49.5%
Angry 49.8%
Fear 49.6%

AWS Rekognition

Age 15-27
Gender Male, 50.2%
Disgusted 49.5%
Fear 49.5%
Surprised 49.5%
Angry 50.2%
Calm 49.6%
Happy 49.5%
Confused 49.5%
Sad 49.7%

AWS Rekognition

Age 1-7
Gender Male, 50.5%
Calm 50.2%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Sad 49.7%

AWS Rekognition

Age 19-31
Gender Female, 54.1%
Happy 45.7%
Surprised 45.5%
Fear 45.6%
Calm 46%
Angry 48.9%
Sad 46.9%
Confused 45.4%
Disgusted 46.1%

AWS Rekognition

Age 18-30
Gender Female, 50.4%
Sad 49.6%
Disgusted 49.5%
Fear 49.5%
Angry 50.2%
Happy 49.6%
Surprised 49.5%
Calm 49.6%
Confused 49.5%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Jeans
Car
Wheel
Person 99.9%
Person 99.8%
Person 99.8%
Person 99.8%
Person 99.8%
Person 99.7%
Person 99.7%
Person 99.7%
Person 99.6%
Person 99.6%
Person 84.9%
Shoe 99.8%
Shoe 99.5%
Shoe 99.3%
Shoe 97.7%
Shoe 97.6%
Shoe 97%
Shoe 86.2%
Jeans 98.7%
Car 84.4%
Car 73.3%
Wheel 72.9%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-02-06

The image depicts a busy urban street scene filled with people walking in various directions. A prominent street sign indicates the intersection at "Broadway". The environment has features of a bustling city, such as a variety of buildings, including business storefronts and signs, traffic lights, and a green street lamp post. It appears to be a bright, sunlit day. People are dressed in casual to professional attire, suggesting it might be a typical weekday in an urban center.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image depicts a busy city street scene in New York City. There are several people visible on the sidewalk, including a person holding a sign that says "NOTHING WILL BE AS BEFORE". The sign appears to be part of a protest or demonstration taking place on the street. In the background, there are various buildings, storefronts, and street signs, including one that says "Broadway". The overall scene conveys a sense of urban activity and a moment of social or political significance.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a man holding a sign in the middle of a city street, with the sign reading "NOTHING WILL BE AS BEFORE" in black letters on a light blue background. The man is dressed in dark clothing and has short, curly hair. He stands on a sidewalk, surrounded by other pedestrians walking in various directions. In the background, several buildings are visible, including one with a sign that reads "Broadway." A few cars can be seen driving down the street, and a traffic light hangs above the intersection. The overall atmosphere of the image suggests a busy urban setting, with people going about their daily lives amidst the hustle and bustle of the city.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-02

The image depicts a man holding a sign in the middle of a busy city street, surrounded by pedestrians and vehicles. * The man is standing in the center of the image, holding a light blue sign with black and red writing that reads "NOTHING WILL BE AS BEFORE." He is wearing a dark jacket, jeans, and a black scarf, and has short brown hair. * The background of the image shows a busy city street with several buildings, including a bank and a restaurant. There are many people walking on the sidewalk, some of whom are looking at the man with the sign. A few cars are driving down the street, and a traffic light can be seen in the distance. * The overall atmosphere of the image is one of chaos and disarray, with the man's sign suggesting that something significant has changed or is about to change. The busy street and crowded sidewalk add to the sense of energy and activity in the image. In summary, the image shows a man holding a sign in the middle of a busy city street, surrounded by pedestrians and vehicles. The sign reads "NOTHING WILL BE AS BEFORE," suggesting that something significant has changed or is about to change. The background of the image shows a busy city street with several buildings, including a bank and a restaurant, and many people walking on the sidewalk. The overall atmosphere of the image is one of chaos and disarray.

Text analysis

Amazon

Mutual
BEFORE
AS BEFORE
AS
BE
Dn Mutual
NOTHING
WILL BE
Breadway
Dn
WILL

Google

Breadway on Mutual NOTHING WILL BE ILEAN AS BEFORE
Breadway
on
Mutual
WILL
NOTHING
BE
ILEAN
AS
BEFORE