Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Human 100
Pedestrian 100
Shoe 100
Clothing 100
Footwear 100
Apparel 100
Shoe 99.9
Person 99.9
Shoe 99.8
Person 99.8
Person 99.8
Person 99.7
Denim 99.7
Jeans 99.7
Pants 99.7
Shoe 99.6
Person 99.6
Person 99.5
Person 99.1
Person 99
Person 98.8
Shoe 98.4
Person 98.2
Shoe 98.2
Shoe 96.1
Shoe 95.5
Jeans 94.5
Coat 86.9
Shoe 83.7
Overcoat 81.8
Jacket 74.6
Walking 74.2
Person 73.1
People 70.3
Crowd 69
Shoe 68.6
Person 67.6
Urban 67.3
Path 62.4
Paper 62.1
Building 61.6
Town 61.6
City 61.6
Road 59.7
Flyer 59
Brochure 59
Poster 59
Advertisement 59
Downtown 58.9
Person 53.8

Clarifai
created on 2019-05-30

people 99
many 96.7
group 96.6
woman 95.6
city 95.3
crowd 94.9
street 93.4
man 92.1
battle 91.4
drag race 91.1
adult 90.7
offense 89.9
rally 89.4
education 89.3
road 88
election 87
business 87
police 86.1
commerce 84
school 83.5

Imagga
created on 2019-05-30

skate 100
pedestrian 39.2
tourist 36.2
people 35.2
person 28.5
city 28.3
man 27.6
traveler 26.3
street 23
male 22
business 21.3
group 20.2
happy 19.4
building 19.3
walking 18.9
outdoor 17.6
outside 16.3
walk 16.2
smiling 15.9
standing 14.8
corporate 13.7
men 13.7
smile 13.5
women 13.4
outdoors 13.4
architecture 13.3
businessman 13.2
portrait 12.9
professional 12.8
adult 12.4
travel 12
attractive 11.9
tree 11.5
office 11.2
pretty 11.2
university 10.7
job 10.6
together 10.5
urban 10.5
motion 10.3
girls 10
team 9.9
family 9.8
student 9.8
success 9.7
boy 9.6
work 9.4
winter 9.4
school 9.3
mother 9.3
children 9.1
road 9
college 8.7
couple 8.7
education 8.7
crowd 8.6
day 8.6
cold 8.6
season 8.6
youth 8.5
buildings 8.5
casual 8.5
active 8.4
snow 8.4
action 8.4
executive 8.3
successful 8.2
suit 8.1
worker 8
lifestyle 8
black 7.8
sidewalk 7.6
meeting 7.5
life 7.4
cheerful 7.3
businesswoman 7.3
exercise 7.3
square 7.2
stylish 7.2
looking 7.2
cute 7.2
to 7.1
summer 7.1
happiness 7.1

Google
created on 2019-05-30

People 93.4
Pedestrian 87.4
Crowd 75
Event 74.8
Walking 72.9
City 67.4
Tourism 66.2
Street 61.7
Jeans 56.2

Microsoft
created on 2019-05-30

clothing 99.3
person 99
jeans 98.9
footwear 97.3
man 94.8
woman 94.1
city 87.5
skyscraper 87.2
jacket 83.7
way 80.8
trousers 78
building 65.9
people 65.3
group 56.9
smile 51.2
road 43
sidewalk 42.9
street 41
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Disgusted 45%
Happy 45%
Sad 48.6%
Calm 51%
Angry 45.2%
Surprised 45%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Female, 55%
Disgusted 45.1%
Calm 48.7%
Sad 50.2%
Surprised 45.2%
Angry 45.2%
Happy 45.5%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Sad 45.4%
Happy 45.4%
Angry 45.2%
Surprised 45.1%
Calm 53.5%
Disgusted 45.3%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 52.4%
Disgusted 45%
Calm 46.2%
Sad 53.5%
Confused 45%
Angry 45.1%
Happy 45.1%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Female, 55%
Confused 45.2%
Sad 52.9%
Calm 45.9%
Surprised 45.1%
Disgusted 45.1%
Angry 45.1%
Happy 45.6%

AWS Rekognition

Age 20-38
Gender Female, 55%
Confused 45.2%
Disgusted 51.5%
Angry 45.4%
Happy 45.4%
Calm 46.2%
Sad 46.1%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Disgusted 45.3%
Sad 51.6%
Confused 45.4%
Calm 46.7%
Happy 45.4%
Angry 45.4%
Surprised 45.3%

AWS Rekognition

Age 29-45
Gender Male, 50.5%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.6%
Calm 49.7%
Sad 50.2%

AWS Rekognition

Age 16-27
Gender Female, 50.3%
Happy 49.6%
Disgusted 49.5%
Surprised 49.6%
Calm 49.7%
Angry 49.6%
Confused 49.5%
Sad 50%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Angry 49.5%
Happy 49.5%
Disgusted 49.8%
Sad 49.5%
Surprised 49.5%
Calm 50.1%
Confused 49.5%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Calm 49.6%
Sad 49.7%
Angry 49.7%
Confused 49.6%
Disgusted 49.6%
Surprised 49.6%
Happy 49.7%

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe
Person
Jeans
Shoe 100%
Shoe 99.9%
Shoe 99.8%
Shoe 99.6%
Shoe 98.4%
Shoe 98.2%
Shoe 96.1%
Shoe 95.5%
Shoe 83.7%
Shoe 68.6%
Person 99.9%
Person 99.8%
Person 99.8%
Person 99.7%
Person 99.6%
Person 99.5%
Person 99.1%
Person 99%
Person 98.8%
Person 98.2%
Person 73.1%
Person 67.6%
Person 53.8%
Jeans 99.7%
Jeans 94.5%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-02-06

This image shows a busy urban sidewalk bustling with pedestrians. Various individuals appear to be going about their day, donning casual to business casual attire suitable for a day in the city. In the background, there are tall buildings that give the impression of a downtown district in a metropolitan area. Visible signs and banners hint at some form of event or protest perhaps taking place nearby. The setting suggests a lively, active environment typical of a city's pace.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image shows a busy urban street scene in New York City. There are a number of people walking on the sidewalk, some carrying bags or wearing coats and jackets. In the background, there are tall buildings and storefronts. One person is carrying a sign that says "Stolen Election". The overall scene conveys a sense of activity and movement in the city.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a bustling city street scene, with a diverse group of people walking in various directions. The street is lined with tall buildings and trees, creating a vibrant urban atmosphere. In the foreground, a woman wearing a white jacket and carrying a baby in her arms walks towards the camera, while another woman in a black jacket and jeans walks away from the camera. A man in a brown jacket and jeans stands to the left, looking at something on the ground. Behind them, a group of people are gathered near a street corner, some looking at their phones or talking to each other. A few individuals are holding signs, including one that reads "A STOLEN ELECTION COULD SPARK A MASS REBELLION." The signs suggest that there may be some kind of protest or demonstration taking place in the area. Overall, the image captures the energy and diversity of city life, with people from all walks of life going about their daily business amidst the hustle and bustle of the urban environment.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-02

The image depicts a bustling city street, with a diverse group of people walking along the sidewalk. The scene is set against a backdrop of tall buildings and trees, with a mix of pedestrians, including men, women, and children, all going about their daily business. In the foreground, a woman wearing a white jacket and blue jeans is prominently featured, while a man in a black jacket and blue jeans walks alongside her. Further back, a group of people can be seen, including a man holding a sign that reads "A STOLEN ELECTION COULD SPARK A MASS REBELLION." The overall atmosphere of the image is one of activity and movement, with people from all walks of life going about their daily routines. The presence of the sign and the diverse group of people suggests that the image may be related to a social or political issue, but without more context, it is difficult to say for certain.

Text analysis

Amazon

ELECTION
COULD
COULD SPARK
SPARK
YORK
REBELLION
ITOLEN ELECTION
EW YORK
ITOLEN
AMASS
EW
AAS
Ernn

Google

STOLEN ELECTION COULD SPARK A MASS REBELLION
STOLEN
ELECTION
COULD
SPARK
A
MASS
REBELLION