Human Generated Data

Title

In the Near Future, New York

Date

2005

People

Artist: Sharon Hayes, American born 1970

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Human Generated Data

Title

In the Near Future, New York

People

Artist: Sharon Hayes, American born 1970

Date

2005

Classification

Audiovisual Works

Credit Line

Harvard Art Museums/Fogg Museum, The Jorie Marshall Waterman '96 and Gwendolyn Dunaway Waterman '92 Fund, 2009.50

Copyright

© Sharon Hayes

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.7
Person 99.7
Person 99.6
Apparel 99.6
Clothing 99.6
Pants 99.6
Person 99.4
Jeans 99.2
Denim 99.2
Footwear 98.9
Shoe 98.9
Text 95.6
Shoe 95.3
Shoe 94.9
Shoe 94.8
Shoe 93.2
Shoe 79.8
Floor 71.8
Flooring 68.7
Banner 67.3
Crowd 57.4

Clarifai
created on 2019-11-16

people 98.2
administration 95.8
education 94.5
election 94.4
adult 94.4
offense 94.4
business 93.8
city 92.9
man 92.6
street 90.7
leader 90.6
building 90.3
drag race 87.1
one 86.8
religion 86.7
banking 86.3
parliament 86.2
crisis 86.2
battle 85.4
rally 85

Imagga
created on 2019-11-16

skate 56.7
man 32.3
people 30.2
male 28.5
street 25.8
city 25.8
person 25.5
sidewalk 24.4
business 23.1
outdoor 19.9
urban 19.2
building 19.1
adult 18.3
corporate 18.1
men 18.1
job 16.8
walking 16.1
architecture 15.9
happy 15.7
work 14.9
pedestrian 14.8
suit 14.8
attractive 14.7
worker 14.2
businessman 14.1
standing 13.1
smile 12.8
outdoors 12.7
pretty 12.6
walk 12.4
fashion 12.1
outside 12
skateboard 11.9
portrait 11.7
college 11.4
student 11.4
office 10.9
one 10.5
black 10.4
stick 10.3
women 10.3
youth 10.2
tourist 10.2
lifestyle 10.1
wheeled vehicle 9.8
bag 9.8
professional 9.7
success 9.7
looking 9.6
boy 9.6
guy 9.5
life 9.4
cute 9.3
alone 9.1
crutch 9.1
human 9
university 8.7
day 8.6
travel 8.5
company 8.4
holding 8.3
handsome 8
board 8
smiling 8
face 7.8
vehicle 7.8
modern 7.7
industry 7.7
expression 7.7
casual 7.6
fashionable 7.6
leisure 7.5
occupation 7.3
successful 7.3
lady 7.3
teenager 7.3
businesswoman 7.3
square 7.2
road 7.2
working 7.1
staff 7.1

Google
created on 2019-11-16

Standing 86.6
Pedestrian 55.5

Microsoft
created on 2019-11-16

ground 98.6
jeans 97.8
clothing 97.4
person 94.4
street 94
footwear 89.7
jacket 88.8
trousers 86
outdoor 85.8
handwriting 75.8
woman 70.8
coat 54.9
cement 15.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-31
Gender Male, 50.1%
Calm 45%
Surprised 45%
Happy 45%
Sad 54.9%
Confused 45%
Angry 45%
Fear 45%
Disgusted 45%

AWS Rekognition

Age 35-51
Gender Male, 50.4%
Happy 49.5%
Fear 49.5%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%
Calm 50.3%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person
Jeans
Shoe
Person 99.7%
Person 99.6%
Person 99.4%
Jeans 99.2%
Shoe 98.9%
Shoe 95.3%
Shoe 94.9%
Shoe 94.8%
Shoe 93.2%
Shoe 79.8%

Captions

OpenAI GPT

Created by gpt-4 on 2024-02-07

This image depicts an individual holding a large white sign with bold text that reads "Ratify E.R.A. NOW!" which indicates a call to action for the ratification of the Equal Rights Amendment. They are standing in front of a building with a classical architectural style, featuring stone walls and steps leading up to a dark wooden door framed by ornate stonework and a tall window. Two other individuals are present on the right side of the frame, seemingly engaged in their own activities, one glancing at a mobile device and the other facing away from the camera. The setting appears to be public, possibly an urban environment given the pavement in the foreground and the architectural elements. The time of day could be inferred as daylight due to the natural lighting in the scene.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-30

The image shows a person holding a sign that says "Ratify ERA NOW!" in front of a government building with ornate doors. Two other people are visible in the background, standing on the steps of the building. The image appears to be capturing a political protest or demonstration related to the Equal Rights Amendment (ERA).

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a woman holding a sign that reads "Ratify E.R.A. NOW!" in front of a building with a large set of doors. The woman is wearing blue jeans and a blue shirt, and her sign is white with brown text. In the background, there are two men standing on the sidewalk, one wearing a black jacket and the other wearing a suit. The building behind them has a large set of doors with a decorative design, and there are steps leading up to the entrance. The overall atmosphere of the image suggests that the woman is protesting or advocating for the ratification of the Equal Rights Amendment (ERA).

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-02

The image depicts a woman holding a sign that reads "Ratify E.R.A. NOW!" in front of a building with a large entrance and steps. The woman is standing on the left side of the image, facing the camera. She has short, curly brown hair and is wearing blue jeans, a blue shirt, and blue shoes. She is holding a white sign with black letters that reads "Ratify E.R.A. NOW!" in all capital letters. The sign is rectangular and appears to be made of cardboard or a similar material. Behind the woman, there is a large building with a stone facade. The building has a large entrance with two sets of double doors, each with a large window above it. The doors are made of dark wood and have ornate metalwork details. There are also several windows on either side of the entrance, as well as a set of steps leading up to the doors. To the right of the entrance, there are three people standing on the sidewalk. One person is wearing a black jacket and blue jeans, while the other two are wearing dark-colored jackets and light-colored pants. They appear to be waiting for someone or something. Overall, the image suggests that the woman is protesting or advocating for something related to the Equal Rights Amendment (ERA), which is a proposed amendment to the United States Constitution that would guarantee equal rights for women. The presence of the other people in the background adds context to the scene, suggesting that the protest or advocacy effort may be part of a larger movement or event.

Text analysis

Amazon

Ratify
NOW!
E.R.A. NOW!
E.R.A.

Google

344-3200 on Ratify E.R.A NOW!
344-3200
on
Ratify
E.R.A
NOW!