Human Generated Data

Title

Untitled (Minneapolis)

Date

1980s

People

Artist: Gilles Peress, French born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.388

Copyright

© Gilles Peress/Magnum Photos

Human Generated Data

Title

Untitled (Minneapolis)

People

Artist: Gilles Peress, French born 1946

Date

1980s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.388

Copyright

© Gilles Peress/Magnum Photos

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.3
Person 99.3
Person 97.8
Goggles 96.8
Accessories 96.8
Accessory 96.8
Car 95.6
Vehicle 95.6
Automobile 95.6
Transportation 95.6
Car 95.5
Person 92.1
Person 92.1
Machine 91.4
Wheel 91.4
Head 88
Clothing 87.3
Apparel 87.3
Face 85.6
Person 84.7
Car 80.9
Water 78.2
Car 77.9
Photo 70.2
Photography 70.2
Portrait 70.2
Outdoors 68.8
Glasses 64.4
Female 58.7
Crowd 58.4
Costume 56.8

Clarifai
created on 2018-02-09

people 99.7
group 98
adult 97.8
vehicle 95.8
group together 95.1
man 92.9
wear 92.7
woman 91.6
portrait 90.7
one 90.4
outfit 88.3
many 86.8
street 86.7
two 86.1
music 85.9
administration 82.4
child 82.3
transportation system 81.1
leader 78.1
war 77.4

Imagga
created on 2018-02-09

mask 75.1
covering 53
armor 32.5
shield 32.1
disguise 30.5
helmet 24.3
face 24.1
war 24
military 23.2
person 20.2
attire 20.1
clothing 19.5
man 18.8
portrait 18.8
religion 17.9
soldier 17.6
culture 17.1
weapon 17.1
goggles 15.8
male 15.6
protection 15.5
people 15.1
safety 13.8
protective 13.6
statue 13.4
ancient 13
human 12.7
army 12.7
metal 12.1
old 11.8
warfare 11.8
history 11.6
gas 11.6
sky 11.5
travel 11.3
fun 11.2
church 11.1
danger 10.9
toxic 10.7
black 10.2
head 10.1
sculpture 10.1
wreckage 10
gold 9.9
temple 9.8
battle 9.8
warrior 9.8
disaster 9.8
uniform 9.7
equipment 9.7
diver 9.7
worship 9.7
antique 9.5
art 9.4
part 9.3
air 9.2
historic 9.2
tourism 9.1
square 9
costume 8.9
armed 8.8
sword 8.8
st 8.7
chemical 8.7
render 8.6
faith 8.6
aviator 8.4
monument 8.4
headdress 8.4
breastplate 8.3
architecture 8.2
respirator 8.2
suit 8.1
science 8
camouflage 7.9
day 7.8
radiation 7.8
gun 7.8
diving 7.8
education 7.8
adult 7.8
nuclear 7.8
golden 7.7
meditation 7.7
cross 7.5
historical 7.5
style 7.4
environment 7.4

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

outdoor 99.9
sky 99.9
person 98.4
people 73.8
mask 72.7
goggles 38.6
posing 36.5
spectacles 32.7
armor 28.4
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Female, 73.4%
Surprised 2.7%
Disgusted 1.2%
Confused 2.8%
Angry 2.2%
Sad 1.9%
Happy 51.6%
Calm 37.6%

AWS Rekognition

Age 57-77
Gender Female, 59.7%
Sad 7.1%
Calm 58%
Angry 5.9%
Surprised 4.2%
Confused 3.5%
Happy 19.3%
Disgusted 2%

AWS Rekognition

Age 26-43
Gender Female, 98%
Surprised 7.7%
Happy 0.5%
Disgusted 1.3%
Angry 4.9%
Confused 1.9%
Calm 79.6%
Sad 4%

AWS Rekognition

Age 35-52
Gender Female, 54.8%
Happy 45%
Surprised 45%
Disgusted 45%
Sad 54.9%
Angry 45%
Confused 45%
Calm 45%

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Car 95.6%
Wheel 91.4%
Glasses 64.4%

Captions

Azure OpenAI

Created on 2024-11-28

The image depicts a street scene with a group of individuals dressed in costumes, suggesting they may be partaking in a costume-related event or possibly a Halloween celebration. Visible costumes include a figure in a white sheet, akin to a ghost, and a person in a black outfit with a pointed hat that could be interpreted as a witch. To the left, there is a child wearing a sweatshirt that features a graphic of She-Ra, a character known from the animated television series. The setting appears to be an urban environment with cars parked along the side of the street, including vehicles that hint at the photo being taken a few decades ago due to their styles. The architecture in the background is modest, with a multi-story building that has numerous windows and a flat roof. The atmosphere of the image suggests it could be part of a public gathering or a communal event, which is reinforced by the presence of multiple people and the casual manner in which they are dressed and interacting.

Anthropic Claude

Created on 2024-11-27

The image depicts a surreal and visually striking scene. In the foreground, there appears to be a large, metal sculpture or mask with a distinctive, almost alien-like appearance. It has a rounded, reflective surface and distinctive features such as large, circular eyes. In the background, there are various people dressed in unusual, theatrical costumes and attire, including a figure wearing a hooded, black robe. The scene seems to be set in an urban environment, with buildings and cars visible in the background. The overall image has a striking, monochromatic quality, with the predominant shades being black, white, and gray. This lends the scene a sense of mystery and otherworldliness, drawing the viewer's attention to the central, sculptural element and the intriguing presence of the costumed figures.

Meta Llama

Created on 2024-11-25

The image is a black-and-white photograph of a group of people in costumes, likely taken during Halloween or another festive event. The scene is set in a parking lot, with several cars parked around the edges and a few buildings visible in the background. In the foreground, a person wearing a large, shiny silver mask with a distinctive shape and design is prominently featured. The mask appears to be a C-3PO character from the Star Wars franchise. To the left of the mask, a person is dressed in a costume with a white shirt and a headpiece that resembles a princess's crown. Another person, partially obscured by the mask, is wearing a dark-colored cloak or cape. Other people in the background are also dressed in various costumes, including a person in a white robe and another in a pointed hat. The overall atmosphere of the image suggests a fun and festive gathering, possibly a Halloween party or parade. The use of black and white photography adds a sense of nostalgia and timelessness to the scene, making it feel like a snapshot from a bygone era.