Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4612

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4612

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 97
Human 97
Person 91.9
Person 89.4
Interior Design 85.3
Indoors 85.3
Person 83.1
Person 78.6
Monitor 78
Electronics 78
Screen 78
Display 78
Person 68
Head 59.7

Clarifai
created on 2023-10-25

movie 96.6
negative 94.7
people 94.4
art 94.2
screen 93.7
slide 93.3
filmstrip 91.1
picture frame 90.7
no person 89.6
retro 89.6
analogue 89.5
vintage 88.2
old 87.9
technology 86.7
display 83.2
rust 82.6
margin 82.3
industry 81.4
dirty 81.2
desktop 80.9

Imagga
created on 2022-01-08

equipment 90.1
electronic equipment 71.9
sequencer 45.6
apparatus 37.3
amplifier 35.9
technology 25.9
monitor 21.6
equalizer 21.6
digital 20.2
computer 19.3
mixer 18.4
sound 15
close 14.8
black 14.4
business 14
music 13.5
audio 13.4
media 13.3
button 13.2
electronic 13
network 13
system 12.4
modern 11.9
connection 11.9
communication 11.7
screen 11.5
electronics 11.4
data 10.9
closeup 10.8
design 10.7
information 10.6
electrical 10.5
object 10.2
display 10.2
entertainment 10.1
speed 10.1
loudspeaker 10
film 10
retro 9.8
panel 9.6
space 9.3
television 9.3
power 9.2
vintage 9.1
receiver 9.1
old 9
stereo 8.9
record 8.7
video 8.7
finance 8.4
electric 8.4
global 8.2
switch 7.8
device 7.8
3d 7.7
radio receiver 7.7
money 7.6
web 7.6
hand 7.6
tech 7.6
electricity 7.5
radio 7.4
template 7.3
room 7.3
art 7.1
science 7.1
silver 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 99.2
screenshot 97.2
old 57.4
electronics 53.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 0-3
Gender Female, 99.4%
Fear 35.6%
Surprised 31.1%
Angry 11.6%
Calm 10.7%
Disgusted 3.8%
Happy 2.9%
Sad 2.9%
Confused 1.3%

AWS Rekognition

Age 0-6
Gender Male, 79.2%
Calm 74.2%
Happy 20.1%
Surprised 1.3%
Sad 1.2%
Disgusted 1%
Angry 0.9%
Fear 0.7%
Confused 0.5%

AWS Rekognition

Age 0-4
Gender Female, 50.6%
Happy 72.7%
Surprised 16.1%
Fear 4.1%
Sad 3.5%
Calm 1.7%
Confused 0.7%
Angry 0.6%
Disgusted 0.6%

AWS Rekognition

Age 0-3
Gender Female, 53.2%
Surprised 50.7%
Fear 46.1%
Disgusted 0.9%
Confused 0.9%
Calm 0.5%
Sad 0.4%
Angry 0.3%
Happy 0.3%

AWS Rekognition

Age 0-3
Gender Female, 96.1%
Fear 92.2%
Calm 4.9%
Surprised 0.8%
Happy 0.8%
Sad 0.5%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 1-7
Gender Female, 90.5%
Sad 66.6%
Calm 12.6%
Angry 9%
Surprised 5.9%
Happy 2.4%
Disgusted 1.8%
Fear 1.4%
Confused 0.3%

AWS Rekognition

Age 0-4
Gender Female, 98.4%
Calm 49.4%
Happy 43.6%
Surprised 2.4%
Fear 1.4%
Angry 1.1%
Sad 1%
Disgusted 0.8%
Confused 0.3%

AWS Rekognition

Age 43-51
Gender Male, 90.1%
Calm 99.1%
Happy 0.4%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Female, 99.2%
Calm 92.8%
Surprised 3.8%
Happy 1.1%
Sad 0.9%
Disgusted 0.5%
Angry 0.5%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 2-10
Gender Female, 98.1%
Calm 91.5%
Sad 3.4%
Disgusted 1.4%
Happy 1%
Angry 0.8%
Surprised 0.7%
Fear 0.7%
Confused 0.4%

AWS Rekognition

Age 0-3
Gender Female, 100%
Calm 90%
Surprised 6%
Disgusted 1.1%
Happy 0.8%
Sad 0.7%
Angry 0.6%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 10-18
Gender Female, 100%
Fear 44%
Calm 18.5%
Surprised 14%
Happy 12.3%
Disgusted 5.2%
Confused 2.2%
Angry 2.2%
Sad 1.6%

AWS Rekognition

Age 4-10
Gender Female, 100%
Fear 99.5%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%
Calm 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Fear 90.1%
Sad 3.8%
Happy 2.1%
Confused 1.2%
Surprised 1%
Calm 0.9%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 2-10
Gender Female, 100%
Happy 43.2%
Sad 18.6%
Surprised 9.1%
Calm 7.9%
Fear 7.2%
Disgusted 6%
Angry 5.9%
Confused 2.1%

AWS Rekognition

Age 6-12
Gender Female, 99.5%
Surprised 99.7%
Fear 0.2%
Calm 0.1%
Angry 0%
Sad 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 4-12
Gender Female, 98%
Surprised 71.1%
Calm 16.9%
Fear 5.9%
Happy 1.6%
Disgusted 1.4%
Angry 1.3%
Confused 1%
Sad 0.8%

AWS Rekognition

Age 0-4
Gender Male, 96.3%
Surprised 39.1%
Calm 20.8%
Fear 15.9%
Happy 8.2%
Confused 7.1%
Sad 6.8%
Disgusted 1.1%
Angry 1%

AWS Rekognition

Age 0-4
Gender Female, 100%
Fear 85.8%
Surprised 11.5%
Happy 1.2%
Sad 0.5%
Angry 0.3%
Calm 0.3%
Disgusted 0.2%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Monitor
Person 97%
Person 91.9%
Person 89.4%
Person 83.1%
Person 78.6%
Person 68%
Monitor 78%

Categories

Captions

Microsoft
created by unknown on 2022-01-08

an old photo of a person 41.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people standing around a group of stuffed animals -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black and white film strip featuring a photograph of a group of dolls and stuffed animals.

  • The film strip is divided into two rows, with the top row containing 20 frames and the bottom row containing 20 frames.
    • The top row has the number "20" printed in white at the top center of each frame.
    • The bottom row has the number "20" printed in white at the bottom center of each frame.
  • The photograph shows a group of dolls and stuffed animals sitting on a shelf or table.
    • The dolls are all dressed in old-fashioned clothing and hats, and they appear to be from different time periods.
    • There are also several stuffed animals, including a teddy bear, a rabbit, and a monkey, scattered throughout the group.
  • The background of the photograph is dark and blurry, but it appears to be a room with a window or door.
    • The overall atmosphere of the photograph is one of nostalgia and curiosity, as if the viewer is being invited to explore a forgotten world.

The image is a unique and fascinating glimpse into the past, offering a glimpse into the lives of people who lived in a different time and place.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a collection of dolls, with the photo itself appearing on a strip of film. The dolls are arranged in rows, showcasing their diverse appearances and attire. Some dolls wear hats, while others are dressed in various outfits. Notably, there are also stuffed animals present among the dolls.

The film strip features numbers at the top and bottom, indicating the frame number. The top number reads "20," while the bottom number is partially obscured but appears to be "20" as well. Additionally, the words "SUPER XX" are visible at the bottom left of the film strip.

The background of the image is a plain white surface, which provides a clean and neutral backdrop for the photograph. Overall, the image presents a charming and nostalgic scene, capturing a moment in time when these dolls were carefully arranged and photographed.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of a group of dolls and teddy bears sitting on a bench. The dolls are dressed in different outfits, and some of them are wearing hats. The teddy bears are sitting in the middle of the dolls. The image is taken from a low angle, and the dolls and teddy bears are in focus. The image has a film strip-like border with the text "SUPER XX" and "20" on it.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photograph of a group of dolls. The dolls are arranged in rows, with some sitting and others standing. They are dressed in various outfits, including dresses, hats, and shoes. The dolls have different facial expressions and hair styles. The photograph has a vintage look, with a grainy texture and a slightly blurred background. The image is framed with a black border and has a label that reads "SUPER XX 20".

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

This is a black and white photograph, appearing to be a print made from a film negative, as the edges show the sprocket holes of the film. The subject of the photograph appears to be a collection of dolls and stuffed animals. They are arranged on what looks like several shelves or steps, in a shop or display.

There are many dolls of different sizes, most appear to have hats or bonnets. A couple of stuffed animals are visible, one looks like a dog and the other a horse or pony. A person is seen on the right side of the photo. The film edge says "SUPER XX" and the number "20" is also visible.

Created by gemini-2.0-flash on 2025-05-16

The black and white image is a photograph of a film strip featuring a collection of dolls and stuffed animals. The film strip has perforations along the top and bottom edges, and the words "SUPER XX" are printed on the bottom. The photograph appears to be a close-up of a section of a film roll. The number "20" is printed in white on both the top and bottom edges of the film strip, presumably indicating frame numbers.

The image within the film strip shows several rows of dolls with various outfits, including dresses and hats. There are also some stuffed animals, such as a dog and horses, interspersed among the dolls. The arrangement suggests the toys are part of a display.

To the right, another image shows a blurry view of a man. The photograph is encased within a white border, giving it the appearance of a mounted print.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image appears to be a black and white photograph of a display of various dolls and stuffed animals. Here are the detailed observations:

  1. Dolls and Stuffed Animals:

    • The display predominantly features dolls, many of which are dressed in vintage-style clothing. The dolls are arranged in rows, with some seated and others standing.
    • There are several stuffed animals, including teddy bears, placed among the dolls.
    • The dolls and stuffed animals are of different sizes and styles, suggesting a diverse collection.
  2. Setting:

    • The display seems to be indoors, possibly in a store or a collector's room.
    • The background is not very clear, but it appears to be a simple, possibly wooden, shelf or display case.
  3. Photographic Details:

    • The photograph itself is framed with a filmstrip border, indicating it might have been taken with a film camera.
    • The filmstrip border includes markings such as "SUPER XX" and the number "20," which could refer to the film type or frame number.
    • The image has a vintage feel, possibly due to the black and white nature and the style of the dolls' clothing.
  4. Lighting and Quality:

    • The lighting is even, allowing for clear visibility of the dolls and stuffed animals.
    • The photograph is clear, with good contrast, making the details of the dolls and stuffed animals discernible.

Overall, the image captures a nostalgic scene of a collection of dolls and stuffed animals, likely from a bygone era, displayed together.

Text analysis

Amazon

20
SUPER
SUPER XX
XX

Google

20 SUPER XX 20
20
SUPER
XX