Human Generated Data

Title

Untitled (crowd of people drinking Pepsi-Cola surrounding seated man)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4988

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people drinking Pepsi-Cola surrounding seated man)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4988

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.8
Human 98.8
Person 97.7
Person 96.1
Person 95.4
Person 93.4
Person 93.2
Person 87.6
Person 84.3
Person 84.1
Person 80.9
Person 78.4
Doctor 78.4
Crowd 75.8
Clinic 75.2
People 74.8
Person 72.5
Clothing 61.7
Apparel 61.7
Face 59
Person 57.4
Person 54.5

Clarifai
created on 2023-10-26

people 99.3
group 98.2
adult 97.3
man 97.2
scientist 95
education 93.6
woman 92.4
many 92.1
monochrome 88.6
medical practitioner 84
coat 81.3
biology 81.1
group together 80.1
uniform 76.8
science 74.8
outerwear 74.6
healthcare 73.1
concentration 70.9
biologist 70.9
indoors 69.8

Imagga
created on 2022-01-22

nurse 100
man 45.7
male 36.2
person 36
patient 35.4
people 32.9
adult 31.4
professional 30.2
coat 27.9
doctor 27.3
businessman 26.5
medical 26.5
business 25.5
lab coat 25.5
indoors 22.8
office 22.5
working 22.1
hospital 21.9
colleagues 21.4
work 21.2
team 20.6
clinic 19.7
casual 19.5
businesspeople 19
case 19
men 18.9
indoor 18.3
smiling 18.1
desk 18
mature 17.7
occupation 17.4
health 17.4
job 16.8
medicine 16.7
specialist 16.5
laboratory 16.4
sick person 16.4
face 16.3
group 16.1
worker 16.1
senior 15.9
teamwork 15.8
day 15.7
happy 15.7
table 15.6
lab 15.5
sitting 15.5
businesswoman 15.5
talking 15.2
meeting 15.1
care 14.8
education 14.7
40s 14.6
lifestyle 14.5
computer 14.4
student 14.4
looking 14.4
bright 14.3
portrait 14.2
color 13.9
associates 13.8
20s 13.7
chemistry 13.5
room 13
scientist 12.7
science 12.5
elderly 12.4
clothing 12.4
corporate 12
coworkers 11.8
horizontal 11.7
discussion 11.7
expertise 11.6
chemical 11.6
research 11.4
biology 11.4
home 11.2
discussing 10.8
test 10.6
30s 10.6
together 10.5
women 10.3
happiness 10.2
camera 10.2
two 10.2
confident 10
technology 9.7
profession 9.6
illness 9.5
teacher 9.4
smile 9.3
glasses 9.3
laptop 9.1
holding 9.1
board 9
cheerful 8.9
doctors 8.8
forties 8.8
assistant 8.7
scientific 8.7
couple 8.7
check 8.7
mid adult 8.7
four 8.6
exam 8.6
serious 8.6
hand 8.4
treatment 8.3
handsome 8
light 8
writing 8
interior 8
business people 7.9
explaining 7.9
crew 7.9
chemist 7.9
examining 7.8
good mood 7.8
diagnosis 7.8
clinical 7.8
businessmen 7.8
experiment 7.8
consultant 7.8
two people 7.8
examination 7.8
concentration 7.7
busy 7.7
modern 7.7
uniform 7.6
bed 7.6
adults 7.6
practitioner 7.3
classroom 7.1
look 7

Google
created on 2022-01-22

Photograph 94.3
White 92.2
Black 89.7
Smile 85.9
Coat 85.9
Black-and-white 84.7
Style 83.8
Apron 83.4
Font 82.2
Sleeve 81.2
Monochrome 75.6
Monochrome photography 75
Snapshot 74.3
Cooking 71.8
Event 71.3
Service 70.5
Room 69.8
Nurse uniform 69.3
T-shirt 68.5
Chef 67.5

Microsoft
created on 2022-01-22

text 99.6
clothing 95.3
person 94.8
man 89
smile 83.2
human face 78.9
drawing 65.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Happy 68.7%
Surprised 13.1%
Confused 4.7%
Calm 4.3%
Disgusted 3.7%
Sad 2.7%
Fear 1.4%
Angry 1.4%

AWS Rekognition

Age 50-58
Gender Female, 95%
Happy 94.8%
Calm 3.2%
Confused 0.7%
Surprised 0.4%
Disgusted 0.4%
Sad 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 56-64
Gender Male, 97.7%
Calm 99.5%
Sad 0.2%
Angry 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Surprised 69.5%
Confused 10.5%
Sad 8.7%
Calm 3.1%
Disgusted 3%
Happy 1.9%
Angry 1.7%
Fear 1.7%

AWS Rekognition

Age 50-58
Gender Male, 93.2%
Happy 82.7%
Sad 8.4%
Surprised 4.2%
Calm 3.3%
Confused 0.6%
Disgusted 0.3%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 36-44
Gender Female, 73.7%
Calm 79.4%
Happy 12.6%
Sad 2.3%
Surprised 1.7%
Disgusted 1.4%
Confused 0.9%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 53-61
Gender Male, 71%
Calm 72.3%
Fear 8.5%
Surprised 4.5%
Sad 4%
Happy 3.8%
Disgusted 2.5%
Angry 2.4%
Confused 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.8%
Person 97.7%
Person 96.1%
Person 95.4%
Person 93.4%
Person 93.2%
Person 87.6%
Person 84.3%
Person 84.1%
Person 80.9%
Person 78.4%
Person 72.5%
Person 57.4%
Person 54.5%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of men in white coats and white coats -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image shows a group of people gathered indoors in celebratory fashion. They are raising cups in a toast-like manner. The setting appears to be formal, with individuals dressed in suits, dresses, and decorative accessories. The room features ornate architectural details, including large windows with stained glass designs and elegant furnishings. A table in the foreground displays multiple cups, floral decorations, and other items. A ceremonial torch-like object is visible to the left side of the scene.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image appears to be a group photo of people gathered indoors, possibly at an event or celebration. The individuals are standing and sitting close together, holding up cups as if making a toast. The setting is adorned with decorative elements, including a table with cups and some floral arrangement. The photograph is in negative form, meaning the colors are inverted, giving it a distinctive appearance. There are windows in the background, suggesting the room is well-lit. This type of composition suggests a formal or semi-formal gathering.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of people gathered around a table, each holding a cup. The scene appears to be a celebratory or commemorative event, with the individuals dressed in formal attire and the cups bearing a logo or design.

  • Group of People:
    • The group consists of approximately 15-20 individuals.
    • They are all dressed in formal attire, with men wearing suits and women wearing dresses or skirts.
    • The group is diverse in terms of age, with both younger and older individuals present.
    • Everyone is holding a cup, which suggests that they are all participating in the same activity or celebration.
  • Table:
    • The table is positioned in the foreground of the image.
    • It is covered with a dark-colored tablecloth.
    • There are several cups on the table, each bearing a logo or design.
    • The cups appear to be identical, suggesting that they may be part of a set or a specific brand.
  • Background:
    • The background of the image is out of focus, but it appears to be a large room or hall.
    • There are several windows visible, which suggests that the room may have a high ceiling.
    • The walls of the room are decorated with various items, including what appears to be a large chandelier.
  • Overall:
    • The image suggests that the group is celebrating a special occasion or event.
    • The formal attire and the presence of cups suggest that the event may be a formal or ceremonial one.
    • The image may have been taken at a wedding, a graduation, or another type of celebration.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of people in white attire, gathered around a table with cups. The scene appears to be a celebratory event, possibly a party or gathering. The individuals are dressed in formal white clothing, with some wearing hats and others holding cups. The table in the center of the image is adorned with cups, suggesting that the event may be related to a beverage or drink. The overall atmosphere of the image is one of joy and celebration, with the group of people smiling and laughing together.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a group of people dressed in white attire, possibly gathered for a formal event or ceremony. The setting appears to be indoors, with a backdrop of arched windows and a chandelier. The individuals are standing in a semi-circle around a table, holding cups or glasses, some with numbers or symbols on them. In the center of the group, a man wearing glasses and a tie is seated, holding a cup in his hand, and smiling. The photograph has a vintage feel, with a watermark at the top left and bottom right corners that reads "13537" and "13337," respectively.

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white photo features a group of people standing in front of a table with cups, some of which have the text "5" on them. The man in front is wearing eyeglasses and a tie and is holding a cup. Behind him are men and women wearing white uniforms, some of whom are holding cups. Some of them are wearing hats. The photo has a watermark with the number "13537" on the top.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

The image is a black-and-white negative photograph showing a group of people gathered indoors, likely in a room with large windows. The composition suggests a celebration or event, as most individuals are holding up what appear to be glasses or cups.

Here are some key observations:

  • People: The group consists of a mix of men and women, likely from an older generation based on their attire and hairstyles. They are all dressed in what seems to be formal or semi-formal clothing, with some wearing jackets or coats.
  • Activity: The primary activity seems to be a celebratory toast. Many people have their glasses raised.
  • Setting: The backdrop includes large windows and possibly ornate architectural details, suggesting a historic building or venue.
  • Objects: There is a table in the foreground with multiple cups and other objects placed upon it. There's also a pedestal with a trophy or decorative item on it.
  • Atmosphere: The image conveys a sense of joy and camaraderie. The people are smiling, and the raised glasses suggest a shared experience.

The overall impression is of a vintage photograph, possibly from a social or celebratory occasion in the past.

Created by gemini-2.0-flash on 2025-05-17

The image is a black-and-white negative, showing a group of people celebrating or toasting with cups. In the foreground, there is a table with several cups on it, decorated with numbers and possibly a logo. In the center of the group is a man in a light-colored suit, holding up a cup. The people behind him are also holding up their cups, creating a sense of festivity. The background features a window with a patterned glass design, and the overall lighting suggests an indoor setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts a group of people, all of whom are wearing costumes and makeup that appear to be a form of blackface. They are posing together in what seems to be a celebratory or festive setting. Many of the individuals are holding cups with the Schlitz beer logo, suggesting a promotional or advertising context. The people are dressed in a variety of outfits, including suits, dresses, and chef uniforms, and they are smiling and posing for the camera. The background features large windows with curtains, adding to the indoor setting of the photograph. The overall atmosphere is jovial and lively.

It's important to note that the use of blackface is highly offensive and racist, as it perpetuates harmful stereotypes and caricatures of Black people. This image likely reflects historical attitudes and practices that are now widely recognized as unacceptable and disrespectful.

Text analysis

Amazon

5
13537.
:
13337.

Google

13537. 11 T3337. -YT3RA2 MAMT2A3
13537.
11
T3337.
-YT3RA2
MAMT2A3