Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.18

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.18

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-08-08

Face 100
Head 100
Photography 100
Portrait 100
Clothing 99.9
People 99.6
Baseball Cap 99.5
Cap 99.5
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.1
Person 98.6
Adult 98.6
Male 98.6
Man 98.6
Person 97.9
Male 97.9
Boy 97.9
Child 97.9
Person 97.4
Adult 97.4
Male 97.4
Man 97.4
Body Part 97.3
Finger 97.3
Hand 97.3
Hat 96
Hat 90.8
Selfie 55.6
Happy 55.1
Smile 55.1

Clarifai
created on 2023-10-13

people 100
adult 99.3
portrait 98.4
woman 98
group 97.8
man 97.7
wear 96.1
child 94.4
group together 93.4
lid 93.2
facial expression 92.8
street 91.1
two 89
several 88.7
many 88.2
veil 86.9
monochrome 86.3
son 85.4
three 85.1
four 84.5

Imagga
created on 2023-08-08

grandfather 49.1
senior 45.9
man 41.6
elderly 38.3
couple 34.8
old 34.8
mature 31.6
male 31.5
retired 29.1
person 28.6
happy 28.2
mother 25.7
people 25.1
adult 22.6
love 22.1
portrait 21.3
together 21
parent 20.8
retirement 20.2
husband 20
aged 19
smiling 18.1
fan 17.9
married 17.3
smile 17.1
wife 17.1
grandmother 16.6
home 15.9
happiness 15.7
face 14.9
men 14.6
older 14.6
follower 14.5
lifestyle 14.4
gray 14.4
age 14.3
hair 14.3
handsome 14.3
marriage 14.2
family 13.3
father 12.9
casual 12.7
laughing 12.3
looking 12
outdoors 11.9
aging 11.5
relationship 11.2
pensioner 11.1
beard 10.9
women 10.3
two 10.2
citizen 9.9
lady 9.7
health 9.7
child 9.7
affection 9.7
look 9.6
grandma 9.6
eyes 9.5
professional 9.3
glasses 9.3
joy 9.2
world 9.2
outdoor 9.2
leisure 9.1
fun 9
cheerful 8.9
70s 8.8
seniors 8.8
dad 8.6
statue 8.6
friendship 8.4
head 8.4
emotion 8.3
life 8.3
close 8
medical 7.9
wrinkles 7.9
day 7.8
60s 7.8
middle aged 7.8
sitting 7.7
expression 7.7
loving 7.6
enjoying 7.6
togetherness 7.6
human 7.5
park 7.4
kin 7.4
relaxing 7.3
activity 7.2
romance 7.1
monk 7

Google
created on 2023-08-08

Forehead 98.5
Gesture 85.3
Hat 84.2
Headgear 83.1
Adaptation 79.3
Building 76.7
Landscape 75.1
Monochrome 74.8
Vintage clothing 74.1
Monochrome photography 71.4
Event 70.8
Crowd 69.5
T-shirt 68.8
Cap 68.1
Crew 67.8
Window 66.3
History 65
Uniform 64.5
Smile 63.6
Team 62.6

Microsoft
created on 2023-08-08

person 99.3
outdoor 98.5
human face 97.5
man 97.1
clothing 96.6
hat 91.7
old 78
black 69
text 68.6
white 60.5
posing 49.3
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 97.5%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Angry 0.5%
Happy 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Happy 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.8%
Calm 0.4%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 58%
Happy 31.5%
Surprised 7.3%
Fear 6.1%
Sad 3.8%
Angry 1.4%
Confused 1.4%
Disgusted 0.8%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 96.2%
Surprised 6.4%
Fear 5.9%
Sad 2.6%
Confused 1%
Happy 0.5%
Disgusted 0.4%
Angry 0.2%

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Boy
Child
Hat
Person 99.2%
Person 99.1%
Person 98.6%
Person 97.9%
Person 97.4%
Adult 99.2%
Adult 98.6%
Adult 97.4%
Male 99.2%
Male 98.6%
Male 97.9%
Male 97.4%
Man 99.2%
Man 98.6%
Man 97.4%
Boy 97.9%
Child 97.9%
Hat 96%
Hat 90.8%

Captions

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-31

The image shows a group of men wearing hats and workwear, standing together outside what appears to be a building or structure in the background. The men seem to be engaged in some kind of work or activity, with one man holding what looks like a piece of building material or tool. The image has a sepia tone and an older, historical feel, suggesting it was taken some time in the past.

Created by claude-3-opus-20240229 on 2024-12-31

The sepia-toned image shows a group of young boys wearing caps and casual shirts, standing in front of a large brick building. The boys have smiling, joyful expressions as they pose together, with some of them placing their arms around each other in a friendly manner. The setting appears to be outdoors on a sunny day, based on the bright lighting and shadows. The old-fashioned style of their clothing and the sepia color of the photograph suggests this is a historical image from an earlier era, capturing a moment of camaraderie and happiness among the group of friends.

Created by claude-3-5-sonnet-20241022 on 2024-12-31

This appears to be a vintage sepia-toned photograph, likely from the early-to-mid 20th century. In the image, several young people are shown wearing casual work clothes and caps, typical of the working class or laborers of that era. They appear to be outdoors, with what looks like a brick building visible in the background. The subjects are smiling at the camera, giving the photo a candid, friendly feel. The image quality and style is characteristic of photography from that historical period, with slightly soft focus and warm brown tones typical of the photographic processes used at the time.

Text analysis

Google

IF IT IT IT
IF
IT