Human Generated Data

Title

Untitled (Greenwich Village, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3133

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Greenwich Village, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3133

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.7
Person 99.7
Person 99.6
Person 99.3
Person 98.8
Hat 96.2
Apparel 96.2
Clothing 96.2
Face 94.9
Female 77.5
People 74.4
Sleeve 73.9
Finger 65.9
Hair 65
Photo 62.8
Photography 62.8
Portrait 62.8
Girl 62.7
Woman 55.7

Clarifai
created on 2018-02-09

people 99.9
adult 99.1
group 98.9
woman 98.2
two 98
three 97.7
man 96
portrait 95.7
wear 95.6
group together 94.8
child 94.8
actress 94.5
four 94.4
music 92
offspring 91.1
five 90.8
administration 90.2
monochrome 89.1
several 88.9
facial expression 88.9

Imagga
created on 2018-02-09

couple 32.2
hairdresser 31.5
man 30.9
happy 30.7
love 29.2
people 28.4
together 26.3
male 25.8
senior 24.4
portrait 23.9
salon 21.9
smile 20.7
smiling 20.3
mother 19.7
family 19.6
adult 19.5
grandma 18.6
two 17.8
parent 17.2
lifestyle 16.6
happiness 16.5
husband 16.2
person 16.1
wife 16.1
attractive 16.1
relationship 15.9
married 15.3
elderly 15.3
home 15.2
toiletry 15.2
grandfather 14.8
mature 13.9
old 13.2
togetherness 13.2
face 12.8
outdoors 12.7
women 12.7
affection 12.6
looking 12
father 11.8
day 11.8
blond 11.8
grandmother 11.7
child 11.6
marriage 11.4
look 11.4
sexy 11.2
fun 11.2
daughter 11
casual 11
leisure 10.8
park 10.7
pretty 10.5
sitting 10.3
hair 10.3
joy 10
romantic 9.8
hugging 9.7
hug 9.7
bride 9.6
sibling 9.5
care 9.1
fashion 9
cheerful 8.9
dad 8.9
lady 8.9
romance 8.9
loving 8.6
friends 8.5
relax 8.4
black 8.4
outdoor 8.4
relaxation 8.4
emotion 8.3
wedding 8.3
human 8.2
body 8
retired 7.8
eyes 7.7
men 7.7
world 7.7
retirement 7.7
females 7.6
friendship 7.5
shop 7.4
dress 7.2
kin 7.2

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 99.9
outdoor 92.6
people 69.2
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 99.9%
Sad 97.5%
Calm 0.4%
Surprised 0.1%
Angry 0.3%
Disgusted 0.9%
Happy 0.5%
Confused 0.2%

AWS Rekognition

Age 20-38
Gender Female, 69%
Happy 0.3%
Disgusted 0.6%
Confused 0.3%
Calm 96.6%
Angry 0.4%
Sad 1.4%
Surprised 0.5%

AWS Rekognition

Age 23-38
Gender Male, 86.5%
Happy 0.6%
Disgusted 0.1%
Angry 1.3%
Confused 0.8%
Calm 7%
Surprised 0.5%
Sad 89.8%

AWS Rekognition

Age 26-43
Gender Female, 87.5%
Angry 6.6%
Calm 58.5%
Sad 21.7%
Happy 1.7%
Confused 4.2%
Surprised 4%
Disgusted 3.3%

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 56
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 96.2%

Captions

Azure OpenAI

Created on 2024-01-28

The photo captures a vintage scene on a street. In the foreground, a person is seen holding onto a metallic pole, dressed in a polka-dotted dress. Another individual stands viewable from the back, featuring a dark outfit with a white collar. They seem to be engaged in an interaction. In the background, there's the partial view of a shop window displaying words that start with "BUTITTA," with visible shelved items inside, potentially a storefront. The image has an overall monochromatic, aged appearance, suggestive of a bygone era.

Anthropic Claude

Created on 2024-03-29

The image shows a group of people standing outside a building. There appear to be three women and one man. The women are wearing dresses with polka dots and other patterns. One woman has a hat on. The older woman in the center is wearing a dark dress and seems to be speaking with the other women. In the background, there is a sign that says "Buttitta". Overall, the image captures a scene of people interacting on a street in what appears to be an older, urban setting.

Text analysis

Amazon

BUTTITTA

Google

BUTTITT
BUTTITT