Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Hudson Guild": The Hudson Guild, New York City.: The Library
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3181.1

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Hudson Guild": The Hudson Guild, New York City.: The Library

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3181.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.1
Person 99.1
Person 98.8
Person 98.8
Person 98.6
Person 98.3
Room 96.7
Indoors 96.7
Person 95.5
Person 94.6
Person 93.8
Person 93.7
Person 92.8
Person 90.8
Person 90.3
Workshop 90.3
School 81.1
Person 78.5
Table 68.9
Furniture 68.9
Person 68.5
Library 68.2
Book 68.2
People 62.6
Person 62.1
Classroom 59.3
Jury 57.6
Court 56.8

Clarifai
created on 2019-06-06

people 100
group 99.8
child 99.1
administration 97.5
many 96.4
adult 96.3
leader 95.9
several 94.8
group together 94.6
five 93.8
sit 91.9
man 91.4
education 90.5
furniture 88.2
elementary school 86.7
four 85
three 83.4
room 81.7
boy 81
offspring 80.9

Imagga
created on 2019-06-06

groom 51.6
statue 33.7
sculpture 29.8
fountain 28.8
architecture 25.8
old 23
marble 20.5
building 19.9
structure 19.6
art 18.9
ancient 18.2
person 18
history 17.9
stone 17.8
monument 17.7
fan 16.4
religion 15.2
couple 13.9
palace 13.7
landmark 13.5
bride 13.4
city 13.3
detail 12.9
people 12.8
culture 12.8
follower 12.5
column 12.2
famous 12.1
historic 11.9
love 11.8
dress 11.7
god 11.5
man 11.4
cemetery 11.4
historical 11.3
travel 11.3
antique 11.3
kin 11.1
wedding 11
seller 11
tourism 10.7
face 10.7
happiness 10.2
two 10.2
park 9.9
cross 9.4
head 9.2
traditional 9.1
memorial 8.9
mythology 8.8
world 8.7
women 8.7
style 8.2
family 8
catholic 7.9
adult 7.8
male 7.8
sepia 7.8
facade 7.7
married 7.7
outdoor 7.6
bouquet 7.5
religious 7.5
outdoors 7.5
vintage 7.4
symbol 7.4
church 7.4
grave 7.4
exterior 7.4
water 7.3
lady 7.3
figure 7.3
decoration 7.2
romantic 7.1
portrait 7.1

Google
created on 2019-06-06

Photograph 96.2
People 93.7
Snapshot 85.5
Room 76.5
Adaptation 67
History 62.6
Photography 62.4
Stock photography 62.1
Art 58.1
Collection 57.1
Furniture 56.7
Photo caption 54.7

Microsoft
created on 2019-06-06

person 98.3
clothing 97.7
human face 87.9
woman 72.7
group 64.6
photograph 60.9
old 55.2
man 54.6
table 46.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 85.6%
Confused 1.2%
Happy 1%
Sad 26.3%
Disgusted 0.3%
Angry 0.8%
Calm 70.1%
Surprised 0.3%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Angry 47.8%
Calm 48.2%
Surprised 45.2%
Sad 47.9%
Disgusted 45.4%
Happy 45.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 53.3%
Disgusted 45%
Confused 45%
Calm 45.1%
Surprised 45%
Happy 45%
Sad 54.8%
Angry 45%

AWS Rekognition

Age 48-68
Gender Male, 54.3%
Angry 45.3%
Confused 45.3%
Calm 50.8%
Disgusted 45.4%
Happy 47.3%
Surprised 45.3%
Sad 45.7%

AWS Rekognition

Age 35-53
Gender Female, 72.1%
Angry 1.7%
Happy 47.7%
Confused 1.5%
Surprised 2.3%
Sad 13%
Disgusted 2.6%
Calm 31%

AWS Rekognition

Age 10-15
Gender Female, 53.3%
Disgusted 45.1%
Confused 45.3%
Happy 47.6%
Sad 47.3%
Surprised 45.2%
Calm 49.3%
Angry 45.3%

AWS Rekognition

Age 15-25
Gender Female, 54%
Angry 45.1%
Calm 45.4%
Disgusted 45.2%
Surprised 45.2%
Sad 45.8%
Happy 53.2%
Confused 45.1%

AWS Rekognition

Age 27-44
Gender Female, 53.8%
Angry 45.1%
Surprised 45.1%
Sad 45.9%
Confused 45.1%
Calm 45.7%
Disgusted 45.2%
Happy 53%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Calm 47.8%
Surprised 45.1%
Happy 45.2%
Angry 45.1%
Confused 45.1%
Sad 51.4%
Disgusted 45.2%

AWS Rekognition

Age 45-63
Gender Female, 54.6%
Angry 45.4%
Surprised 45.5%
Disgusted 47.7%
Calm 50%
Sad 45.2%
Happy 45.8%
Confused 45.5%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.1%
Person 98.8%
Person 98.8%
Person 98.6%
Person 98.3%
Person 95.5%
Person 94.6%
Person 93.8%
Person 93.7%
Person 92.8%
Person 90.8%
Person 90.3%
Person 78.5%
Person 68.5%
Person 62.1%

Categories

Imagga

paintings art 71.8%
streetview architecture 27%

Captions

Microsoft
created on 2019-06-06

a group of people sitting at a table 89.4%
a group of people sitting around a table 88.8%
an old photo of a group of people sitting at a table 88.7%

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people sitting around a table -100%

Text analysis

Amazon

Litrary
The Litrary
The

Google

The
Library
The Library