Human Generated Data

Title

Industrial Problems, Welfare Work: United States. New York. New York City. National Biscuit Co.: Welfare of Employees at the Factory, Welfare Institutions, National Biscuit Co., New York City.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.431.1

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. New York. New York City. National Biscuit Co.: Welfare of Employees at the Factory, Welfare Institutions, National Biscuit Co., New York City.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.431.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Furniture 99.8
Tablecloth 98.7
Human 98.5
Person 98.5
Person 98.4
Person 98.4
Person 95.9
Table 94.5
Dining Table 90.9
Person 87.2
Room 87.2
Indoors 87.2
Reception Room 87.2
Reception 87.2
Waiting Room 87.2
Home Decor 83.9
Restaurant 77.9
Chair 77.5
Painting 75.1
Art 75.1
Food 63.8
Meal 61.9
Linen 59
Hall 58.2
Food Court 57.8

Clarifai
created on 2019-06-05

people 99.8
group 99.4
furniture 98.9
many 98.2
adult 97.3
group together 96.4
room 96.1
chair 94.9
seat 94.4
woman 94.3
wear 92.5
military 91.5
man 91.3
several 90.7
administration 89
leader 87.2
outfit 86.7
war 86.6
indoors 85.4
vehicle 77.9

Imagga
created on 2019-06-05

room 28.8
interior 23.9
table 21
home 18.6
people 17.3
chair 16.8
furniture 14.2
house 13.4
window 13
person 12.9
celebration 12
adult 12
happy 11.9
style 11.9
family 11.6
man 11.5
decor 11.5
indoors 11.4
modern 11.2
sofa 11.1
love 11
decoration 11
day 11
design 10.8
restaurant 10.7
new 10.5
comfortable 10.5
group 10.5
empty 10.3
architecture 10.3
luxury 10.3
women 10.3
life 10.2
lifestyle 10.1
wedding 10.1
indoor 10
old 9.7
business 9.7
antique 9.5
hall 9.5
wood 9.3
space 9.3
smile 9.3
elegance 9.2
relaxation 9.2
portrait 9.1
dress 9
black 9
clothing 8.8
couple 8.7
smiling 8.7
glass 8.7
happiness 8.6
holiday 8.6
elegant 8.6
relax 8.4
floor 8.4
fashion 8.3
pillow 8.3
cheerful 8.1
bride 7.9
wall 7.9
art 7.8
dinner 7.8
travel 7.7
party 7.7
couch 7.7
men 7.7
monument 7.5
seat 7.4
romance 7.1

Google
created on 2019-06-05

Photograph 96.6
Snapshot 86.1
Room 82.1
Classic 63.8
Table 63.8
Photography 62.4
Stock photography 59.4
History 57.6
Furniture 56.7
Black-and-white 56.4
Restaurant 56.3
Dining room 55.6
Family 51.8

Microsoft
created on 2019-06-05

wedding dress 94.7
indoor 89.8
dress 89.8
clothing 89.2
person 87.2
woman 83.3
bride 79.2
old 72.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 52.2%
Disgusted 45%
Happy 45.1%
Angry 45.1%
Calm 53.8%
Surprised 45.1%
Confused 45.2%
Sad 45.7%

AWS Rekognition

Age 20-38
Gender Male, 51.7%
Sad 51.8%
Angry 47%
Confused 45.4%
Happy 45.2%
Disgusted 45.2%
Surprised 45.2%
Calm 45.3%

AWS Rekognition

Age 27-44
Gender Male, 53.4%
Calm 45.7%
Surprised 45.6%
Happy 47.6%
Angry 45.5%
Confused 46.9%
Sad 48.2%
Disgusted 45.5%

AWS Rekognition

Age 15-25
Gender Male, 50.2%
Happy 49.5%
Calm 49.7%
Sad 50.2%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 17-27
Gender Female, 54.1%
Calm 51.1%
Confused 45.9%
Happy 45%
Surprised 45.8%
Angry 45.5%
Disgusted 45.1%
Sad 46.5%

Feature analysis

Amazon

Person
Painting
Person 98.5%
Person 98.4%
Person 98.4%
Person 95.9%
Person 87.2%
Painting 75.1%

Captions

Microsoft
created on 2019-06-05

an old photo of a group of people in a room 94.2%
a group of people in a room 92.8%
a group of people in an old photo of a person 76.3%

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people standing around a table with a waiter -100%

Text analysis

Amazon

B

Google

h B
h
B