Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Dining out-doors.

Date

c. 1912

People

Artist: Wolfson, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.159.1

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Dining out-doors.

People

Artist: Wolfson, American

Date

c. 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.159.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 97.9
Person 97.9
Person 97.8
Restaurant 97.1
Person 97
Person 96.4
Person 96.3
Person 95.6
Person 95.5
Person 87.1
Cafeteria 87.1
Person 86.3
Person 85.3
Person 80.6
Furniture 69.4
Chair 69.4
Cafe 66.5
People 64.6
Porch 60.1
Person 59.2
Indoors 58.2
Room 58.2
Art 57.8
Painting 57.8
Food 55.9
Food Court 55.9

Clarifai
created on 2019-06-05

people 100
group 99.6
adult 98.9
furniture 98.5
many 98.3
man 97.7
woman 96.9
room 96.4
group together 96
administration 94.3
leader 93.8
several 91.6
sit 91.1
child 90.3
military 90.2
chair 90.2
war 89.3
seat 86.6
wear 86.6
watercraft 83

Imagga
created on 2019-06-05

barbershop 69.4
shop 54.3
mercantile establishment 42.3
room 33
indoors 30.7
man 30.2
salon 29.5
home 28.7
place of business 28.4
people 27.9
male 22.7
smiling 22.4
interior 22.1
sitting 20.6
person 20
chair 19.8
table 19.3
adult 18.3
classroom 18.1
lifestyle 18.1
hairdresser 17.9
indoor 17.3
happy 16.9
couple 16.5
happiness 15.7
office 15.1
women 15
work 14.9
modern 14.7
men 14.6
computer 14.5
house 14.2
establishment 14.2
desk 12.7
meeting 12.2
business 12.1
smile 11.4
love 11
team 10.7
working 10.6
cheerful 10.6
together 10.5
group 10.5
laptop 10.2
inside 10.1
glass 10.1
occupation 10.1
relaxation 10
two people 9.7
portrait 9.7
color 9.5
togetherness 9.4
hospital 9.4
two 9.3
communication 9.2
window 9.2
holding 9.1
family 8.9
professional 8.9
20 24 years 8.9
businessman 8.8
furniture 8.8
chairs 8.8
life 8.8
couch 8.7
comfortable 8.6
talking 8.6
teacher 8.6
child 8.5
enjoyment 8.4
mature 8.4
teamwork 8.3
executive 8.3
kitchen 8.2
day 7.8
casual clothing 7.8
education 7.8
full length 7.8
corporate 7.7
college 7.6
living 7.6
adults 7.6
relationship 7.5
design 7.3
alone 7.3
businesswoman 7.3
board 7.2
romantic 7.1
architecture 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

person 98.3
clothing 98.1
wall 95.9
woman 89
man 85
old 65.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 51.2%
Sad 46.2%
Angry 49.9%
Confused 45.3%
Happy 47.5%
Disgusted 45.5%
Surprised 45.4%
Calm 45.2%

AWS Rekognition

Age 10-15
Gender Female, 54.8%
Happy 55%
Sad 45%
Disgusted 45%
Angry 45%
Surprised 45%
Calm 45%
Confused 45%

AWS Rekognition

Age 20-38
Gender Female, 54.3%
Disgusted 45.1%
Sad 52.9%
Calm 45.3%
Confused 45.1%
Happy 45.1%
Surprised 45.1%
Angry 46.4%

AWS Rekognition

Age 15-25
Gender Female, 54.8%
Sad 54.8%
Angry 45.1%
Calm 45%
Confused 45.1%
Happy 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 19-36
Gender Male, 53.4%
Sad 45.1%
Calm 54.4%
Happy 45.1%
Surprised 45.1%
Angry 45.1%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Happy 46.3%
Angry 46.7%
Calm 45.2%
Sad 45.9%
Surprised 45.5%
Confused 45.6%
Disgusted 49.7%

AWS Rekognition

Age 29-45
Gender Female, 52%
Confused 45.5%
Happy 46.1%
Sad 45.6%
Disgusted 45.9%
Angry 46%
Calm 50.3%
Surprised 45.6%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Sad 50.3%
Angry 49.5%
Disgusted 49.5%
Happy 49.6%

AWS Rekognition

Age 49-69
Gender Female, 50.3%
Happy 49.5%
Sad 50.5%
Angry 49.5%
Surprised 49.5%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Surprised 46.2%
Sad 46%
Disgusted 46%
Happy 48.4%
Confused 45.3%
Calm 46.7%
Angry 46.4%

AWS Rekognition

Age 16-27
Gender Male, 50.3%
Calm 49.6%
Sad 49.6%
Surprised 49.5%
Angry 50.2%
Happy 49.5%
Confused 49.5%
Disgusted 49.6%

Feature analysis

Amazon

Person 97.9%
Chair 69.4%
Painting 57.8%

Categories

Captions

Microsoft
created on 2019-06-05

an old photo of a person 77.5%
old photo of a person 74.3%
a group of people in a room 74.2%

Text analysis

Amazon

Dining
Dining out-doors.
out-doors.
GILI
AmIbadt

Google

CHILE Dining out-doors.
CHILE
Dining
out-doors.