Human Generated Data

Title

Charity, Aged: United States. New York. Buffalo. St. Francis Asylum: St. Francis Asylum, Buffalo, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.581.2

Human Generated Data

Title

Charity, Aged: United States. New York. Buffalo. St. Francis Asylum: St. Francis Asylum, Buffalo, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Workshop 99.1
Person 98.2
Human 98.2
Building 97.8
Factory 97.8
Person 97.4
Person 85.8
Person 82.8
Person 80.4
Person 78
Person 77.6
Assembly Line 70.8
Restaurant 58.2
Cafeteria 56.5
Brewery 55.5

Clarifai
created on 2019-06-07

people 100
group 99.5
group together 99.2
adult 98.8
furniture 97.2
many 97
administration 96.1
military 96
several 95.9
man 95.8
four 93.4
war 92.2
room 91.2
woman 91.1
child 90
one 88.9
two 88.7
wear 87.9
employee 87
merchant 86.9

Imagga
created on 2019-06-07

shop 26.3
barbershop 25.8
industry 23
factory 20.9
industrial 20
building 19.9
old 19.5
man 19.5
mercantile establishment 18.7
steel 16.1
city 15.8
people 15.1
metal 14.5
window 14.1
urban 14
house 13.4
power 12.6
architecture 12.5
place of business 12.4
light 12
machine 11.5
men 11.2
construction 11.1
work 11
business 10.9
black 10.8
dirty 9.9
male 9.9
transportation 9.9
modern 9.8
manufacturing 9.8
structure 9.8
room 9.7
interior 9.7
outdoors 9.7
percussion instrument 9.7
glass 9.3
street 9.2
device 9.2
musical instrument 9.1
wall 8.7
energy 8.4
iron 8.4
worker 8.4
inside 8.3
life 8.3
plant 8.2
chair 8.2
technology 8.2
person 8.1
job 8
working 8
women 7.9
adult 7.9
machinery 7.8
sky 7.6
heavy 7.6
fashion 7.5
home 7.2
warehouse 7.1
day 7.1
travel 7

Google
created on 2019-06-07

Room 74.4
Building 50.8
Art 50.2

Microsoft
created on 2019-06-07

person 97.9
clothing 97.6
table 97.1
furniture 93.2
outdoor 85.3
old 69.9
man 54.6

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-38
Gender Male, 53.9%
Sad 48.1%
Disgusted 47.8%
Happy 45.7%
Calm 47.1%
Surprised 45.6%
Confused 45.4%
Angry 45.4%

AWS Rekognition

Age 29-45
Gender Male, 54.7%
Confused 46%
Surprised 45.3%
Happy 45.5%
Sad 46.7%
Disgusted 45.5%
Angry 46.2%
Calm 49.8%

AWS Rekognition

Age 38-57
Gender Male, 54%
Disgusted 45.2%
Surprised 45.5%
Happy 45.7%
Calm 48.4%
Angry 46.5%
Sad 48.3%
Confused 45.5%

AWS Rekognition

Age 49-69
Gender Female, 50%
Sad 49.7%
Angry 50.1%
Happy 49.6%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Disgusted 49.5%
Angry 49.5%
Surprised 49.6%
Sad 49.9%
Calm 49.7%
Confused 49.6%
Happy 49.6%

Microsoft Cognitive Services

Age 13
Gender Female

Feature analysis

Amazon

Person 98.2%

Captions

Microsoft

a group of people standing in front of a building 78.8%
a group of people standing outside of a building 78.7%
a group of people standing next to a building 78.3%