Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 179. Potting of Flower Plants.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3561.2

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsch Fund.: 179. Potting of Flower Plants.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Assembly Line 100
Building 100
Factory 100
Person 99.9
Human 99.9
Person 99.8
Person 99.8
Person 99.4
Person 98.3

Clarifai
created on 2019-06-05

people 100
group 99.4
group together 98.7
adult 98.4
many 96.9
man 95.8
several 94.1
two 91.3
four 91.3
employee 90.8
furniture 90.2
room 89.4
woman 88.2
administration 88.2
commerce 87
wear 86.4
grinder 85.3
military 84.7
vehicle 84.5
merchant 83

Imagga
created on 2019-06-05

barbershop 100
shop 84.7
mercantile establishment 66
place of business 44
industry 28.2
factory 23.1
establishment 21.9
industrial 21.8
work 20.5
man 18.1
old 17.4
building 17
steel 15.9
equipment 15.5
construction 14.5
metal 13.7
manufacturing 13.7
power 13.4
machine 13.4
heavy 13.3
people 12.8
worker 12.6
house 12.5
concrete 12.4
interior 10.6
men 10.3
inside 10.1
structure 10.1
male 9.9
working 9.7
seller 9.7
machinery 8.9
home 8.8
architecture 8.6
business 8.5
hairdresser 8.4
travel 8.4
fire 8.4
iron 8.4
plant 8.4
light 8
person 7.8
waste 7.8
dairy 7.7
builder 7.6
engineering 7.6
build 7.6
carpenter 7.6
room 7.3
life 7.2
religion 7.2
adult 7.1
to 7.1
job 7.1
indoors 7
sky 7
modern 7

Google
created on 2019-06-05

Snapshot 82.5
Wood 59.6
Sawmill 57.1
woodworking 54.2
Furniture 53.3
Art 50.2

Microsoft
created on 2019-06-05

person 98.9
clothing 97.9
people 87.3
man 81.5
group 72.8
table 56
old 43
several 10.2

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 54.1%
Surprised 45.2%
Confused 45.5%
Sad 52.2%
Calm 46.4%
Happy 45.2%
Disgusted 45.2%
Angry 45.4%

AWS Rekognition

Age 49-69
Gender Male, 53.8%
Happy 45.6%
Angry 46.5%
Sad 46.4%
Calm 49.9%
Confused 45.5%
Disgusted 45.5%
Surprised 45.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Calm 51.3%
Confused 45.2%
Angry 45.7%
Surprised 45.2%
Disgusted 45.8%
Sad 46.3%
Happy 45.5%

AWS Rekognition

Age 16-27
Gender Female, 52.5%
Sad 51.7%
Disgusted 45.5%
Surprised 45.3%
Angry 46%
Happy 45.6%
Calm 45.6%
Confused 45.3%

AWS Rekognition

Age 38-59
Gender Female, 51.6%
Calm 45.2%
Disgusted 45.2%
Sad 53.3%
Angry 45.2%
Happy 45.4%
Surprised 45.2%
Confused 45.4%

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people sitting and standing in front of a building 92.5%
a group of people standing in front of a building 92.1%
a group of people sitting and standing in front of a store 85%