Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States: II. Eldress Anna and Sister Sarah in sewing shop.
Date

c. 1903
People

Artist: James E. West, American active 1890s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.353

Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States: II. Eldress Anna and Sister Sarah in sewing shop.

People

Artist: James E. West, American active 1890s

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.3
Person 99.3
Person 99
Clothing 84.3
Apparel 84.3
Sitting 81.3
Text 70
Monk 66
Female 60.1
Worker 57.5
Senior Citizen 55.1

Clarifai
created on 2019-06-05

people 99.3
adult 97
woman 94.8
man 93.7
two 91.5
indoors 91
sit 88
group 85.6
room 85
wear 81.7
chair 81.1
portrait 79.6
furniture 77.6
one 75.7
family 75.5
education 71.1
three 70.6
leader 69.4
administration 63.3
military 63.1

Imagga
created on 2019-06-05

room 45.2
man 41.7
person 37.6
people 36.8
home 35.1
male 32.7
indoors 31.6
smiling 28.9
sitting 28.4
classroom 28.3
adult 28.2
happy 25.7
computer 24.9
laptop 24.8
senior 21.6
office 21.4
barbershop 21.2
happiness 21.2
lifestyle 21
teacher 20.4
professional 19.3
smile 18.5
desk 18.3
couple 18.3
table 18.3
shop 18.2
work 18.1
businessman 16.8
business 16.4
group 16.1
meeting 16
family 16
mature 15.8
indoor 15.5
interior 15
together 14.9
women 14.2
patient 14.1
cheerful 13.8
men 13.7
working 13.3
education 13
mercantile establishment 13
portrait 12.9
educator 12.8
two 12.7
technology 12.6
house 12.5
color 11.7
team 11.7
couch 11.6
kid 11.5
elderly 11.5
mother 11.4
looking 11.2
hospital 11.2
life 11.1
love 11
casual 11
suit 10.8
chair 10.6
modern 10.5
living 10.4
togetherness 10.4
corporate 10.3
nurse 10.3
coffee 10.2
face 9.9
to 9.7
child 9.7
exam 9.6
grandfather 9.4
horizontal 9.2
alone 9.1
executive 9.1
holding 9.1
old 9.1
student 9
two people 8.8
school 8.6
place of business 8.6
clothing 8.6
husband 8.6
bright 8.6
talking 8.6
sit 8.5
shirt 8.4
study 8.4
hand 8.4
inside 8.3
occupation 8.3
confident 8.2
aged 8.1
cup 8.1
job 8
medical 7.9
70s 7.9
conference 7.8
retired 7.8
mid adult 7.7
pretty 7.7
attractive 7.7
college 7.6
wife 7.6
communication 7.6
book 7.5
screen 7.5
relationship 7.5
fun 7.5
father 7.5
presentation 7.4
lady 7.3
board 7.2
domestic 7.2
handsome 7.1
director 7.1
case 7.1

Google
created on 2019-06-05

Photograph 96.6
Text 86.9
Snapshot 83.9
Adaptation 67
Room 65.7
Photography 62.4
History 60.4

Microsoft
created on 2019-06-05

wall 97.5
clothing 93.2
man 92.4
person 89.8
smile 80.6
human face 78.2
old 77.2
posing 64.6
gallery 50.4
picture frame 6.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-66
Gender Male, 92.5%
Disgusted 1.5%
Confused 6.8%
Calm 43.8%
Surprised 3%
Happy 36.6%
Sad 3.5%
Angry 4.7%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Angry 45.4%
Disgusted 45.2%
Surprised 45.2%
Calm 49.2%
Sad 49.2%
Happy 45.2%
Confused 45.6%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a person standing in front of a box 78.1%
an old photo of a person 78%
a man and a woman standing in front of a box 53.8%

Text analysis

Amazon

United
United States
States
G
Anna
74.345
Seii
sho Seii
sho
Shaker
G G Rer45.73.15.2
G Rer45.73.15.2
Sstersaprh
kbpes S Anna
Shaker Cenmmmtss
kbpes
iin
Cenmmmtss
S
E Sstersaprh
p
E

Google

Shokee Comnties G Rev 45, 73.15.2 United States tblpess Auna Sstar Sapah in sesu shop 74.345
Shokee
Comnties
G
Rev
45,
73.15.2
United
States
tblpess
Auna
Sstar
Sapah
in
sesu
shop
74.345