Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States: On the Lawn, North Family Shakers, Mt. Lebanon, N.Y.

Date

c. 1903

People

Artist: Will S. Potter,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2619.5

Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States: On the Lawn, North Family Shakers, Mt. Lebanon, N.Y.

People

Artist: Will S. Potter,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2619.5

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Person 99.6
Human 99.6
Person 99.2
Person 99
Person 98.9
Person 98.8
Person 98.6
Person 98.3
Person 97.2
Person 97.2
Person 94.4
Person 94.2
Tie 93.7
Accessories 93.7
Accessory 93.7
Person 91.9
People 80.5
Apparel 68.6
Clothing 68.6
Female 58.3
School 55.4

Clarifai
created on 2019-06-04

people 100
group 99.8
many 99.2
group together 98.3
adult 98.1
leader 97.5
child 96.7
administration 96.3
several 93.7
man 92.6
wear 92
woman 91.1
portrait 91.1
offspring 88.3
five 88.1
sibling 80.2
facial expression 79.7
outfit 79.3
four 79.2
home 78.9

Imagga
created on 2019-06-04

kin 75.1
statue 34.8
catholic 26.5
sculpture 25.8
old 25.8
religion 23.3
history 21.5
monument 18.7
art 18.4
god 17.2
religious 16.9
people 16.7
couple 16.5
ancient 16.4
uniform 14.4
stone 14.3
architecture 14.1
church 13.9
person 13.8
historic 13.7
military uniform 13.7
man 13.4
love 12.6
marble 12.6
city 12.5
bride 12.5
historical 12.2
groom 12.1
antique 12.1
vintage 11.6
tourism 11.5
culture 11.1
dress 10.8
clothing 10.8
world 10.6
married 10.5
happy 10
family 9.8
detail 9.7
holy 9.6
saint 9.6
spirituality 9.6
cathedral 9.6
home 9.6
faith 9.6
adult 9.3
famous 9.3
male 9.2
travel 9.1
portrait 9.1
new 8.9
mother 8.7
spiritual 8.6
happiness 8.6
gown 8.5
senior 8.4
traditional 8.3
metropolitan 8.3
landmark 8.1
symbol 8.1
column 8
building 7.9
scene 7.8
pray 7.8
men 7.7
elderly 7.7
sky 7.6
park 7.4
wedding 7.4
peace 7.3
lady 7.3
figure 7.2
aged 7.2

Google
created on 2019-06-04

Photograph 96.2
People 94.5
Vintage clothing 63.3
Family 59.2
History 57.6

Microsoft
created on 2019-06-04

person 99.8
outdoor 98
clothing 95.9
group 94.8
posing 90.4
old 86.4
woman 82
smile 69.8
white 63.7
dress 58.8
vintage clothing 53.6
team 38.9
clothes 18.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-65
Gender Female, 54.2%
Disgusted 45%
Happy 54.6%
Sad 45%
Angry 45.1%
Calm 45.2%
Confused 45%
Surprised 45%

AWS Rekognition

Age 38-59
Gender Female, 54.4%
Calm 47.5%
Disgusted 45.2%
Confused 45.2%
Angry 45.3%
Happy 45.4%
Sad 51.1%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Angry 49.4%
Disgusted 45.2%
Confused 45.8%
Calm 47.1%
Happy 45.1%
Surprised 45.1%
Sad 47.3%

AWS Rekognition

Age 35-52
Gender Male, 53.6%
Sad 47.4%
Surprised 45.1%
Disgusted 45.1%
Calm 50%
Happy 45.1%
Confused 45.1%
Angry 47.2%

AWS Rekognition

Age 49-69
Gender Female, 51.7%
Disgusted 45.2%
Calm 45.8%
Surprised 45.1%
Sad 52.6%
Confused 45.3%
Angry 45.7%
Happy 45.3%

AWS Rekognition

Age 49-69
Gender Male, 52.5%
Surprised 45.2%
Happy 45.9%
Confused 45.3%
Sad 51.3%
Calm 45.3%
Disgusted 45.2%
Angry 46.9%

AWS Rekognition

Age 60-90
Gender Male, 54.8%
Calm 50.7%
Surprised 45.3%
Disgusted 45.2%
Confused 45.6%
Sad 46.6%
Happy 45.9%
Angry 45.7%

AWS Rekognition

Age 60-90
Gender Male, 54.4%
Sad 48.8%
Angry 45.6%
Happy 45.3%
Confused 45.4%
Surprised 45.3%
Disgusted 45.2%
Calm 49.5%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Surprised 45.2%
Calm 48.5%
Happy 45.1%
Sad 49.9%
Angry 45.9%
Confused 45.2%
Disgusted 45.1%

AWS Rekognition

Age 48-68
Gender Male, 53.7%
Angry 45.7%
Happy 45.3%
Disgusted 45.2%
Sad 50.2%
Confused 45.5%
Calm 48%
Surprised 45.2%

AWS Rekognition

Age 48-68
Gender Male, 52.4%
Confused 45.3%
Happy 47.6%
Angry 45.6%
Sad 47.2%
Calm 48.9%
Disgusted 45.1%
Surprised 45.2%

AWS Rekognition

Age 57-77
Gender Male, 54.7%
Calm 49.8%
Surprised 45.3%
Disgusted 45.2%
Confused 45.4%
Happy 48%
Angry 45.5%
Sad 45.8%

AWS Rekognition

Age 57-77
Gender Male, 50.2%
Confused 45.4%
Calm 53.1%
Angry 45.5%
Sad 45.2%
Happy 45.3%
Disgusted 45.2%
Surprised 45.3%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 57
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 93.7%

Categories

Text analysis

Amazon

The
Narrh
On The Lawn
Shakers
On
Lawn
Narrh Famity Shakers Mt.Lebainnn
Famity
PKET
Mt.Lebainnn

Google

PKer On The uaWn mt.Leba non NY. North Fomy Shakers
PKer
On
The
uaWn
mt.Leba
non
NY.
North
Fomy
Shakers