Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States
Date

c. 1895
People

Artist: James E. West, American active 1890s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.85

Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States

People

Artist: James E. West, American active 1890s

Date

c. 1895

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.85

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Person 99.1
Human 99.1
Person 97.5
Advertisement 96.2
Collage 96.2
Poster 96.2
Person 93.6
Person 92.9
Person 91.1
Person 89.4
Person 89
Person 88.4
Person 84.4
Person 84
Indoors 81.8
Interior Design 81.8
Person 79.2
Restaurant 78.4
Person 77.9
Person 77.1
Cafeteria 76.9
Person 70.7
Person 70.3
Person 68.3
Food 66.6
Meal 66.6
Person 62.5
Person 60.9
Room 58.3
Living Room 58.3
Cafe 56.1

Clarifai
created on 2018-04-18

people 99.8
adult 99.1
furniture 98.6
group 98.4
monochrome 98.3
no person 97.8
print 97.8
indoors 97.4
room 96.8
many 96.5
man 96.5
illustration 94.6
art 92.1
one 92
woman 91.7
two 90
home 88.3
picture frame 88.2
shelf 85.8
war 84.9

Imagga
created on 2018-04-18

negative 34.3
grunge 33.2
film 31
retro 24.6
drawing 24.1
old 23.7
vintage 23.3
web site 21.8
sketch 20.2
texture 18.7
paper 18.2
art 18.1
photographic paper 18
frame 17.9
design 16.9
dirty 16.3
pattern 15
case 14.7
antique 14.3
graphic 13.9
blank 13.7
insulating material 13.5
paint 12.7
aged 12.7
grungy 12.3
ancient 12.1
photographic equipment 12
border 11.7
currency 11.7
black 11.4
dollar 11.1
money 11
representation 11
worn 10.5
bill 10.5
building material 10.1
cash 10.1
surface 9.7
floral 9.4
flower 9.2
wallpaper 9.2
decorative 9.2
letter 9.2
business 9.1
collection 9
bank 9
digital 8.9
stamp 8.9
decoration 8.8
hundred 8.7
artistic 8.7
exchange 8.6
space 8.5
poster 8.5
finance 8.4
rough 8.2
postage 7.9
text 7.9
messy 7.7
modern 7.7
mail 7.7
card 7.6
unique 7.6
sign 7.5
office 7.5
backdrop 7.4
brown 7.4
banking 7.3
window 7.1

Google
created on 2018-04-18

text 88.8
collection 76.5
black and white 74.7
design 65.3
picture frame 59.7
brand 51.7

Microsoft
created on 2018-04-18

gallery 80.8
room 48.7
different 40.6
several 12.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Calm 49.6%
Happy 49.6%
Sad 50.2%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 35-55
Gender Female, 50.7%
Surprised 45.1%
Disgusted 45.1%
Angry 45.3%
Happy 45.2%
Sad 53.3%
Calm 45.8%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50%
Calm 49.5%
Angry 49.5%
Disgusted 49.9%
Sad 49.9%
Confused 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.1%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.5%
Angry 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 45-63
Gender Male, 50.4%
Confused 49.6%
Sad 50.1%
Disgusted 49.5%
Angry 49.7%
Surprised 49.5%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 45-63
Gender Female, 50.1%
Calm 49.7%
Angry 49.6%
Disgusted 49.5%
Surprised 49.5%
Confused 49.5%
Sad 49.8%
Happy 49.8%

AWS Rekognition

Age 35-55
Gender Female, 50.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.6%
Surprised 49.5%
Sad 50.4%
Happy 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Confused 49.6%
Sad 49.8%
Surprised 49.5%
Disgusted 49.6%
Calm 49.9%
Angry 49.6%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.5%
Surprised 49.5%
Calm 49.5%
Sad 50.2%
Angry 49.7%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Disgusted 49.5%
Happy 49.5%
Calm 50.3%
Surprised 49.5%
Angry 49.6%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Confused 49.5%
Sad 49.5%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 49.6%
Angry 50.3%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Disgusted 49.7%
Confused 49.5%
Calm 49.5%
Angry 50.1%
Surprised 49.5%
Sad 49.6%
Happy 49.6%

AWS Rekognition

Age 38-57
Gender Male, 50.4%
Angry 49.8%
Disgusted 49.5%
Happy 49.5%
Sad 50%
Surprised 49.5%
Confused 49.6%
Calm 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.1%
Angry 49.6%
Confused 49.5%
Calm 49.5%
Sad 50.1%
Disgusted 49.6%
Happy 49.6%
Surprised 49.5%

AWS Rekognition

Age 48-68
Gender Male, 50.2%
Disgusted 49.5%
Calm 50.4%
Sad 49.5%
Angry 49.5%
Confused 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Surprised 49.5%
Calm 49.5%
Sad 49.5%
Disgusted 49.5%
Angry 50.4%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Disgusted 49.5%
Angry 49.5%
Sad 49.6%
Calm 50.3%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 60-80
Gender Male, 54.6%
Angry 46%
Sad 48%
Calm 49.7%
Happy 45.3%
Surprised 45.3%
Disgusted 45.1%
Confused 45.6%

AWS Rekognition

Age 60-90
Gender Male, 50.4%
Disgusted 49.5%
Confused 49.5%
Sad 50.4%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Sad 49.6%
Confused 49.6%
Calm 49.9%
Angry 49.6%
Surprised 49.7%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Surprised 49.5%
Calm 49.5%
Disgusted 49.5%
Sad 50.2%
Happy 49.7%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 38-59
Gender Female, 50.1%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Calm 49.7%
Sad 50.1%
Happy 49.5%
Angry 49.5%

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Categories

Imagga

paintings art 99.5%
text visuals 0.4%

Captions

Microsoft
created on 2018-04-18

a group of people in a room 59.5%
an old photo of a store 54.9%
an old photo of a group of people in a room 54.8%

Text analysis

Amazon

United
Communities,
States
Shaker Communities, United States
Shaker
group.
room.
Evans
dining room.
Flder Evans and family group.
family
Flder
dining
and

Google

Shaker Communities, United States I. Elder Evans and family group. II. Store. III. Visitors' dining roonm IV. Ki tchen.
United
States
I.
and
group.
II.
III.
Shaker
Communities,
Elder
Evans
family
Store.
Visitors'
dining
roonm
IV.
Ki
tchen.