Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2693.3

Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.7
Person 99.7
Person 93.7
Path 89.8
Road 85.3
Pedestrian 76.8
Urban 74.3
Bag 74.1
Transportation 70.3
Vehicle 70.3
Pavement 69.9
Sidewalk 69.9
Town 68.8
Street 68.8
City 68.8
Building 68.8
Walkway 56.8
Handbag 56.5
Accessory 56.5
Accessories 56.5
Apparel 56.1
Clothing 56.1
Coat 56.1
Overcoat 56.1
Person 43.9

Clarifai
created on 2019-06-05

people 99.9
adult 97.7
group together 97.3
street 95.2
child 95.2
one 95
group 94.8
man 93.5
two 92.9
wear 91.2
war 90
military 89.9
administration 89.4
soldier 88.9
boy 85.2
woman 81.5
many 81.3
canine 81.2
three 80.6
vehicle 80

Imagga
created on 2019-06-05

harp 28.7
child 25.1
musical instrument 22.2
stringed instrument 17.9
man 17.5
ancient 17.3
travel 16.9
person 15.7
architecture 15.6
beach 15.3
old 15.3
sea 14.9
pedestrian 14.8
vacation 14.7
pipe 14
people 13.9
sand 13.6
wind instrument 13.6
summer 13.5
outdoors 13.4
tourist 12.4
tourism 12.4
couple 12.2
building 12.1
history 11.6
outdoor 11.5
adult 11.1
stone 11
sculpture 10.5
swing 10.5
holiday 10
water 10
statue 9.7
weapon 9.6
sky 9.6
wall 9.4
lifestyle 9.4
snow 9.4
two 9.3
male 9.3
street 9.2
city 9.1
leisure 9.1
dress 9
happy 8.8
walk 8.6
outside 8.6
walking 8.5
attractive 8.4
historic 8.2
bow and arrow 8.2
sun 8
tropical 7.7
fashion 7.5
relaxation 7.5
historical 7.5
juvenile 7.3
monk 7.1
romantic 7.1
sunlight 7.1
happiness 7.1

Google
created on 2019-06-05

Photograph 97.3
People 94.3
Snapshot 89.3
Vintage clothing 86.5
Standing 79.6
Photography 62.4
Stock photography 62.1
Retro style 57
Black-and-white 56.4
Monochrome 54.4
Vehicle 54.4
Family 51.8
Street 51.1

Microsoft
created on 2019-06-05

building 99.6
outdoor 99.6
ground 97.5
clothing 97.1
person 93.6
way 60.4
footwear 58.2
sidewalk 51.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Female, 97.2%
Sad 90.8%
Disgusted 0.6%
Surprised 1.5%
Angry 2.4%
Happy 2%
Calm 1.9%
Confused 0.9%

AWS Rekognition

Age 10-15
Gender Female, 98.2%
Happy 0.1%
Disgusted 0%
Sad 99.2%
Confused 0.2%
Angry 0.3%
Surprised 0.1%
Calm 0.2%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a person riding a skateboard up the side of a building 39.3%
a person riding a skateboard down a sidewalk next to a building 39.2%
a person riding a skateboard down a sidewalk in front of a building 39.1%

Text analysis

Amazon

S s

Google

940
940