Human Generated Data

Title

Untitled (Baniya shop)
Date

1862-1863
People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.55

Human Generated Data

Title

Untitled (Baniya shop)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.4
Apparel 99.4
Human 99.3
Person 99.3
Person 75.8
Painting 74.8
Art 74.8
Animal 70.2
Hat 64.9
Cobra 57.5
Reptile 57.5
Snake 57.5

Imagga
created on 2022-01-09

old 20.2
brick 18.1
architecture 15.6
ancient 15.6
people 14.5
work 14
person 14
religion 13.4
man 13.4
child 13.3
wicker 13.3
fashion 12.1
travel 12
outdoors 11.9
stone 11.8
history 11.6
park 11.5
sitting 11.2
wall 11.1
love 11
two 11
adult 11
temple 10.8
village 10.8
male 10.8
trainer 10.6
cell 9.7
building material 9.7
natural 9.4
outdoor 9.2
attractive 9.1
standing 8.7
culture 8.5
tree 8.5
grave 8.4
east 8.4
wood 8.3
traditional 8.3
product 8
building 7.9
smile 7.8
couple 7.8
portrait 7.8
sculpture 7.6
mother 7.6
religious 7.5
tourist 7.5
tourism 7.4
style 7.4
dress 7.2
life 7.1
grass 7.1
parent 7.1

Google
created on 2022-01-09

Adaptation 79.3
People 78
Hat 77.8
Tints and shades 77
Vintage clothing 75
Monochrome 70.7
Room 67.6
Sitting 66.4
Art 66.1
Monochrome photography 65.3
History 63.2
Visual arts 62.7
Still life photography 58.6
Rectangle 50.9
Window 50.5

Microsoft
created on 2022-01-09

building 99.8
outdoor 93.8
clothing 93.4
person 89
black and white 72.2
text 59.6
old 48.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 99%
Sad 63.8%
Confused 14.3%
Disgusted 11.8%
Fear 3.4%
Calm 3%
Surprised 1.8%
Angry 1.5%
Happy 0.5%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 74.8%

Captions

Microsoft

a man sitting in front of a building 66.8%
a man sitting in front of a brick building 61.1%
a man sitting in front of a brick wall 60.6%

Text analysis

Amazon

1121
Photo: 1121
Photo: