Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. Kingsley House: Kingsley House, Pittsburgh, Pa.: In the Country.: Obstacle race

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.284.3

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. Kingsley House: Kingsley House, Pittsburgh, Pa.: In the Country.: Obstacle race

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.284.3

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Person 98.9
Human 98.9
Person 98.5
Person 96.9
Person 96.8
Person 96.4
Person 95.9
Person 92.7
Person 90.6
Person 88.9
People 86.6
Outdoors 83.9
Housing 82.9
Building 82.9
Person 78
Person 77.9
Couch 77.8
Furniture 77.8
Person 74.3
Person 71.3
Nature 71.2
Person 68.8
Shelter 68.2
Rural 68.2
Countryside 68.2
Meal 65.9
Food 65.9
Person 63.7
Mammal 63
Animal 63
Grass 62.3
Plant 62.3
Person 61.3
Field 61
Clothing 60.5
Apparel 60.5
Canine 58.4
Yard 58.1
House 58
Room 57
Indoors 57
Picnic 55.6
Vacation 55.6
Leisure Activities 55.6
Pet 55.3
Person 52.7

Imagga
created on 2022-07-02

dairy 100
farm 32.1
rural 27.3
grass 22.9
pen 21.9
tree 20.8
ranch 19.5
landscape 17.8
field 17.6
enclosure 17.5
agriculture 16.7
horse 16.7
sky 16.6
country 15.8
countryside 15.5
livestock 14.7
pasture 14.4
cow 13.6
cattle 13.1
animals 13
herd 12.7
outdoors 12.7
animal 12.1
travel 12
house 11.7
trees 11.6
outdoor 11.5
farming 11.4
cows 10.8
horses 10.7
sand 10.5
brown 10.3
summer 10.3
structure 10.2
hill 9.4
clouds 9.3
fence 9.1
tourism 9.1
park 9.1
vacation 9
building 8.9
tractor 8.8
hay 8.8
architecture 8.6
resort 8.4
black 8.4
mammal 8.3
meadow 8.1
sun 8
mountain 8
grazing 7.8
wild 7.8
dirt 7.6
beach 7.6
dry 7.4
man 7.4
land 7.4
water 7.3
tourist 7.2

Google
created on 2022-07-02

Vertebrate 92
Mammal 85.9
Building 84.9
House 83.9
Window 82.3
Adaptation 79.4
People 79.3
Sky 77.4
Grass 74.5
Photo caption 68.4
Team 67.4
Stock photography 64.4
Room 63.7
Vintage clothing 63.4
History 59.8
Paper product 59.8
Art 59.1
Team sport 58.4
Football equipment 52.5

Microsoft
created on 2022-07-02

grass 99.9
building 99.8
outdoor 99.1
house 96.5
old 95.2
animal 92.8
mammal 87.1
cattle 82.7
group 73.9
farm 72.8
person 70.4
white 64.8
farm building 37.3
vintage 29.3
horse 19.4
several 13.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 12-20
Gender Male, 98.3%
Calm 69.1%
Angry 10.5%
Sad 9.8%
Surprised 7.2%
Fear 6.5%
Happy 3%
Confused 1.7%
Disgusted 1.1%

AWS Rekognition

Age 18-26
Gender Male, 81%
Calm 63.1%
Confused 14.6%
Surprised 7.3%
Fear 6.8%
Sad 6.5%
Happy 4.3%
Angry 4.1%
Disgusted 1.7%

AWS Rekognition

Age 9-17
Gender Male, 99.8%
Angry 67.7%
Calm 14.7%
Happy 8.7%
Surprised 8.3%
Fear 6.3%
Sad 3%
Disgusted 1%
Confused 1%

AWS Rekognition

Age 21-29
Gender Male, 99.3%
Calm 93%
Surprised 6.3%
Fear 5.9%
Angry 4.8%
Sad 2.7%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Male, 98.8%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.8%
Angry 0.4%
Disgusted 0.2%
Confused 0%

AWS Rekognition

Age 10-18
Gender Male, 97.6%
Calm 51.6%
Happy 24.2%
Fear 7.6%
Surprised 7.5%
Angry 6.7%
Sad 6.1%
Disgusted 2.1%
Confused 1.5%

AWS Rekognition

Age 22-30
Gender Male, 97.7%
Calm 70.7%
Angry 10.9%
Surprised 8.9%
Fear 6.4%
Sad 5.8%
Confused 3.8%
Disgusted 1%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 89.1%
Surprised 6.6%
Fear 6.1%
Sad 3.8%
Happy 2.6%
Angry 1.9%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 55.8%
Happy 14.4%
Sad 12.5%
Fear 7.8%
Surprised 7%
Angry 5.5%
Disgusted 3.3%
Confused 2%

AWS Rekognition

Age 21-29
Gender Male, 98%
Calm 96.8%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Happy 2.2%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 9-17
Gender Male, 75.5%
Calm 95.5%
Surprised 6.4%
Fear 5.9%
Sad 2.5%
Angry 1.1%
Happy 0.8%
Confused 0.7%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Text analysis

Amazon

SE4
35

Google

SE4 ろが
SE4