Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: A Straw Ride

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3271.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: A Straw Ride

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Wheel 99.5
Machine 99.5
Horse 98.3
Mammal 98.3
Animal 98.3
Wagon 95.1
Vehicle 95.1
Transportation 95.1
Wheel 94.3
Person 93.5
Human 93.5
Person 92
Person 87.8
Carriage 87.8
Person 85.8
Person 84.9
Horse Cart 81
Person 74.7
Person 68.4
Person 66.7
Bicycle 65.4
Bike 65.4
Person 64.5
Person 63.8
Person 63
Town 61
Street 61
Urban 61
Building 61
Road 61
City 61
Nature 58.3
Outdoors 57.4
Person 52.3
Person 43.4
Person 42.4

Imagga
created on 2022-07-02

cart 100
wagon 100
horse cart 100
wheeled vehicle 68.9
vehicle 46.6
carriage 42.1
transportation 29.6
horse 29.4
old 27.9
rural 22.9
wheel 22.6
farm 21.4
transport 21
grass 16.6
antique 16.5
travel 15.5
hay 14.6
animal 13.7
wheels 13.7
vintage 13.2
horses 12.7
sky 12.1
landscape 11.9
oxcart 11.3
historic 11
countryside 11
architecture 10.9
wooden 10.5
agriculture 10.5
outdoors 10.5
historical 10.4
wood 10
city 10
tourist 10
history 9.8
country 9.7
building 9.5
field 9.2
road 9
tractor 8.8
farming 8.5
house 8.4
street 8.3
vacation 8.2
sand 7.9
tire 7.8
ancient 7.8
driver 7.8
ride 7.8
summer 7.7
outdoor 7.7
cattle 7.5
tourism 7.4
park 7.4
people 7.3
snow 7.1
trees 7.1
work 7.1

Google
created on 2022-07-02

Microsoft
created on 2022-07-02

outdoor 100
horse 100
drawn 99.8
carriage 99.7
old 98.1
pulling 97.9
text 91.9
transport 83.7
land vehicle 83
people 81.7
horse and buggy 81.6
animal 81.1
cart 72.8
vehicle 71.4
wagon 59.7
pulled 59.4
horse-drawn vehicle 54.3
family 26.5

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 99.2%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.5%
Disgusted 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 18-26
Gender Male, 94.2%
Happy 28.6%
Disgusted 24.3%
Calm 21.1%
Sad 16.3%
Surprised 7.1%
Fear 6.9%
Angry 3.3%
Confused 3.3%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 91.4%
Surprised 6.5%
Fear 6%
Sad 2.8%
Disgusted 1.9%
Angry 1.6%
Happy 1.3%
Confused 1.2%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Calm 96.1%
Surprised 6.5%
Fear 6.1%
Sad 2.8%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Calm 97.8%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.5%
Angry 0.5%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Female, 70.4%
Calm 84.7%
Surprised 6.4%
Sad 6.3%
Fear 6%
Disgusted 3.1%
Angry 1.4%
Confused 1.4%
Happy 0.9%

AWS Rekognition

Age 16-22
Gender Female, 82.5%
Sad 99.9%
Calm 7.1%
Angry 7.1%
Surprised 6.4%
Fear 6.3%
Confused 2.5%
Disgusted 1.8%
Happy 0.7%

AWS Rekognition

Age 41-49
Gender Female, 51.8%
Calm 40.1%
Happy 34.5%
Confused 8.5%
Sad 7.8%
Surprised 6.8%
Fear 6.4%
Angry 3.1%
Disgusted 1.9%

AWS Rekognition

Age 22-30
Gender Male, 60.3%
Angry 54.9%
Calm 30.4%
Sad 8.7%
Surprised 6.8%
Fear 6.1%
Disgusted 1.8%
Confused 0.6%
Happy 0.5%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Surprised 77.1%
Disgusted 14.3%
Sad 12.7%
Calm 10.8%
Confused 6.4%
Fear 6.3%
Angry 5.5%
Happy 3%

AWS Rekognition

Age 27-37
Gender Female, 92.9%
Sad 67.6%
Disgusted 55.7%
Calm 8.3%
Surprised 6.5%
Fear 6.1%
Confused 1.9%
Happy 0.8%
Angry 0.6%

AWS Rekognition

Age 18-24
Gender Female, 67%
Calm 58.9%
Angry 32.7%
Surprised 6.6%
Fear 6%
Sad 3.8%
Happy 1.4%
Disgusted 1.4%
Confused 0.5%

AWS Rekognition

Age 28-38
Gender Male, 83.2%
Happy 78.4%
Calm 19%
Surprised 6.7%
Fear 5.9%
Sad 2.2%
Confused 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 18-26
Gender Male, 96%
Calm 87.4%
Surprised 6.9%
Fear 6%
Sad 3.8%
Angry 3.2%
Happy 1.7%
Disgusted 1.3%
Confused 0.6%

AWS Rekognition

Age 18-26
Gender Female, 60.8%
Calm 94%
Surprised 6.5%
Fear 6.1%
Sad 2.5%
Angry 1.4%
Happy 1.3%
Disgusted 0.7%
Confused 0.2%

AWS Rekognition

Age 23-33
Gender Male, 95.5%
Disgusted 48.2%
Calm 18.3%
Angry 16.6%
Surprised 9.7%
Sad 6.2%
Fear 6.1%
Confused 2.1%
Happy 1.2%

AWS Rekognition

Age 20-28
Gender Male, 99.1%
Calm 60.2%
Sad 19.7%
Surprised 7.4%
Angry 6.7%
Happy 6.5%
Fear 6.3%
Confused 5%
Disgusted 1.5%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Sad 99.7%
Calm 20.8%
Surprised 6.8%
Fear 6.2%
Confused 4.1%
Angry 3.7%
Disgusted 1.7%
Happy 0.7%

AWS Rekognition

Age 19-27
Gender Male, 77.3%
Calm 79%
Sad 8.5%
Surprised 7%
Fear 6.1%
Disgusted 3.8%
Angry 2.5%
Confused 1.6%
Happy 1%

AWS Rekognition

Age 21-29
Gender Male, 97.4%
Calm 47.1%
Happy 21%
Disgusted 14.3%
Sad 10.4%
Fear 7.3%
Surprised 6.8%
Confused 0.9%
Angry 0.7%

AWS Rekognition

Age 23-31
Gender Male, 83.6%
Sad 60.8%
Calm 18.4%
Surprised 15.2%
Angry 14.8%
Happy 12.5%
Fear 7.9%
Disgusted 4.9%
Confused 3.4%

AWS Rekognition

Age 23-33
Gender Male, 88.6%
Sad 100%
Surprised 6.3%
Fear 6%
Happy 3%
Calm 2.7%
Angry 0.6%
Confused 0.3%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Male, 98.8%
Sad 36%
Surprised 29.5%
Calm 21.1%
Happy 19.6%
Fear 10.5%
Angry 2.6%
Disgusted 2.1%
Confused 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Wheel 99.5%
Horse 98.3%
Person 93.5%
Bicycle 65.4%

Captions

Microsoft

a group of people riding on the back of a horse drawn carriage 95.9%
an old photo of a horse drawn carriage 95.8%
a man riding a horse drawn carriage 95.7%

Text analysis

Amazon

SRR

Google

SRR 4 4.
4
SRR
.