Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. City Hospital, Blackwell's Island: City Hospital, Blackwell's Island, New York: Boat landing patients and supplies.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.304.1

Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. City Hospital, Blackwell's Island: City Hospital, Blackwell's Island, New York: Boat landing patients and supplies.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Person 99.7
Human 99.7
Person 99.6
Person 99.5
Boardwalk 96.6
Building 96.6
Bridge 96.6
Person 93.4
Waterfront 86.1
Water 86.1
Pier 82
Port 82
Dock 82
Person 81.3
Vehicle 76
Transportation 76
Person 70.2
Person 67.1
Person 65.8
Wheel 64.9
Machine 64.9
Person 63.1
Person 61.6
Wood 61.2
Person 61.2
Porch 57.7
Person 56.3
Deck 55.9
Person 45.4

Imagga
created on 2022-06-04

sketch 100
drawing 79
representation 65.6
construction 29.1
sky 28.1
architecture 21.9
machine 21.2
building 19.8
industry 19.6
structure 19.3
water 18.7
sea 16.4
industrial 15.4
work 13.8
landscape 13.4
equipment 13.4
travel 12.7
power 12.6
old 12.5
house 12.5
city 12.5
ocean 12.4
business 12.1
beach 12
river 11.6
sand 11.3
roof 10.5
sun 10.5
bridge 10.4
summer 10.3
energy 10.1
wood 10
loom 10
silhouette 9.9
tourism 9.9
steel 9.7
device 9.6
gas 9.6
wagon 9.4
clouds 9.3
crane 9.1
transportation 9
tower 8.9
tool 8.9
metal 8.8
fuel 8.7
tree 8.5
iron 8.4
oil 8.4
transport 8.2
coast 8.1
wheeled vehicle 8.1
history 8
textile machine 8
day 7.8
pump 7.8
cloud 7.7
port 7.7
winter 7.7
outdoor 7.6
heavy 7.6
technology 7.4
exterior 7.4
sunset 7.2
support 7.1
rural 7

Google
created on 2022-06-04

Wheel 95
Vehicle 91.4
Motor vehicle 79.7
Aircraft 76.1
Crew 66.6
Airplane 66.3
Tire 66.1
Bridge 65.1
Vintage clothing 64.1
History 63.4
Paper product 59.2
Aviation 58.1
Aerospace manufacturer 57.8
Transport 50.6

Microsoft
created on 2022-06-04

text 97.7
outdoor 95.2
vehicle 90.6
old 85.8
ship 83.2
drawn 80.9
person 75.3
transport 66.3
land vehicle 57.6
pulling 57.5
people 55.6
carriage 54.4
cart 33.9

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Female, 88%
Calm 73.7%
Sad 34.8%
Surprised 6.4%
Fear 6%
Happy 1.2%
Angry 1.1%
Disgusted 0.6%
Confused 0.6%

AWS Rekognition

Age 23-31
Gender Female, 50.1%
Calm 60.9%
Happy 13.7%
Sad 12%
Fear 8.8%
Surprised 6.9%
Confused 1.9%
Angry 1.5%
Disgusted 1.4%

AWS Rekognition

Age 33-41
Gender Male, 97.7%
Happy 44.5%
Calm 40.7%
Surprised 8.6%
Fear 6.3%
Angry 3.8%
Sad 3.4%
Disgusted 1.4%
Confused 1.3%

AWS Rekognition

Age 21-29
Gender Male, 98.2%
Sad 92.7%
Calm 49.6%
Surprised 6.5%
Fear 6.1%
Happy 2.5%
Confused 1.1%
Angry 0.7%
Disgusted 0.5%

AWS Rekognition

Age 43-51
Gender Male, 87.4%
Calm 92.9%
Surprised 6.5%
Fear 5.9%
Happy 4.3%
Sad 2.3%
Confused 0.9%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 16-22
Gender Female, 80.8%
Happy 83.6%
Calm 13.2%
Surprised 6.4%
Fear 6.2%
Sad 2.3%
Confused 1%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 23-31
Gender Female, 74.1%
Calm 67.8%
Happy 14.3%
Surprised 6.9%
Fear 6.3%
Disgusted 4.9%
Sad 4.3%
Confused 3.9%
Angry 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Wheel 64.9%

Captions

Microsoft

a vintage photo of a horse drawn carriage 94.8%
an old photo of a horse drawn carriage 94.7%
a vintage photo of a person riding a horse drawn carriage 87%

Text analysis

Amazon

Boat
and
landing
patients
Boat landing patients and supplies.
supplies.
D24

Google

H Boat landing patients and supplies. D24
H
Boat
landing
patients
and
supplies
.
D24