Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: Taking the treatment
Date

c. 1905
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.334.4

Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: Taking the treatment

People

Artist: Unidentified Artist,

Date

c. 1905

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.334.4

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.3
Human 99.3
Person 99.1
Shoe 92.3
Footwear 92.3
Clothing 92.3
Apparel 92.3
Bed 90.1
Furniture 90.1
Porch 88.8
Clinic 82.7
Hospital 77.5
Shoe 71.9
Deck 55.6
Funeral 55.1

Clarifai
created on 2025-01-10

people 99.9
man 99.4
adult 99.4
two 99.3
woman 98.7
administration 96.9
group together 96.9
furniture 96.4
group 95.6
reclining 95.5
four 93.9
three 91.8
leader 90.3
hospital 90.2
home 90.2
chair 90.1
medical practitioner 89.4
child 88.2
one 85
family 85

Imagga
created on 2022-06-25

deck 63.1
interior 47.8
room 41.7
chair 35.3
house 30.4
furniture 30
table 29.5
home 28.7
modern 28
floor 25.1
indoors 22.8
window 22.2
architecture 22
sofa 20.2
lamp 20
decor 18.6
luxury 18
design 18
inside 17.5
comfortable 17.2
living 16.1
seat 16.1
office 16
bed 14.4
hotel 14.3
relaxation 14.2
light 14
bedroom 13.7
building 13.6
travel 13.4
business 13.4
wood 13.3
glass 13.2
relax 12.6
apartment 12.5
hall 12.4
lifestyle 12.3
residential 11.5
man 11.4
urban 11.4
empty 11.2
people 11.2
hospital 11.1
work 11
indoor 11
nobody 10.9
city 10.8
color 10.6
structure 10.5
estate 10.5
sitting 10.3
comfort 9.6
style 9.6
enjoyment 9.4
3d 9.3
rest 9
hardwood 8.8
chairs 8.8
two people 8.8
women 8.7
couch 8.7
decoration 8.7
leather 8.5
real 8.5
desk 8.5
elegance 8.4
reflection 8.2
pillow 7.9
furnishings 7.9
20 24 years 7.9
living room 7.8
casual clothing 7.8
carpet 7.8
full length 7.8
lighting 7.7
men 7.7
passenger 7.7
communication 7.6
contemporary 7.5
place 7.5
vacation 7.4
smiling 7.2
residence 7.2
family 7.1
dwelling 7.1
day 7.1
happiness 7.1
fireplace 7

Google
created on 2022-06-25

Building 89.8
Dress 86.6
Window 85.5
Style 83.9
Black-and-white 83.4
Wedding dress 77.8
Monochrome 76.4
Door 73.9
Vintage clothing 73.7
Monochrome photography 73.6
House 72.6
Classic 72.5
Room 68.9
Event 68
Stock photography 63.1
Home 62.8
Bride 61.7
Bridal clothing 61.5
Hardwood 61.5
Sky 58.8

Microsoft
created on 2022-06-25

indoor 87.4
person 78.8
clothing 76.2
furniture 66.8
white 66.5
man 63.4
house 51.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 50.3%
Calm 72.7%
Sad 33.5%
Surprised 6.5%
Fear 6%
Confused 1.9%
Disgusted 1.4%
Angry 1.1%
Happy 0.2%

AWS Rekognition

Age 18-24
Gender Male, 99.4%
Sad 99.8%
Calm 24.3%
Surprised 6.5%
Fear 6.1%
Disgusted 1.1%
Confused 1%
Angry 0.7%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Bed
Person 99.3%
Person 99.1%
Shoe 92.3%
Shoe 71.9%
Bed 90.1%

Captions

Microsoft
created on 2022-06-25

a person sitting on a bed 74.4%
a man and a woman sitting on a bed 55.8%
a person sitting on a bed 55.7%