Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3270

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Person 97.7
Human 97.7
Person 96.5
Person 94.1
Person 92.3
Person 90
Poster 82.8
Advertisement 82.8
Collage 80.4
Person 78.6
Person 76.1
Person 75.1
Nature 75
Outdoors 74.7
Person 71.7
Person 71.4
Person 71.1
Person 70.9
Person 70.2
Text 67.9
Person 66.8
Person 64.6
Photography 61
Photo 61
Paper 59.1
Archaeology 58
Furniture 57.3
Art 56.6
Urban 55.9
Architecture 55.9
Building 55.9
Wall 55.7
Plan 55.2
Diagram 55.2
Plot 55.2
Flyer 55.2
Brochure 55.2
Person 51.1

Imagga
created on 2022-07-02

envelope 33.1
brass 29.1
old 24.4
memorial 23.5
vintage 22.3
money 21.3
container 21.2
business 20.6
insulating material 20.6
structure 20.2
currency 19.7
paper 18.8
grunge 17.9
cash 17.4
finance 16.9
antique 16.4
retro 16.4
building material 15.4
blackboard 14.8
stamp 14.8
blank 14.6
frame 14.1
design 14.1
postage 13.7
letter 13.7
mail 13.4
bill 13.3
book jacket 13.1
dollar 13
ancient 13
board 12.8
card 12.7
bank 12.5
financial 12.5
art 11.9
pattern 11.6
post 11.4
jacket 11.1
global 10.9
postmark 10.8
texture 10.4
graphic 10.2
economy 10.2
banking 10.1
investment 10.1
dirty 9.9
exchange 9.5
symbol 9.4
sign 9
collection 9
technology 8.9
computer 8.8
hundred 8.7
payment 8.6
hardware 8.6
empty 8.6
wall 8.5
wallpaper 8.4
wall clock 8.3
drawing 8.2
aged 8.1
border 8.1
wealth 8.1
market 8
postal 7.8
device 7.8
bills 7.8
wrapping 7.7
communications 7.7
stock 7.5
page 7.4
digital 7.3
paint 7.2
black 7.2
history 7.2

Google
created on 2022-07-02

Art 83.3
Font 80.6
Visual arts 69.1
History 67.4
Event 66.4
Paper 66
Room 65.7
Paper product 62.1
Collection 61.5
Rectangle 60.3
Illustration 54.5
Monochrome 52.7
Photographic paper 51.1

Microsoft
created on 2022-07-02

scene 99.9
gallery 99.7
room 99.7
text 92.3
indoor 86.3
person 76.4
old 76.1
museum 66.2
different 63.3
various 57.4
picture frame 50.5
posing 42
bunch 42
several 17.3
painting 15.1

Face analysis

Amazon

AWS Rekognition

Age 23-33
Gender Female, 63.7%
Calm 93.2%
Surprised 6.5%
Fear 6.3%
Sad 2.9%
Angry 1.2%
Happy 1%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 92.2%
Surprised 6.4%
Fear 6%
Angry 3%
Sad 3%
Confused 0.8%
Happy 0.6%
Disgusted 0.3%

AWS Rekognition

Age 10-18
Gender Female, 79.3%
Angry 30.7%
Calm 29.6%
Disgusted 16.6%
Surprised 10.1%
Fear 7.9%
Confused 4.7%
Sad 4.6%
Happy 1.9%

AWS Rekognition

Age 6-14
Gender Female, 83.3%
Fear 56%
Calm 31.4%
Surprised 15.9%
Confused 3.2%
Happy 3%
Sad 2.7%
Angry 2.2%
Disgusted 1.5%

AWS Rekognition

Age 16-24
Gender Female, 87.2%
Calm 90.9%
Happy 6.7%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Angry 0.5%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Female, 72.5%
Calm 87%
Surprised 6.8%
Fear 6.5%
Sad 3.2%
Angry 3%
Disgusted 1.9%
Happy 1.7%
Confused 0.8%

AWS Rekognition

Age 7-17
Gender Male, 98.2%
Calm 90.3%
Surprised 6.4%
Fear 5.9%
Angry 5.7%
Sad 2.6%
Confused 1%
Happy 0.8%
Disgusted 0.3%

AWS Rekognition

Age 20-28
Gender Female, 68.2%
Calm 91.9%
Surprised 6.4%
Fear 6%
Sad 4.2%
Confused 0.9%
Angry 0.7%
Happy 0.6%
Disgusted 0.4%

AWS Rekognition

Age 18-24
Gender Male, 66.6%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 2%
Angry 1.2%
Happy 0.5%
Confused 0.4%
Disgusted 0.2%

AWS Rekognition

Age 20-28
Gender Female, 54.8%
Calm 95.4%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Confused 1.6%
Angry 0.8%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Female, 77.3%
Calm 55.6%
Sad 19.9%
Angry 12.3%
Surprised 6.8%
Fear 6.6%
Happy 5.4%
Confused 4.8%
Disgusted 2.2%

AWS Rekognition

Age 11-19
Gender Female, 82.4%
Calm 75.3%
Disgusted 8.6%
Surprised 6.6%
Fear 6.5%
Angry 6.2%
Sad 4.5%
Happy 1.2%
Confused 1.1%

AWS Rekognition

Age 13-21
Gender Female, 60.3%
Calm 97.7%
Surprised 6.3%
Fear 6%
Sad 2.4%
Angry 0.4%
Happy 0.4%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 19-27
Gender Male, 78.2%
Calm 95.1%
Surprised 6.5%
Fear 6.1%
Sad 2.7%
Happy 0.9%
Confused 0.8%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 18-26
Gender Female, 57.7%
Calm 91.9%
Surprised 6.4%
Fear 5.9%
Angry 4.6%
Sad 2.6%
Happy 0.8%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 14-22
Gender Female, 67%
Calm 65.6%
Happy 19.1%
Sad 8.2%
Surprised 6.5%
Fear 6.2%
Disgusted 1.7%
Angry 1.6%
Confused 0.8%

AWS Rekognition

Age 21-29
Gender Male, 78%
Calm 78.1%
Happy 8.4%
Surprised 6.9%
Fear 6.1%
Angry 4.9%
Sad 4.1%
Confused 1.3%
Disgusted 0.8%

AWS Rekognition

Age 6-12
Gender Male, 66.7%
Calm 94.4%
Surprised 6.3%
Fear 6%
Sad 2.6%
Happy 2.2%
Angry 0.7%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 21-29
Gender Female, 75.8%
Calm 96.5%
Surprised 6.3%
Fear 5.9%
Sad 2.9%
Disgusted 0.4%
Angry 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Male, 76.1%
Calm 77.9%
Sad 10.4%
Surprised 6.6%
Fear 6.2%
Angry 4.3%
Confused 1.7%
Happy 1.6%
Disgusted 1.3%

AWS Rekognition

Age 22-30
Gender Male, 90.9%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Happy 0.3%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 33-41
Gender Male, 64.6%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.6%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Female, 73.9%
Calm 75%
Angry 17.2%
Surprised 6.5%
Fear 6%
Happy 3.8%
Sad 2.9%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 6-12
Gender Male, 93.1%
Calm 66.7%
Happy 25.5%
Surprised 6.4%
Fear 6.1%
Sad 3.9%
Disgusted 1.1%
Angry 0.9%
Confused 0.4%

AWS Rekognition

Age 16-24
Gender Male, 69.7%
Calm 66.2%
Angry 14.3%
Surprised 6.8%
Fear 6.3%
Sad 5.7%
Confused 5.1%
Happy 3.9%
Disgusted 1.2%

AWS Rekognition

Age 22-30
Gender Male, 87.6%
Calm 82.9%
Surprised 6.6%
Fear 6.3%
Sad 5.4%
Angry 4.2%
Happy 2.9%
Confused 0.8%
Disgusted 0.7%

AWS Rekognition

Age 12-20
Gender Male, 82.3%
Surprised 99.5%
Fear 6.1%
Calm 2.8%
Sad 2.8%
Angry 1%
Happy 0.8%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 18-24
Gender Female, 83%
Calm 53%
Fear 19.4%
Happy 17.7%
Surprised 7.1%
Sad 3.2%
Disgusted 1.9%
Confused 1.6%
Angry 1.4%

AWS Rekognition

Age 23-31
Gender Male, 88.7%
Calm 98.1%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Angry 0.6%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-22
Gender Female, 95.4%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.4%
Happy 0.4%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Male, 82.1%
Calm 95.5%
Surprised 6.4%
Fear 5.9%
Sad 2.5%
Angry 1.4%
Confused 0.6%
Happy 0.5%
Disgusted 0.3%

AWS Rekognition

Age 24-34
Gender Male, 96.3%
Calm 89.5%
Surprised 7%
Fear 6.1%
Happy 3.2%
Sad 2.7%
Disgusted 1.7%
Angry 1.6%
Confused 0.5%

AWS Rekognition

Age 23-33
Gender Female, 81.7%
Calm 83.5%
Happy 8.3%
Surprised 6.5%
Fear 6.4%
Sad 3.4%
Disgusted 1.3%
Angry 1%
Confused 0.7%

Feature analysis

Amazon

Person 97.7%

Captions

Microsoft

an old photo of a room 63.3%
a bunch of old photo of a room 59.1%
a group of people posing for a photo 30.6%

Text analysis

Amazon

House,
University
the
Philadelphia,
One
University House, Philadelphia, Pa.
of
street
Club
A
One of the Clubs
Club Members
A nearby street
Members
Want
Class
Pa.
belong
Cooking Class
Want % belong
nearby
Clubs
Cooking
%
G
SRR,
In the Neighborhood
In
Neighborhood
SARE

Google

on ma Cooking Class Club Members University House, Philadelphia, Pa. One of the clubs Want to belong RRE In the Neighborhood G Se a
on
ma
Cooking
Class
Club
Members
University
House
,
Philadelphia
Pa
.
One
of
the
clubs
Want
to
belong
RRE
In
Neighborhood
G
Se
a