Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Pennsylvania. Pittsburgh. H. J. Heinz Company: Our Choral Society.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.92

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Pennsylvania. Pittsburgh. H. J. Heinz Company: Our Choral Society.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.92

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 96.9
Person 96.9
Person 96.7
Person 96
Person 95
Stage 94.7
Person 92.8
Person 91.3
Person 91.2
Person 90.9
Person 87.2
Advertisement 85.2
Poster 85.2
Person 85.1
Indoors 84.9
Painting 83.6
Art 83.6
Person 80.1
Room 78.9
Person 75.8
Person 75.3
Person 75.2
Interior Design 72.1
Person 71.3
Person 65.2
People 64.6
Person 62.7
Shop 59.8
Window Display 59.8
Crowd 58.9
Person 54.8
Person 52.4
Person 52
Person 45.6

Clarifai
created on 2019-06-05

people 99.8
many 98.7
adult 98.4
group 98.2
wear 96.2
man 93
home 92.9
no person 92.9
woman 92.4
outfit 92.1
group together 91.1
administration 90.8
room 90.6
crowd 89.8
music 89.4
indoors 89.1
one 87.8
leader 84.9
painting 84.3
ceremony 83.3

Imagga
created on 2019-06-05

freight car 77.5
car 58.7
wheeled vehicle 48.1
vehicle 30.9
vintage 26.5
old 23.7
grunge 23
antique 21.9
art 21.3
retro 19.6
frame 17.6
texture 16.7
dirty 16.3
conveyance 15.6
border 15.4
damaged 15.3
pattern 15
black 15
architecture 14.8
film 14.6
graphic 13.9
paint 12.7
design 12.4
grungy 12.3
ancient 12.1
decoration 12
light 12
aged 11.8
screen 11.6
text 11.3
rough 10.9
scratches 10.8
photographic 10.8
frames 10.7
scratch 10.7
material 10.7
movie 10.7
night 10.6
collage 10.6
slide 9.8
digital 9.7
your 9.7
layer 9.7
rust 9.6
detailed 9.6
edge 9.6
dirt 9.5
paper 9.4
space 9.3
theater curtain 9.2
church 9.2
building 9.1
structure 9.1
reflection 8.9
postmark 8.9
highly 8.9
designed 8.8
computer 8.8
layered 8.8
mess 8.8
noise 8.8
strip 8.7
stamp 8.7
messy 8.7
mask 8.6
mail 8.6
weathered 8.5
curtain 8.3
city 8.3
letter 8.2
landmark 8.1
blackboard 8.1
noisy 7.9
colorful 7.9
postage 7.9
postal 7.8
travel 7.7
dark 7.5
electronic equipment 7.5
equipment 7.4
entertainment 7.4
water 7.3
historic 7.3
business 7.3
history 7.2
interior 7.1

Google
created on 2019-06-05

Photograph 95
Picture frame 78.6
Room 65.7
Art 50.2

Microsoft
created on 2019-06-05

person 82
old 74.9
picture frame 6.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Sad 49.6%
Calm 49.9%
Surprised 49.6%
Confused 49.6%
Disgusted 49.5%
Happy 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.6%
Happy 50%
Angry 49.6%
Surprised 49.7%
Sad 49.6%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 49.6%
Angry 49.6%
Calm 49.6%
Confused 49.5%
Happy 50.1%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50%
Angry 49.9%
Sad 49.7%
Disgusted 49.6%
Calm 49.7%
Surprised 49.6%
Confused 49.6%
Happy 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Surprised 49.5%
Disgusted 49.6%
Sad 49.6%
Calm 49.8%
Confused 49.5%
Angry 49.6%
Happy 49.9%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Surprised 49.6%
Happy 50.1%
Calm 49.6%
Disgusted 49.6%
Confused 49.5%
Sad 49.6%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Happy 49.6%
Disgusted 49.6%
Sad 49.6%
Surprised 49.6%
Confused 49.6%
Calm 49.9%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Confused 49.6%
Happy 49.7%
Surprised 49.6%
Calm 49.6%
Angry 49.5%
Sad 50%
Disgusted 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Confused 49.6%
Surprised 49.6%
Sad 49.7%
Calm 49.8%
Happy 49.7%
Angry 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.5%
Sad 49.6%
Disgusted 49.5%
Calm 50.1%
Surprised 49.6%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Surprised 49.6%
Disgusted 49.8%
Sad 49.7%
Calm 49.7%
Happy 49.6%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 49.7%
Angry 49.6%
Happy 49.6%
Disgusted 49.8%
Calm 49.6%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.5%
Happy 49.5%
Surprised 49.5%
Calm 50%
Angry 49.6%
Sad 49.8%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.5%
Happy 49.5%
Sad 50%
Angry 49.8%
Disgusted 49.5%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.6%
Happy 49.6%
Calm 49.5%
Confused 49.5%
Sad 50%
Disgusted 49.7%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50%
Angry 49.6%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 50.3%
Surprised 49.6%
Sad 49.5%

AWS Rekognition

Age 35-55
Gender Female, 50.4%
Happy 49.5%
Angry 50%
Calm 49.6%
Sad 49.8%
Surprised 49.5%
Confused 49.5%
Disgusted 49.6%

AWS Rekognition

Age 27-44
Gender Male, 50.2%
Sad 49.7%
Calm 49.9%
Disgusted 49.6%
Confused 49.6%
Angry 49.6%
Surprised 49.6%
Happy 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50%
Sad 49.6%
Disgusted 49.5%
Surprised 49.6%
Happy 49.5%
Confused 49.5%
Calm 50.2%
Angry 49.6%

AWS Rekognition

Age 4-9
Gender Female, 50.1%
Angry 49.5%
Calm 50.3%
Confused 49.5%
Happy 49.5%
Sad 49.6%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Disgusted 49.6%
Confused 49.5%
Happy 49.5%
Sad 50.3%
Surprised 49.5%
Calm 49.5%
Angry 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Disgusted 49.6%
Surprised 49.5%
Sad 50%
Angry 49.6%
Happy 49.7%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Sad 49.8%
Calm 49.9%
Surprised 49.6%
Confused 49.6%
Disgusted 49.6%
Happy 49.6%
Angry 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Calm 49.8%
Confused 49.6%
Happy 49.5%
Surprised 49.6%
Angry 49.7%
Disgusted 49.6%
Sad 49.8%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Sad 49.8%
Calm 49.5%
Happy 49.8%
Surprised 49.5%
Angry 49.6%
Disgusted 49.6%
Confused 49.5%

AWS Rekognition

Age 10-15
Gender Female, 50.3%
Disgusted 49.5%
Confused 49.6%
Happy 49.6%
Sad 49.8%
Surprised 49.5%
Calm 49.9%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Angry 49.6%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 50.2%
Happy 49.5%
Disgusted 49.7%

AWS Rekognition

Age 17-27
Gender Female, 50%
Confused 49.6%
Surprised 49.6%
Angry 49.7%
Happy 49.8%
Sad 49.7%
Calm 49.6%
Disgusted 49.6%

AWS Rekognition

Age 30-47
Gender Female, 50.5%
Confused 49.6%
Disgusted 49.6%
Surprised 49.6%
Sad 50%
Angry 49.6%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 29-45
Gender Female, 50.2%
Confused 49.5%
Happy 49.5%
Surprised 49.6%
Calm 50.2%
Angry 49.6%
Sad 49.6%
Disgusted 49.6%

AWS Rekognition

Age 16-27
Gender Male, 50.1%
Angry 49.5%
Disgusted 49.5%
Sad 49.5%
Calm 50.4%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

Feature analysis

Amazon

Person 96.9%
Poster 85.2%
Painting 83.6%

Captions

Microsoft
created on 2019-06-05

a vintage photo of a person 50.2%
a vintage photo of some people 44.6%
a vintage photo of a person 44.5%

Text analysis

Amazon

CHORAL
SOCIETY
OUR CHORAL SOCIETY
OUR
SEROIS
BOOIRS
CVEERAYKIIIKG.
TTEE
RRONAONG
BOOIRS IE TTEE
GOD
RRONAONG TBRRMXORS. SEROIS nGs
STS. GOD US CVEERAYKIIIKG.
STS.
TBRRMXORS.
IE
US
nGs

Google

S IS TRSIES ROISISG BROOKS, STOAES 1B0OKS UA THE SERMOSS Is D GOOD S VEY TK G. OUR CHORAL SOCIETY
S
ROISISG
BROOKS,
UA
THE
Is
VEY
G.
SOCIETY
IS
TRSIES
STOAES
1B0OKS
SERMOSS
D
GOOD
TK
OUR
CHORAL