ÿþ<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv=Content-Type content="text/html; charset=unicode"> <meta name=ProgId content=Word.Document> <meta name=Generator content="Microsoft Word 10"> <meta name=Originator content="Microsoft Word 10"> <link rel=File-List href="July01-2003_files/filelist.xml"> <link rel=Edit-Time-Data href="July01-2003_files/editdata.mso"> <!--[if !mso]> <style> v\:* {behavior:url(#default#VML);} o\:* {behavior:url(#default#VML);} w\:* {behavior:url(#default#VML);} .shape {behavior:url(#default#VML);} </style> <![endif]--> <title>Seminar: July 09, 2002</title> <!--[if gte mso 9]><xml> <o:DocumentProperties> <o:Author>Dide Ergüven</o:Author> <o:LastAuthor>Dide Ergüven</o:LastAuthor> <o:Revision>3</o:Revision> <o:TotalTime>1</o:TotalTime> <o:Created>2003-05-20T13:13:00Z</o:Created> <o:LastSaved>2003-05-20T13:40:00Z</o:LastSaved> <o:Pages>1</o:Pages> <o:Words>283</o:Words> <o:Characters>1618</o:Characters> <o:Company>Bilkent Üniversitesi</o:Company> <o:Lines>13</o:Lines> <o:Paragraphs>3</o:Paragraphs> <o:CharactersWithSpaces>1898</o:CharactersWithSpaces> <o:Version>10.2625</o:Version> </o:DocumentProperties> </xml><![endif]--><!--[if gte mso 9]><xml> <w:WordDocument> <w:SpellingState>Clean</w:SpellingState> <w:GrammarState>Clean</w:GrammarState> <w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel> </w:WordDocument> </xml><![endif]--> <style> <!--a:link {font-weight: Regular;} a:visited {font-weight: Regular;} a:active {font-weight: Regular;} A:hover { color: #A0A0A0 } h2 {FONT-FACE: Bold;} /* Font Definitions */ @font-face {font-family:Verdana; panose-1:2 11 6 4 3 5 4 4 2 4; mso-font-charset:162; mso-generic-font-family:swiss; mso-font-pitch:variable; mso-font-signature:536871559 0 0 0 415 0;} @font-face {font-family:"Trebuchet MS"; panose-1:2 11 6 3 2 2 2 2 2 4; mso-font-charset:162; mso-generic-font-family:swiss; mso-font-pitch:variable; mso-font-signature:647 0 0 0 159 0;} @font-face {font-family:"Century Gothic"; panose-1:2 11 5 2 2 2 2 2 2 4; mso-font-charset:162; mso-generic-font-family:swiss; mso-font-pitch:variable; mso-font-signature:647 0 0 0 159 0;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {mso-style-parent:""; margin:0cm; margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:"Times New Roman"; mso-fareast-font-family:"Times New Roman"; color:black;} h2 {mso-margin-top-alt:auto; margin-right:0cm; mso-margin-bottom-alt:auto; margin-left:0cm; mso-pagination:widow-orphan; mso-outline-level:2; font-size:12.0pt; font-family:Verdana; color:black; font-weight:bold;} h3 {mso-margin-top-alt:auto; margin-right:0cm; mso-margin-bottom-alt:auto; margin-left:0cm; mso-pagination:widow-orphan; mso-outline-level:3; font-size:13.5pt; font-family:"Times New Roman"; color:black; font-weight:bold;} a:link, span.MsoHyperlink {color:blue; mso-text-animation:none; text-decoration:none; text-underline:none; text-decoration:none; text-line-through:none;} a:visited, span.MsoHyperlinkFollowed {color:blue; mso-text-animation:none; text-decoration:none; text-underline:none; text-decoration:none; text-line-through:none;} p {mso-margin-top-alt:auto; margin-right:0cm; mso-margin-bottom-alt:auto; margin-left:0cm; mso-pagination:widow-orphan; font-size:12.0pt; font-family:"Times New Roman"; mso-fareast-font-family:"Times New Roman"; color:black;} span.SpellE {mso-style-name:""; mso-spl-e:yes;} @page Section1 {size:612.0pt 792.0pt; margin:70.85pt 70.85pt 70.85pt 70.85pt; mso-header-margin:35.4pt; mso-footer-margin:35.4pt; mso-paper-source:0;} div.Section1 {page:Section1;} --> </style> <!--[if gte mso 10]> <style> /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-parent:""; mso-padding-alt:0cm 5.4pt 0cm 5.4pt; mso-para-margin:0cm; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:10.0pt; font-family:"Times New Roman";} </style> <![endif]--><!--[if gte mso 9]><xml> <o:shapedefaults v:ext="edit" spidmax="3074"/> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext="edit"> <o:idmap v:ext="edit" data="1"/> </o:shapelayout></xml><![endif]--> </head> <body bgcolor=white lang=EN-US link=blue vlink=blue style='tab-interval:36.0pt'> <div class=Section1> <p class=MsoNormal> <link rev=made href="mailto:guvenir@cs.bilkent.edu.tr"> <span style='font-family:Arial'><a href="http://www.bilkent.edu.tr" title="Bilkent Üniversitesi"><span style='font-size:13.5pt;color:navy'><!-- OWNER_INFO="Bilkent University, Department of Computer Engineering -->Bilkent University</span></a><br> <a href="http://www.cs.bilkent.edu.tr" title="Bilgisayar Mühendislii Bölümü"><span style='font-size:13.5pt;color:red'>Department of Computer Engineering</span></a> <o:p></o:p></span></p> <div class=MsoNormal align=center style='text-align:center'><span style='font-family:Arial'> <hr size=2 width="100%" noshade color=navy align=center> </span></div> <p class=MsoNormal align=center style='text-align:center'><b><span style='font-size:13.5pt;font-family:"Century Gothic";mso-bidi-font-family:Arial; color:#007744'>S E M I N A R</span></b><span style='font-family:"Century Gothic"; mso-bidi-font-family:Arial'> <o:p></o:p></span></p> <h2 align=center style='text-align:center'><span style='font-size:18.0pt; font-family:"Century Gothic";mso-bidi-font-family:Arial;color:navy;font-weight: normal'>Making a multilayer perceptron say, &quot;don't know&quot; when it should. </span><span style='mso-bidi-font-family:Arial'><o:p></o:p></span></h2> <p align=center style='text-align:center'><span style='font-family:"Century Gothic"; mso-bidi-font-family:Arial'>&nbsp;<o:p></o:p></span></p> <h3 align=center style='text-align:center'><span style='font-family:"Century Gothic"'>Prof. <span class=SpellE>Nikhil</span> R. Pal, Ph. D.<o:p></o:p></span></h3> <p align=center style='text-align:center'><span style='font-size:13.5pt; font-family:"Century Gothic";mso-bidi-font-family:Arial;color:gray'>Indian Statistical Institute <o:p></o:p></span></p> <p align=center style='text-align:center'><b><span style='font-size:10.0pt; font-family:"Century Gothic";mso-bidi-font-family:Arial;color:gray'>&nbsp;<o:p></o:p></span></b></p> <p align=center style='text-align:center'><span style='font-family:"Century Gothic"; mso-bidi-font-family:Arial'>&nbsp;<o:p></o:p></span></p> <p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'><span style='font-family:"Trebuchet MS"'>The response of a multilayered perceptron network (MLP) on points which are far away from the boundary of its training data is generally not reliable. Unfortunately, this issue is ignored in the literature. Ideally a network should not respond to a data point which lies far away from the boundary of its training data. This strange behavior of MLP type network could be disastrous in many critical applications areas such medical, defence, mining and ..... We propose a new training scheme for MLPs as classifiers, which ensures a well behaved generalization. Our scheme involves training subnets for each class present in the training data. Training each subnet requires data from the class which the subnet represents along with some points outside the &quot;boundary&quot; of that class. For this purpose we propose an easy but approximate method to generate points outside the boundary of a pattern class. The trained subnets are then merged to solve the multi-class classification problem. We show through simulations that an MLP trained by our method does not respond to points which lie outside the boundary of its training sample. Unlike conventional training schemes, our approach can properly deal with OVERLAPPED classes giving a better insight into the data. In addition, this scheme enables incremental training of an MLP, i.e. the MLP can learn new knowledge without forgetting the old knowledge. <span class=SpellE>perceptron</span> type networks while the second method is for radial basis function type network. </span></p> <p><span style='font-family:Verdana;mso-bidi-font-family:Arial'><br> &nbsp;</span><span style='font-family:Arial'><o:p></o:p></span></p> <p><b><span style='font-family:Arial;color:red'>DATE:</span></b><b><span style='font-family:Arial'> July 01, 2003, Tuesday @ 14:30 <br> </span></b><b><span style='font-family:Arial;color:red'>PLACE:</span></b><b><span style='font-family:Arial'> EA-409</span></b><span style='font-family:Arial'><o:p></o:p></span></p> </div> </body> </html>