| Author: | Wang, Defeng |
| Title: | Modular structured learning : an integrated framework and its applications |
| Degree: | Ph.D. |
| Year: | 2006 |
| Subject: | Hong Kong Polytechnic University -- Dissertations Instructional systems Pattern perception -- Mathematical models Machine learning Computer-assisted instruction |
| Department: | Department of Computing |
| Pages: | xvii, 163 leaves : ill. ; 30 cm |
| Language: | English |
| Abstract: | A new perspective to review the existing learning models by considering their structureness is proposed in this thesis. The performance of the learning models could be improved if the modular structure in the data is utilized in a proper way; we name it as the modular structured learning. This thesis mainly concerns incorporating data structures in the SVM and its extensions, although this philosophy is applicable in designing various supervised and unsupervised learning models. Guided by this general idea, several modular structured counterparts of the SVM and its extensions have been constructed. Firstly, the structured large margin machine (SLMM) is introduced as a modular structured large margin learning model. The modular data structure is extracted by ag-glomerative hierarchical clustering and the optimization problem is solved by converting to a sequential second order cone programming (SOCP) problem. SLMM possesses appealing features such as high classification accuracy, scalability, extensibility, and noise tolerance. Secondly, the probabilistic large margin machine (PLMM) is another modular structured large margin model by integrating the prior probabilities into the decision hyperplane calculation. We also propose an extended PLMM that is robust to estimation errors. The optimization problem involved in the PLMM can be treated as one SOCP problem, which can be solved efficiently. Thirdly, structured one-class classifier (TOCC) is designed to consider the data structure into solving one-class classification problems. TOCC is able to describe modular structured target data, so that the chance of outlier occurrence inside the boundary can be reduced. Fourthly, we construct a generic type of modular structured kernel functions, i.e., weighted Mahalanobis distance (WMD) kernels, by incorporating data specific knowledge into existing kernels. In WMD kernels, the similarity between two pattern images is determined by the Mahalanobis distance between their corresponding input patterns as well as the sizes of the clusters they reside in. Aside from testing on the benchmark datasets, the proposed modular structured learning models have been applied on two medical applications: automatic detection of breast cancers in mammograms and the functional MRI activation analysis. Experimental results show the success of using the modular structured learning approaches in solving real world problems. |
| Rights: | All rights reserved |
| Access: | restricted access |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| b20696991.pdf | For All Users (off-campus access for PolyU Staff & Students only) | 2.83 MB | Adobe PDF | View/Open |
Copyright Undertaking
As a bona fide Library user, I declare that:
- I will abide by the rules and legal ordinances governing copyright regarding the use of the Database.
- I will use the Database for the purpose of my research or private study only and not for circulation or further reproduction or any other purpose.
- I agree to indemnify and hold the University harmless from and against any loss, damage, cost, liability or expenses arising from copyright infringement or unauthorized usage.
By downloading any item(s) listed above, you acknowledge that you have read and understood the copyright undertaking as stated above, and agree to be bound by all of its terms.
Please use this identifier to cite or link to this item:
https://theses.lib.polyu.edu.hk/handle/200/3040