Image processing is a field in which biometric traits such as Face, voice, lip movements, hand geometry, odour, gait, iris, retina, fingerprint etc., are essential for recognition. The face is the most critical biometric trait for recognition because the face is an easily approachable biometric trait. There is no need for attention from a human being for face recognition. Human face classification is a challenging task for a machine. In this project, minimum distance classifier used with LASSO based gender classification. Database of 100 images (50 male and 50 female face images which considered from 4 different databases) used for face recognition and classification. Original face image database used for the gender classification. This approach of dual classfication ((1) Recognizing or classfying human faces from various objects and (2) Classifying gender through face recognition) is made possible with the help of combining modified SIFT feature in combination with ridge regression (RR), elastic net (EN) and lasso regression with GSVM (LRGS) based classificatioins. The final classfication results with accuracy are as follows for RR- 89.6%, EN- 93.5%, LR-93.2% and propsed approach(LRGS) with 98.4% accurate detection rate with rediction names.