I am fortunate to have the support of some truly wonderful people. First and foremost, I would like to thank my advisor Dr.Timothy Davis who has been an excellent mentor. I will be indebted to him forever for the trust he placed in me even before I started graduate studies and while doing this study. He has not only taught me technical nuances, but also helped me appreciate the beauty in everything from perfect software to poetry. I am grateful for his valuable advice, patience and for making me a better person. I would like to acknowledge Dr.Gene Golub who was in my PhD committee for his kind and encouraging words. He gave the motivation to solve the sparse singular value decomposition problem. I would also like to thank Dr.Alin Dobra, Dr....