Glycosylation represents the most common of all known protein post-translational modifications. Carbohydrates can modulate the biological functions of a glycoprotein, protect a protein against hydrolysis via protease activity, and reduce or prevent aggregation of a protein. The determination of the carbohydrate structure and function in glycoproteins remains one of the most challenging tasks given to biochemists, as these molecules can exhibit complex branched structures that can differ in linkage and in the level of branching. In this review, we will present the approach followed in our laboratory for the elucidation of N- and O-glycan chains of glycoproteins. First, reduced/carboxamidomethylated glycoproteins are digested with a protease or a chemical reagent. N-Glycans are then released from the resulting peptides/glycopeptides via digestion with peptide N-glycosidase F (PNGase F). Oligosaccharides released by PNGase F are separated from peptides and glycopeptides using a C18 Sep-Pak, and their methylated derivatives are characterized by matrix-assisted laser desorption/ionization-time of flight mass spectrometry (MALDI-TOF-MS). O-Glycans are released by reductive elimination, which are permethylated, purified on a Sep-Pak C18 cartridge, and analyzed with MALDI-TOF-MS. Finally, to confirm the structures N-glycans released by PNGase F are characterized using MALDI-TOF-MS following on-plate sequential exoglycosidase digestions. The clean-up procedures of native and permethylated oligosaccharides for an efficient MALDI-TOF-MS analysis will also be described. This strategy was applied to calf fetuin and glycoproteins present in human serum.