Pre-existing immune responses to seasonal endemic coronaviruses could have profound consequences for antibody responses to SARS-CoV-2, either induced in natural infection or through vaccination. Such consequences are well established in the influenza and flavivirus fields. A first step to establish whether pre-existing responses can impact SARS-CoV-2 infection is to understand the nature and extent of cross-reactivity in humans to coronaviruses. We compared serum antibody and memory B cell responses to coronavirus spike (S) proteins from pre-pandemic and SARS-CoV-2 convalescent donors using a series of binding and functional assays. We found weak evidence of pre-existing SARS-CoV-2 cross-reactive serum antibodies in pre-pandemic donors. However, we found stronger evidence of pre-existing cross-reactive memory B cells that were activated on SARS-CoV-2 infection. Monoclonal antibodies (mAbs) isolated from the donors showed varying degrees of cross-reactivity with betacoronaviruses, including SARS and endemic coronaviruses. None of the cross-reactive mAbs were neutralizing except for one that targeted the S2 subunit of the S protein. The results suggest that pre-existing immunity to endemic coronaviruses should be considered in evaluating antibody responses to SARS-CoV-2.