I have a custom application in Salesforce classic. Will I need to build a component from scratch to move it to Lightning? If we have a Visualforce page, how easy is it to convert to lightning component?

You can easily embed a visualforce page in a lightning component and Visualforce page will work fine in any Lightning environment with some code changes.