You don't need a degree to learn to program. What you do need is logic, at least a bit of discipline, plus a willingness to use the math that you should have learned in high school.
Is it easy? That depends on you. Some people get it right away, others have to work at it. Some never seem to get it. I frequently compare programming to playing a musical instrument. Mozart learned to play piano (clavier, actually) by 5, well enough to begin composing his own pieces. That's no indication of how much time and work it will take someone else to learn to play.
Half of the programmers I know personally don't have degrees in computer science. Most of them have degrees in something else. Physics majors tend to do well, as do engineers and mathematicians. Oddly, instrumental musicians tend to well, at least among my acquaintances. One of my friends was a psychology major, but recovered sufficiently enough to work a full career programming business applications.
That said, getting a programming job without a degree has always been a "well, maybe" proposition. Some firms wouldn't have given Bill Gates an interview for an internship, on that basis alone. (Gates dropped out to work on software for what would become Microsoft.) It's especially tough at the entry level, but even with years of paid experience many companies won't even look at an applicant without at least a bachelor's degree.