The idea is not completely insane, but you'd have to do a LOT of work, possibly including reimplementing the language. You might look at some of the Lisp Machine publications for inspiration and an idea of what you'd be getting yourself into.