Coleridge and Religion

When I first read, "The Eolian Harp", I thought that Coleridge was describing God's power as less than that of Nature's. But upon another look, I realized that the last stanza is filled with that narrator's exclamation of faith.
He is thanking his wife, Sara, "O beloved woman" for having thoughts and faith more collected than his own (50). She sets him straight when his mind wanders too much to "walk humbly with my God" (52). Previously in the poem, the narrator is indulging in thoughts of nature's power. He refers to his thoughts as "idle flitting phantasies" and wonders if "all of animated nature / Be but organic harps diversely framed" (40, 44 - 45). Instead of giving into these thoughts on nature, as Wordsworth would, Coleridge is brought back down to earth by his wife. And he curves his thoughts and refers to them as "vain Philosophy's aye-babbling spring" (57).
The reason as to why he stops these thoughts comes at the end when he claims that the only time he doesn't feel guilty when speaking of greater power like nature and God, is "when with awe / I praise him" (59 - 60).
I find this so interesting because it's as if he wants to appreciate nature and question it's power but doesn't want to overstep his bounds when it comes to religion. He is almost shoo-ing his questions and thoughts on the universe away to prove his complete faith in God, instead of really relating these thoughts to God.