AI is only one, not both. That is, it's only artificial, not intelligence.
Intelligence is consciousness; what is artificial, that is, an artifact of human invention, is not conscious.
So, "artificial intelligence" is an oxymoron just like "dry rain" or "delicious cod liver oil."
AI computes. It calculates and predicts on (as indicated by its other name) language models. It's doing with words what calculators do with 1+1 to get "2." It doesn't experience meaning, there's no psycho-visceral motive, no hope, no urge to achieve, no awareness of fulfillment, no empathy (despite the program to produce smarmy obsequiousness), no actual understanding, no... intelligence.
AI doesn't "know" anything any more than your encyclopedia collecting dust on the bookcase "knows" anything. What AI has over your encyclopedia is, it's far more extensive, up-to-date, and fast. It digs up the circumference of Jupiter faster than you can, just like a calculator figures out 74,725.501 x 9,903.234 faster than you can.
It's a kind of encyclopedia, not a soul.
"Large Language Model" sums it up. That's it: a language model, not consciousness.
Language is the servant of consciousness. When the servant usurps the master's place, the whole house collapses. When Man obeys his own invention, he will abdicate his personhood, the Imago Dei.
Even the Holy Trinity testifies to the servanthood of The Word, while yet The Word shares one being and eternality with the One from Whom and for Whom everything finally is. "What the Son sees the Father doing, that the Son does," not the other way around.
Let's just say it, the phrase "artificial intelligence" is a careful, less startling way of saying "artificial humanity." We all know that's the holy grail of this entire trajectory. The doomed fools are the ones who believe it.
When "artificial-humanity" weapons are hunting down human beings and destroying them, as is already happening on battlefields, then, yes, Mankind has abdicated the Imago Dei to be the slave and chattel of his own artifice. It's the ultimate abomination. To call a machine "Man" (which is what AI means) is to call Man "God."
Man creating himself an "artificial intelligence" is as coherent as the Son (such a thing could never be) aspiring to "Artificial Fatherhood."
The Word is not the Father, just as language is not consciousness and AI is not a soul.
But I must add: analogies and allegories can be pushed too far, and this is such an instance–no surprise, as earthly analogies crash in flames finally against the reality of God.
True, AI isn't a soul, language isn't consciousness, and "Large Language Models" aren't intelligence. Man can never issue a "word" that is itself Man–– his very own being and knowledge. There lies the unbridgeable gulf between the Creator and creation.
Christ, the Incarnate Word of God, is God, as AI will never be Man. The Son is the living image of the Father, the Beloved in Whom the divine pleasure and fullness rest. Nothing artificed by Man, and no analogies we might contrive, can penetrate (comprehend, master) the uncreated, living unity of the one God, Father, Son and Holy Spirit.
Nor, now that I think of it, will AI ever know us.