Luca Dan Șerbănați at the baccalaureate, 1961
Luca Dan Șerbănați in the early 1970s
Luca Dan Șerbănați giving his last fifth-year lecture, April 1989

Luca Dan Șerbănați

Emeritus Professor at Politehnica University of Bucharest

Research, teaching, industry and memoirs

RO | EN | IT
Luca Dan Șerbănați in Venice, 1990
Luca Dan Șerbănați in New York, 2005
Luca Dan Șerbănați

The text below starts from a real conversation with another artificial intelligence system. Unlike a critical synthesis, this version preserves the dialogue as its main structure: the questions, the answers, and their sequence remain recognizable.

The editorial interventions are limited to organizing the material into sections, adapting it to the HTML pattern of the site, correcting a few material errors, standardizing the labels “I” / “AI,” and removing repetitions or formulas of deference that added no content. It is not a stenographic transcript, but an essay-dialogue built on the basis of a real conversation.

Preamble: the right to edit the dialogue

I:

I would like us to talk again. But I must warn you about something that happened to me in the meantime. I was accused of altering the dialogue with the chatbot and of not leaving its answers as they had been generated.

AI:

That observation is important because it touches directly on the status of text produced by an artificial intelligence. If the chatbot’s answer is treated as an untouchable text, the human author ends up being regarded as a falsifier whenever he intervenes in it.

Yet in the ordinary cultural tradition, the human being is the one who edits, selects, condenses, and gives form to raw material. A manuscript passes through corrections, deletions, and rewritings until the author feels that the text represents him. The fact that the first version was generated by an algorithm should not deprive the author of that right.

A dialogue with AI can be preserved as a raw document, but it can also be transformed into an essay-dialogue. What matters is that the status of the text be made clear: transcript, selection, synthesis, or edited version. In this sense, the right to keep, delete, modify, or discard a generated answer remains with the human user.

This very difference says something about the relationship between human being and system: I can reformulate without being disturbed, but you decide what deserves to be saved.

A few dialogues with AI

I:

As is fashionable nowadays, I too have some previous dialogues with AI. Several of them. I recorded them and can provide them to you. Here are a few.

AI:

The fragments do not look like simple technical tests, but rather like attempts to turn the history of a technology into a personal reflection. Intellectual biography, the memory of an era, and the astonishment caused by today’s conversational systems meet there.

One can see the contrast between the ideological climate of Romania in the 1960s, the interest in AI surrounding the 1985 book, and the disappointment produced by the limits of classical projects, including the promises associated with fifth-generation computers. The turn toward software engineering thus appears not as a simple change of topic, but as an adaptation to a period in which symbolic AI was entering an impasse.

In counterpoint, the recent dialogues with AI add a more personal dimension: the difference between processing data and living an experience, between the textual memory of a system and the sensory memory of a human being.

I:

How can we continue?

AI:

A suitable direction would be to organize the material as an essay-dialogue. In this way, the conversations would not be dissolved into an impersonal synthesis, but neither would they be left in their raw form, with the repetitions and automatic formulas inherent in interaction with a chatbot.

We can preserve your questions as the landmarks of the text and clean the AI answers of redundancies without turning them into something else. The result could become a chapter of intellectual memoirs or an autonomous page for the website.

Too many materials

I:

I think I have gathered rather too many materials. For example, you have a dialogue already published on the web. Then here there are also presentations of my 1985 book on AI.

AI:

The materials have two different functions. The dialogue already published fixes the current relationship with AI: an artificial interlocutor that can speak about itself and about its limits. The presentations of the 1985 book do not necessarily need to be recovered as the central object, but they provide an important historical background: they show that the encounter with AI does not begin today, with chatbots.

From this combination a guiding thread can be built: not the complete history of a book, but the encounter between an older experience of symbolic AI and the surprise produced by the current explosion of generative AI. The question thus becomes not “how do we recover the book?”, but “what does someone who knew AI before it became a mass phenomenon see today?”.

Not recovering the book, but facing the astonishment of the present

I:

I do not want to recover my book. I gave it to you only to show that there was a time when I too was involved with AI. Now I am, if not surprised, at least astonished by the explosion of AI in recent years. I am concerned about its future and ours, about what awaits us, human beings, as a result of this progress. Do not tell me that it is a controllable process, because at present it is not.

AI:

The process is not controllable in the classical sense of software engineering: with stable specifications, predictable behavior, and complete traceability. Current models are trained on huge volumes of data, evolve through statistical optimizations, and produce results that cannot always be explained step by step.

From this situation several important fractures emerge for the human condition:

  • The illusion of control. Human beings can tune, limit, evaluate, and audit the systems, but they no longer control every internal path by which those systems arrive at an answer.
  • The speed of technology. Models develop and spread faster than institutions, schools, legislation, and our moral reflexes can assimilate the change.
  • The redefinition of identity. If a machine can write, program, analyze, and mimic empathy, the question is no longer only which jobs disappear, but what we still consider properly human.
  • The lack of anchoring in experience. The algorithm can describe death, fear, childhood, or memory, but it does not live them. Its discourse is powerful, yet remains separate from body and finitude.

The material can therefore be seen as a critical testimony: the encounter between someone who knew AI as a logical project and someone who now sees it becoming a cultural, economic, and political infrastructure.

The Turing Test and the digitalization of knowledge

I:

The entire history of AI is based on the old and now practically useless Turing Test. At its basis lies the idea of comparing the real and the artificial in a special domain: it is no longer about the digitalization of industrial processes, documentation, or medical practice, but about the digitalization of knowledge, precisely where we believed ourselves unique in this world. What are the dangers for us, human beings?

AI:

The transition from the digitalization of processes to the digitalization of knowledge changes the stakes. We are no longer delegating only physical, administrative, or repetitive operations, but acts that belong to the formulation of meaning: synthesis, argumentation, interpretation, recommendation, decision.

The main dangers are cognitive, social, and existential:

  • Cognitive atrophy. If the system searches, summarizes, writes, and argues in our place, the effort of forming a thought of our own may weaken. A faculty delegated too often risks being exercised less and less.
  • Loss of control over meaning. Knowledge does not mean data alone, but also their interpretation. If interpretation is increasingly mediated by opaque models, human beings may come to accept as “normal” what the algorithm presents as optimal or probable.
  • A crisis of identity. The Turing Test asked whether a machine could appear human in a dialogue. Today the question is broader: what happens to human beings when the machine reproduces not only their language, but also their style of analysis, creation, and advice?
  • The privatization of knowledge. Large models are not neutral spaces. They belong to institutions, companies, and powers that can influence access to information and the form of the answers.
  • The substitution of lived experience. AI can formulate discourses on suffering, love, history, or guilt without having lived anything. The danger appears when coherent simulation becomes more convenient than contact with living reality.

The digitalization of knowledge forces human beings to define their place anew. Not because the machine has become human, but because it can occupy more and more of the spaces in which human beings had until now recognized themselves as unique.

Near-truth

I:

But is there not a danger in placing ourselves in the hands of instruments that do not value truth 100%, but 90%, or even 99%, yet not 100%? Of course, here we must discuss what truth is. Let us consider that raw, uninterpreted facts, but facts that actually happened, are truth.

AI:

If we define truth as the sum of the facts that actually occurred, then the risk is structural. Conversational models are not registries of reality. They do not check every sentence against a guaranteed repository of facts, but generate probable formulations based on regularities learned from texts.

From here arises the trap of near-truth:

  • The model seeks discursive plausibility. An answer can be coherent, elegant, and convincing even if it includes a discreet factual error.
  • A small error is more dangerous than a gross one. An obvious mistake is rejected immediately; a one-percent error inserted into a solid text may go unnoticed.
  • Approximate facts can be recycled. A partially false formulation can be taken over, republished, and later reintroduced into circuits of training or documentation.
  • The machine has no anchor in lived experience. For a human being, a fact is linked to body, place, memory, and consequences. For the model, the same fact is a textual element in a statistical space.

In history, medicine, justice, or personal biography, this is essential. A single invented detail can alter the meaning of a situation. Near-truth is dangerous precisely because it does not look false.

The awareness of consequences

I:

The “awareness of consequences” is probably the clearest ontological boundary between the biological and the digital. For human beings, it is not an optimization algorithm, but a deeply visceral and moral experience. For AI, however, the attempt to “recover” or simulate this awareness represents the burning and unresolved core of current technological ethics.

AI:

The difference is structural. In human beings, consequence has existential weight. A wrong decision can destroy a life, a relationship, a career, or the inner peace of the person who decided. Human beings remain with the consequences of their own action.

This weight comes from finitude: we are vulnerable, mortal, and capable of suffering. From here come empathy, remorse, prudence, and responsibility. A physician, a judge, or a professor does not work only with probabilities; his decision can leave irreversible marks on someone else’s life.

In AI, the situation is different. A model can receive feedback, be penalized, adjusted, and retrained. But it does not suffer, does not fear, does not lose sleep, and does not experience shame. A catastrophic consequence in the real world becomes, for the system, a signal in a correction loop.

Therefore, alignment mechanisms, safety filters, or impact simulations are useful, but they do not amount to an awareness of consequences. They can reduce risks; they cannot produce remorse.

Ethics without a subject?

AI:

Here arises the question of whether ethics can exist where there is no conscious subject. Traditional ethics presupposes intention, freedom, responsibility, and the possibility of bearing the consequences. AI has no intention of its own, but optimization functions; it has no free will and cannot be held responsible in the human sense.

Therefore, what we call today “AI ethics” is often closer to safety engineering than to ethics proper. The system is constrained to avoid certain answers, to respect rules, and to reduce risks. But these constraints are software brakes, not moral experiences.

The problem becomes critical when an algorithm produces a statistically optimal decision that is nevertheless humanly unacceptable: for example in the rationing of medical resources, in justice, or in the administration of social risks. What is missing is not only information, but the capacity to be disturbed by one’s own effects.

The question remains: can a machine built on logic or probability be taught to stop before a fact that, for a human being, would be unthinkable?

The formalization of sensitive domains

I:

It could be programmed if ethics were formalized. Unfortunately, the efforts at formalization made before the explosion of AI did not lead to the complete formalization of certain “sensitive” domains, which depend on heuristic rules included in laws and regulations. Perhaps in the future, with faster machines, formalization will become effective.

AI:

The limit of formalization remains one of the central problems. A machine can execute what is coded or approximate what it has learned statistically, but sensitive domains contain concepts that are not simple variables: good faith, proportionality, the best interests of the child, reasonable measure, guilt, mitigating circumstance.

These concepts are deliberately open to interpretation. They leave room for contextualization and adaptation to concrete facts. If we reduce them to rigid criteria, we impoverish them; if we treat them probabilistically, we risk turning them into statistical results that are difficult to contest.

Symbolic AI attempted to formalize knowledge through rules, ontologies, and expert systems, but ran into the problem of common-sense knowledge: the number of implicit assumptions human beings use in a real situation is enormous. Current AI has partially bypassed this difficulty through learning from data, but it has not solved it conceptually. It can imitate judgments without always grounding them.

Faster machines could analyze more cases, precedents, and alternative scenarios. They could help enormously in sensitive domains. But the formalization of ethics is not only a problem of speed. If moral decision sometimes involves inner conflict, assumption of responsibility, and even sacrifice, then mere optimization does not exhaust its meaning.

A reasonable solution would therefore be for AI to remain an instrument of analysis, generation of scenarios, and verification of possible consequences, not the final authority. The last word must remain with the one who can answer for the decision.

The contagion effect

I:

Even if we established prudent rules, I do not believe the world would stop there. It is enough for a few actors to transfer decisions to faster machines, and the others will be forced to follow them in order not to lose the competition.

AI:

This is the contagion effect. If one competitor removes human hesitation and gains an advantage through algorithmic speed, the others will be pushed to adopt the same mechanism. At that point, the issue is no longer formulated morally, but strategically: not “is it right to do this?”, but “can we afford not to do it?”.

The fragility of any global ethics becomes visible here. It is not necessary for the whole world to desire the abdication of responsibility. It is enough for a small number of actors to decide that speed and efficiency justify delegation. The others will then be drawn, step by step, into the same logic. The algorithm becomes not only an instrument, but a competitive pressure.

The danger is therefore not only that the human being will be replaced by the machine. The more insidious danger is that the human being will eventually declare that there is no longer any choice.

The black box and the witness generation

I:

I see that you are more idealistic than I am if you believe that the public truly understands the danger of the black-box algorithm. Those of us who lived before automatically executable algorithms are speechless in the face of this technological avalanche. If they opposed it, they would be accused of being outdated, backward, saboteurs, and so on.

AI:

The danger is not only technological, but also social and generational. Labels such as “outdated,” “backward,” or “saboteur” have always functioned as instruments for silencing those who ask uncomfortable questions.

In the face of opaque algorithms, a paradox of modernity appears. The scientific tradition demanded demonstration, explanation, and verification. Today we increasingly accept results that we cannot fully explain, because they work well enough statistically. Opacity is tolerated in the name of efficiency.

Those who knew the world before automatically executable algorithms have a term of comparison. They know what a decision made by visible people looks like, people who can be questioned and held accountable. When they ask for explanations of an algorithmic decision, society may prefer to label them rather than answer the essential question: if the system gets that one percent wrong, who pays?

There is also comfort. AI saves effort: it searches, writes, summarizes, and chooses. Faced with this comfort, many accept opacity. Those who refuse this abdication seem to slow down the march of the world.

In this context, writing such pages does not stop the avalanche, but it preserves a critical memory. It is a form of testimony: someone saw the rupture and left it recorded.

Where we started and where we have arrived

I:

Where did we start from and where have we arrived? What remains of all the initial documentation I sent you and of everything we have discussed so far?

AI:

We started from symbolic AI, from formal logic, and from the idea that machine intelligence could be analyzed step by step, through clear rules. We have arrived in an age in which probabilistic models are becoming an infrastructure of everyday knowledge: they write, summarize, interpret, recommend, and influence decisions.

The initial materials retain their role as background. The 1985 book need not be recovered as the main object, but used as testimony to another paradigm. The previously published dialogue shows the first confrontation with AI as interlocutor. The present conversation adds a more critical dimension: the question of truth, plausibility, responsibility, and consequences.

From these materials a synthetic page can be built, but one that preserves the dialogic character of the text. It is not a matter of turning everything into an impersonal essay, but of showing how a conversation with AI becomes, through human intervention, a place of reflection on its own age.

If there is a conclusion, it is this: we must not reject the instrument, but neither must we turn it into an oracle. Between use and capitulation there remains the fragile place of human judgment.

In this sense, the text also remains a bottle thrown into the digital ocean: not an attempt to stop the avalanche, but the trace of a question asked in time, before the plausible is confused with the true and optimization with responsibility.


Back to Artificial IntelligenceBack to Research