Increasing digitalization and the increased use of artificial intelligence are leading to automated decision-making processes in numerous areas. While such processes enable efficiency gains and technological innovations, they also raise fundamental ethical questions and liability uncertainties. A precise analysis of the allocation of responsibility and the necessary safety standards is required, particularly in view of the provisions of the AI Act, which came into force on February 2, 2025.
As an IT lawyer and self-confessed AI nerd, I follow developments in this area with great interest – not only from a technical perspective, but above all from a legal one. The fascination for the technology is not only evident in the application of simple generative AI for text creation, but also in the complex systems used, for example, in the automated audit logic of insurance companies, in the evaluation of the truthfulness of statements, or in dynamic pricing in online retail. In these fields, different prices and even conditions for returns can be set depending on user behavior or regional characteristics, which raises a variety of ethical and liability issues.
These developments once again highlight the tension between technological innovation and legal responsibility. The challenge lies in ensuring the transparency and traceability of decision-making processes, while not unnecessarily restricting the scope for essential entrepreneurial innovation. The AI Act, in force since February 2, 2025, sets clear legal standards with requirements for risk management, conformity assessment, and human oversight (see Art. 9 ff. AI Act).
As a practicing IT lawyer, it is a personal concern to not only theoretically illuminate the legal implications of these developments, but also to address them in a practice-oriented manner. The aim is to combine technological progress with appropriate protection for those affected and a clear allocation of liability – a challenge that is both technically and legally demanding. This complex topic requires a critical and differentiated approach to pave the way for future-proof regulation and the legally compliant use of AI systems.
Ethical Issues in Automated Decision-Making
Automated systems make decisions that can have a direct impact on individuals and companies. Key ethical aspects include, in particular:
- Transparency and Traceability: The often high complexity of underlying algorithms makes it difficult to fully trace decision-making processes. Comprehensive technical and organizational measures are thus necessary to ensure traceable documentation of these processes.
- Fairness and Non-discrimination: Distortions in the data used can lead to systematic discrimination. Compliance with the principle of equal treatment requires appropriate precautions to guarantee non-discriminatory decisions.
- Responsibility and Human Control: Despite increasing automation, the ultimate responsibility for decisions made must remain with human operators. Ensuring effective human supervision is essential to detect errors early and take corrective action.
The principles formulated in the “Ethics Guidelines for Trustworthy AI” – particularly transparency, robustness, and fairness – are increasingly being incorporated into legal discussions surrounding the use of AI.
Regulatory Framework: The AI Act
In force since February 2, 2025, the AI Act introduces the first regulations for the use of artificial intelligence within the European Union. This Act creates a uniform legal framework and differentiates AI systems based on risk categories. High-risk systems, in particular, are subject to strict requirements, which include the following aspects:
- Risk Management and Conformity Assessment: Providers are obliged to implement a comprehensive risk management system and demonstrate the conformity of their systems (see Art. 9 ff. AI Act).
- Transparency and Documentation Obligations: Detailed technical documentation is required, along with an obligation to inform data subjects about the functioning of AI systems. This ensures the traceability of automated decision-making processes.
- Human Oversight: The AI Act mandates that automated decision-making processes always remain under the control of a responsible natural person, allowing for interventions and corrections.
These regulations aim to minimize the risk of incorrect or non-transparent decisions and to clarify the allocation of liability in the event of damage.
Liability Risks with Automated Decisions
The lack of transparency and complexity inherent in AI systems make it challenging to clearly assign liability claims when incorrect decisions occur. From a liability law perspective, the following aspects are particularly important:
- Attribution of Responsibility: General tort law, especially Section 823 of the German Civil Code (BGB), typically provides a framework for claims for damages. However, proving an adequate causal link between AI use and the damage caused is often problematic.
- Product Liability and Operator Liability: The applicability of traditional product liability to AI systems is a subject of controversial debate in legal literature. Existing liability regulations, such as those under the Product Liability Directive, often reach their limits given the unique characteristics of AI applications.
- Ethical Dimension of Liability: Beyond the purely legal allocation of responsibility, discussions also revolve around the extent to which ethical deficits – such as a lack of transparency or inadequate risk management – can justify extended liability.
Legal Opinions and Future Developments
The legal discussion on liability issues concerning automated decision-making processes is controversial. While some experts advocate adapting existing liability regulations, others propose a differentiated approach that accounts for the specific nature of AI systems. Key viewpoints include:
- The need to reform liability law in light of the increasing complexity and self-learning mechanisms of AI applications.
- The integration of technical security measures into a holistic risk management system, considering both technical and legal requirements.
- A gradual further development of case law to enable a more precise allocation of liability in cases of algorithmically induced wrong decisions in the future.
Conclusion
Automated decision-making processes offer significant opportunities but also present considerable ethical and liability risks. The AI Act, effective since February 2, 2025, enhances the transparency and traceability of these systems and clarifies liability allocation in case of damage. Despite this, practical implementation remains a challenge, necessitating continuous refinement of the legal framework. Balancing ethical principles with liability law requirements is crucial for navigating our increasingly digitalized world.