Moral Change or Noise? On Problems of Aligning AI with Temporally Unstable Human Feedback
Identification
- Clé publique
- radar:r-d8fd57277adc9467f96dc77fdd9c81e5
- Auteurs
- Vijay Keswani · Cyrus Cousins · Breanna K. Nguyen · Vincent Conitzer · Hoda Heidari · Jana Schaich Borg · Walter P. Sinnott-Armstrong
- Année déclarée
- 2026
- Langue déclarée
- en
- Type source
- conference-paper
- Première détection
- 2026-11-13T12:50:28.967527+00:00
- Dernière observation des métadonnées
- 2026-11-13T12:50:28.967527+00:00
- Dernière vérification HTTP
- Non effectuée
Institutions déclarées par la source
Duke University · Carnegie Mellon University
Pays d’affiliation déclarés
US
Résumé documentaire — langue originale
Alignment methods in moral domains seek to elicit moral preferences of human stakeholders and incorporate them into AI. This presupposes moral preferences as static targets, but such preferences often evolve over time. Proper alignment of AI to dynamic human preferences should ideally account for "legitimate" changes to moral reasoning, while ignoring changes related to attention deficits, cognitive biases, or other arbitrary factors. However, common AI alignment approaches largely neglect temporal changes in preferences, posing serious challenges to proper alignment, especially in high-stakes applications of AI, e.g., in healthcare domains, where misalignment can jeopardize the trustworthiness of the system and yield serious individual and societal harms. This work investigates the extent to which people's moral preferences change over time, and the impact of such changes on AI alignment. Our study is grounded in the kidney allocation domain, where we elicit responses to pairwise comparisons of hypothetical kidney transplant patients from over 400 participants across 3-5 sessions. We find that, on average, participants change their response to the same scenario presented at different times around 6-20% of the time (exhibiting "response instability"). Additionally, we observe significant shifts in several participants' retrofitted decision-making models over time (capturing "model instability"). Predictive performance of simple AI models decreases as a function of both response and model instability. Moreover, predictive performance diminishes over time, highlighting the importance of accounting for temporal changes in preferences during training. These findings raise fundamental normative and technical challenges relevant to AI alignment, highlighting the need to better understand the object of alignment (what to align to) when user preferences change significantly over time, including the mechanisms underlying these changes.
Identifiants
- OPENALEX
- https://openalex.org/W7139098003
- DOI
- 10.1609/aaai.v40i44.41083
Repères documentaires
- Famille documentaire
- unknown
- Types déclarés par les sources
- conference-paper
- Éditeurs
- Association for the Advancement of Artificial Intelligence
Les mentions d’entités ne constituent pas une preuve de reconnaissance juridique. La juridiction étudiée est distincte du pays d’affiliation des auteurs.
Sources
OpenAlex · Document 1
Citer cette référence
Vijay Keswani; Cyrus Cousins; Breanna K. Nguyen; Vincent Conitzer; Hoda Heidari; Jana Schaich Borg; Walter P. Sinnott-Armstrong. Moral Change or Noise? On Problems of Aligning AI with Temporally Unstable Human Feedback. 2026. https://doi.org/10.1609/aaai.v40i44.41083
JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·
APA, Chicago, ISO 690 : formats bibliographiques fondés sur les champs disponibles. OSCOLA / Bluebook : données structurées uniquement ; aucune conformité juridique complète n’est revendiquée sans vérification des éléments nécessaires.
- APA
- Vijay Keswani; Cyrus Cousins; Breanna K. Nguyen; Vincent Conitzer; Hoda Heidari; Jana Schaich Borg; Walter P. Sinnott-Armstrong. (2026). Moral Change or Noise? On Problems of Aligning AI with Temporally Unstable Human Feedback. https://doi.org/10.1609/aaai.v40i44.41083
- Chicago
- Vijay Keswani; Cyrus Cousins; Breanna K. Nguyen; Vincent Conitzer; Hoda Heidari; Jana Schaich Borg; Walter P. Sinnott-Armstrong. Moral Change or Noise? On Problems of Aligning AI with Temporally Unstable Human Feedback. 2026. https://doi.org/10.1609/aaai.v40i44.41083
- ISO 690
- Vijay Keswani; Cyrus Cousins; Breanna K. Nguyen; Vincent Conitzer; Hoda Heidari; Jana Schaich Borg; Walter P. Sinnott-Armstrong. Moral Change or Noise? On Problems of Aligning AI with Temporally Unstable Human Feedback. 2026. https://doi.org/10.1609/aaai.v40i44.41083
Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31
UDTR — Bibliothèque juridique mondiale des droits de la Nature. Moral Change or Noise? On Problems of Aligning AI with Temporally Unstable Human Feedback. Notice documentaire: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-d8fd57277adc9467f96dc77fdd9c81e5/ · Dernière vérification HTTP : non effectuée
Données de cette version figée
Dossiers et relations documentaires
Rôles des sources
Source bibliographique / publication d’origine · https://doi.org/10.1609/aaai.v40i44.41083
Un lien vers une autorité ne prouve pas à lui seul une affirmation juridique. Les résumés et les textes intégraux restent soumis aux conditions de leur source.
Statut documentaire
Pertinence à examiner
Bibliothèque
Cette identité n’est pas encore intégrée à la Bibliothèque juridique.