Machine Learning

Ethics, FAIR Data and Responsible AI

Dr. Iftikhar Ahmed
Ethics in AI
 Slide Source

Slides source is CS281: Ethics of Artificial

Intelligence by Carlos Guestrin, Stanford
University

©2022-2023 Carlos Guestrin

Are Emily and Greg More Employable than Lakisha and
Jamal? [Bertrand & Mullainathan ‘03]
 ML-based System for Recruiting

• Could decrease this bias...

• But could also amplify biases...

 ML-based System for Recruiting

https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
 The most challenging ethical
questions in AI involve nuanced
complex tradeoffs
Privacy and Surveillance

Nothing was your own except the few

cubic centimetres inside your skull
(George Orwell, 1984)
Privacy and Surveillance
 Opacity of Predictions

https://www.wired.com/story/opioid-drug-addiction-algorithm-chronic-pain/
 Manipulation of Behavior

https://theconversation.com/how-engagement-makes-you-vulnerable-to- https://theconversation.com/facebooks-algorithms-fueled-massive-foreign-propaganda-
manipulation-and-misinformation-on-social-media-145375 campaigns-during-the-2020-election-heres-how-algorithms-can-manipulate-you-168229
 Automation and Employment

https://time.com/5629233/amazon-warehouse-
https://www.youtube.com/watch?v=4sEVX4mPuto
employee-treatment-robots/
Decisions by Proxy

https://www.pinterest.com/pin/22518066860725898/
 Decisions by Proxy

https://xkcd.com/1613/
 Decisions by Proxy

https://www.youtube.com/watch?v=Mme2Aya_6Bc
Existential Risk

https://www.dailymail.co.uk/sciencetech/article-12869629/Tesla-robot-
ATTACKS-engineer-companys-Texas-factory-violent-malfunction-leaving-trail-
blood-forcing-workers-hit-emergency-shutdown-button.html
ML Perpetuates Stereotypes
Know Your Role

https://subsplash.com/+8528/embed/mi/+6b9f08c
 Your Role

You will be a decision-maker in these ethical concerns

 Your Role

• Math/methods have been most of the focus of the AI

community

• But it is also important to understand the social and ethical

implications of your choices
 Your Role

What are we teaching our models?

 Your Role

The choice of data defines decisions of ML model

 The choice of data defines decisions of ML model

https://www.vox.com/2015/9/18/9348821/photography-race-bias
 The choice of data defines decisions of ML model

https://www.vox.com/2015/9/18/9348821/photography-race-bias
 Its not about data only

And it’s not just about diversity or coverage in the

data we collect...

Must ensure all development decisions reflect

values we want the model to exhibit
 Thesis

To address ethical challenges of AI, we need to

understand methods and the human perspective
 Some Key Points

• Fairness

• Transparency

• Accountability

• Privacy
FAIR Data
 FAIR Data Principle

• FAIR Data
• Findable
• Accessible
• Interoperable
• Resuable

Source : https://force11.org/info/the-fair-data-principles/
 FAIR Data

• Findable
• Assigning a globally unique and eternally persistent identifier
• Data description with rich metadata

• Accessible
• Data retrievable via a standard communication protocol
• The protocol is open, free, and universally implementable

Source : https://force11.org/info/the-fair-data-principles/
 FAIR Data

• Interoperable
• Data and metadata is machine actionable
• Data and metadata formats utilize shared vocabularies
• Reusable
• Data and metadata have plurality of accurate and relevant attributes
• Data and metadata meet domain-relevant community standards
• Data and metadata are released with a clear and accessible data usage
license.

Source : https://force11.org/info/the-fair-data-principles/
Responsible AI
 Responsible AI
• Developing, assessing, and deploying AI systems in a safe,
trustworthy, and ethical way.
• Various standards/recommendations available
• Microsoft (MS) Responsible AI Standards
• https://blogs.microsoft.com/wp-content/uploads/prod/sites/5/2022/06/Microsoft-
Responsible-AI-Standard-v2-General-Requirements-3.pdf
• Google Responsible AI Practices
• https://ai.google/responsibility/responsible-ai-practices/
• CISCO Responsible AI Framework
• https://www.cisco.com/c/dam/en_us/about/doing_business/trust-center/docs/cisco-
responsible-artificial-intelligence-framework.pdf
 Key Elements of MS Responsible AI Standards

• Accountability Goals
• Impact assessment
• Oversight of significant adverse impacts
• Fit for purpose
• Data Governance and Management
• Human oversight and control
• Transparency Goals
• System intelligibility for decision making
• Communication to stakeholders
• Disclosure of AI interaction
 Key Elements of MS Responsible AI Standards
• Fairness Goals
• Quality of service
• Allocation of resources and opportunities
• Minimization of stereotyping, demeaning, and erasing outputs

• Reliability and Safety Goals

• Reliability and safety guidance
• Failures and remediations
• Ongoing monitoring, feedback, and evaluation
 Key Elements of MS Responsible AI Standards
• Privacy and Security Goals
• Privacy Standard compliance
• Security Policy compliance

• Inclusiveness Goal
• Accessibility Standards compliance
 Acknowledgement / Resources

• Carlos Guestrin, Ethics of Artificial Intelligence, Stanford University,

https://stanfordaiethics.github.io/syllabus.html

• FAIR Principles, https://www.go-fair.org/fair-principles/