Isaca AAIA Practice Exam Questions

Isaca AAIA Sample Question Answers

Question # 1

An organization plans to implement an AI search and chatbot solution provided by an external vendor. Which of the following is MOST important for an IS auditor to confirm? 

A. Whether the solution is tied to a bilingual evaluation understudy (BLEU) metric 
B. Whether the vendor can provide an independent third-party attestation 
C. Whether the solution effectively enables web integration 
D. Whether the organization or the vendor has the test plan for the solution 

Show Answer

Question # 2

An organization using AI to create digital content faces challenges in protecting its intellectual property. Which of the following is the BEST way to mitigate this risk?

A. Separate training and production data. 
B. Implement watermarking.
C. Apply adversarial training. 
D. Implement a firewall. 

Show Answer

Question # 3

Which of the following pre-processing steps would MOST effectively justify an AI model's decision to a non-technical stakeholder?

A. Permutation feature importance 
B. Local interpretable model-agnostic explanations (LIME) 
C. Partial dependence plots 
D. AI model penetration testing 

Show Answer

Question # 4

Which of the following techniques BEST supports machine learning (ML) training in sentiment analysis?

A. Analysis of variance 
B. Log-rank test 
C. Image recognition 
D. Logistic regression 

Show Answer

Question # 5

An IS auditor reviewing the latest AI chatbot release identifies that, despite high accuracy rates, non-English users complain about the model's poor accuracy. Which of the following controls is BEST at ensuring detection of subgroup regressions?

A. Weighted metric with higher accuracy targets 
B. Human review for non-English languages after go-live 
C. Translate all outputs to English and evaluate in English for consistency 
D. Comparative language evaluations with parity thresholds 

Show Answer

Question # 6

Which of the following represents the PRIMARY benefit of reviewing model cards during AI model acquisition and risk assessment? 

A. Complying with documentation requirements 
B. Identifying model vulnerabilities and training needs 
C. Establishing legally binding contracts for model use 
D. Understanding model intent and performance context 

Show Answer

Question # 7

Which of the following is the MOST essential attribute of an AI-driven audit tool?

A. Explainability of model conclusions 
B. Optimization of audit resources 
C. Use of labeled training datasets 
D. Support for a range of statistical methods 

Show Answer

Question # 8

An IS auditor is reviewing a dataset related to a restaurant's food delivery process. Which of the following data preparation techniques should be used to ensure that no single feature dominates and all fields are weighted appropriately? 

A. Converting Postal Code values from text format to integers 
B. Inserting average values where Distance data is missing 
C. Removing duplicate entries for Customer Address field 
D. Scaling the Distance From Restaurant field 

Show Answer

Question # 9

Which of the following is the GREATEST risk when an organization uses publicly available social media data to train its AI model without obtaining explicit user consent?

A. Introduction of inaccurate and incomplete data 
B. Data with questionable labeling 
C. User distrust caused by lack of transparency in AI model training 
D. Violation of data privacy regulations leading to legal penalties 

Show Answer

Question # 10

When initiating an AI governance program, which of the following is MOST critical to ensure the AI system aligns with organizational objectives and stakeholder needs?

A. Defining AI regulatory compliance requirements before business needs 
B. Prioritizing AI hardware and infrastructure acquisition 
C. Establishing continuous AI system monitoring 
D. Identifying specific processes for the AI use case 

Show Answer