ISACA Advanced in AI Audit (AAIA) Free Practice Test

Question 1

Which of the following is the GREATEST risk when training data is not separated into distinct training and testing sets?

A. Model drift

B. Overfitting

C. Underfitting

D. Hallucinations

Correct Answer: B

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 2

The accuracy of an AI model used for product recommendations, trained on data from a specific year, is declining two years later as customer buying patterns have shifted toward sustainable products. Which of the following is the MOST likely cause?

A. Data labeling

B. Schema drift

C. Data drift

D. Covariate shift

Correct Answer: C

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 3

Which of the following is the PRIMARY objective of performing adversarial testing on AI models?

A. Determining key risk indicators (KRIs)

B. Identifying control gaps

C. Validating AI incident response plans

D. Fostering security awareness

Correct Answer: B

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 4

An organization is conducting an audit of an AI decision-making system being used for talent recruitment.
Which of the following is MOST critical to evaluate in order to ensure the system meets stakeholder needs?

A. Predictive accuracy

B. Decision fairness

C. Input validation

D. Decision timeliness

Correct Answer: B

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 5

An IS auditor notes the combined number of records utilized within the training, validation, and testing data sets exceeds the total number of records in the original data set. Which of the following is MOST important for the auditor to determine?

A. Whether the validation data set utilized the same number of records as the training data sets

B. Whether data leakage occurred from utilizing overlapping records in the data sets

C. Whether a sufficient number of records were utilized in the training data set

D. Whether the training, validation, and testing data sets were created in the correct order

Correct Answer: B

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 6

An IS auditor is auditing an AI system that predicts inventory needs. The system recently failed to predict a stock outage for a key product. Which of the following audit tests would BEST validate the system ' s accuracy?

A. Historical testing with past sales data

B. Load testing during peak sales periods

C. Sensitivity analysis on input variables

D. Unit testing of the forecasting algorithm

Correct Answer: A

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 7

An IS auditor notes that an AI modelachieved significantly better results on training data than on test data.
After the development, a quality assurance (QA) team checks that all input variables and parameters match the technical design. Which of the following BEST describes this activity?

A. Model verification

B. Model tuning

C. Model validation

D. Model testing

Correct Answer: A

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 8

An organization deploys an AI recruitment platform to screen job applicants. The IS auditor identifies that the platform ' s decisions may be influenced by model bias. Which of the following risk mitigation strategies is BEST for the auditor to recommend?

A. Implement a process to periodically test the AI system for biases and adjust parameters as needed.

B. Retrain the AI model using an external data set certified for inclusivity and fairness.

C. Suspend the use of the AI system until the training data can be verified for fairness and compliance.

D. Require manual reviews of all AI-generated recruitment decisions before hiring is finalized.

Correct Answer: A

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 9

An organization is evaluating change management practices for AI-based decision support models. Which of the following BEST demonstrates effective AI-focused change management?

A. Engaging an independent expert to review the model ' s accuracy and precision on a quarterly basis

B. Documenting model updates and retraining sessions to ensure traceability

C. Deploying two separate copies of the model after each adjustment to compare results

D. Assigning a single data science team member to adjust the model in order to establish accountability

Correct Answer: B

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 10

A bank uses a video-based know your customer (KYC) verification process. Cybercriminals exploit this process by using deepfake technology to impersonate bank customers. Which of the following countermeasures is the BEST way for the bank to mitigate this risk?

A. Encrypting all customer data and communication

B. Leveraging AI-based liveness detection during video verification

C. Requesting additional identity and address documents for verification

D. Discontinuing the use of the video-based verification process

Correct Answer: B

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 11

A healthcare AI tool recommends treatments with high success rates but significant risk. The hospital prioritizes patient safety over innovation. What is the BEST course of action?

A. Adjust the AI ' s parameters to align with the hospital's risk tolerance.

B. Discontinue using the AI tool and rely solely on doctor expertise.

C. Obtain patients ' consent for the use of their data by the AI tool.

D. Use the AI tool only for low-risk situations.

Correct Answer: A

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Question 12

An organization ' s system development process has been enhanced with AI. Which of the following features presents the GREATEST risk?

A. All codes are generated by AI without human oversight.

B. Non-technical users are validating AI results.

C. The AI allocates resources for new system development projects.

D. The AI personalizes applications for the user.

Correct Answer: A

Explanation: Only visible for TestSimulate members. You can sign-up / login (it's free).

Welcome to TestSimulate

ISACA Advanced in AI Audit (AAIA) Free Practice Test