The AWS Certified AI Practitioner Exam (AIF-C01)

The F1 score is the harmonic mean of precision and recall, making it a balanced metric for evaluating model performance when there is an imbalance between false positives and false negatives. Speed, cost, and energy efficiency are unrelated to the F1 score. References: AWS Foundation Models Guide.

BLEU (Bilingual Evaluation Understudy) is the standard metric for evaluating machine translation quality across multiple languages.

ROUGE is for summarization quality (not translation).

AUC is for classification model performance.

Precision is a general metric but not specific for evaluating translations.

???? Reference:

AWS Documentation – Evaluation Metrics for NLP

The business goal identification phase of the ML lifecycle involves defining the objectives of the project and understanding the requirements, including compliance and regulatory considerations. This phase ensures the ML solution aligns with legal and organizational standards before proceeding to technical stages like data collection or model training.

Exact Extract from AWS AI Documents:

From the AWS AI Practitioner Learning Path:

" The business goal identification phase involves defining the problem to be solved, identifying success metrics, and determining compliance and regulatory requirements to ensure the ML solution adheres to legal and organizational standards. "

(Source: AWS AI Practitioner Learning Path, Module on Machine Learning Lifecycle)

Detailed Explanation:

Option A: Feature engineeringFeature engineering involves creating or selecting features for model training, which occurs after compliance requirements are identified. It does not address regulatory concerns.

Option B: Model trainingModel training focuses on building the ML model using data, not on determining compliance or regulatory requirements.

Option C: Data collectionData collection involves gathering data for training, but compliance and regulatory requirements (e.g., data privacy laws) are defined earlier in the business goal identification phase.

Option D: Business goal identificationThis is the correct answer. This phase ensures that compliance and regulatory requirements are considered at the outset, shaping the entire ML project.

AWS Artifact provides compliance reports and certifications (ISO, SOC, GDPR-related documentation) to prove regulatory adherence.

Amazon Transcribe is the correct solution for converting audio from customer calls into text, allowing the company to analyze and extract key information from the conversations.

Amazon Transcribe:

It is a fully managed automatic speech recognition (ASR) service that converts speech into text, making it easier to perform text-based analysis on audio data.

After transcribing the audio, further analysis can be performed using other AWS services like Amazon Comprehend to extract insights such as sentiment, key phrases, or entities.

Why Option B is Correct:

Conversion to Text: Transcribing audio recordings is the first step in gaining insights from spoken conversations, allowing for further processing.

Enables Further Analysis: Once the audio is transcribed into text, other tools and services can be used to analyze the content more deeply.

Why Other Options are Incorrect:

A. Amazon Lex: Is used for building conversational interfaces, not for transcribing or analyzing audio from customer calls.

C. Amazon SageMaker Model Monitor: Monitors ML models for bias and data drift, not for audio analysis.

D. Amazon Comprehend: Can analyze text but cannot transcribe audio; it would be used after transcription is completed.

The verified answer is D. Model deployment and inference. The question describes a trained model being made available to production applications through an API endpoint. That is deployment, and the runtime use of the model to answer queries is inference. AWS SageMaker documentation states that after training, you can get predictions, or inferences, from trained machine learning models, and SageMaker provides model deployment options to support ML inference needs. This directly matches the phrase “available to production applications through an API endpoint for runtime queries.”

Data preparation is incorrect because that phase happens before training. It includes collecting, cleaning, transforming, labeling, and preparing datasets so the model can learn from them. The question already says the model is trained, so the workflow has moved beyond data preparation.

Model training and tuning is incorrect because training and tuning are where the model learns patterns from data and hyperparameters may be adjusted to improve performance. The question is not describing learning, optimization, or retraining. It describes exposing the trained model to applications.

Model evaluation and validation is incorrect because evaluation checks whether the model meets quality, accuracy, fairness, safety, or business criteria before or during production use. The scenario does not describe testing the model; it describes making the model callable by production applications.

In the ML lifecycle, deploying a model means placing it into an environment where applications can send requests and receive predictions. Inference is the process of using the deployed model to generate outputs from new inputs. Because the company is exposing the trained model through an API endpoint for runtime queries, the activity is model deployment and inference.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Inference parameters control output behavior:

Higher temperature increases creativity and randomness

Shorter response length limits output size

AWS prompt and inference guidance recommends increasing temperature for creative tasks and reducing response length for concise outputs.

Why the other options are incorrect:

A reduces creativity.

B produces long outputs.

D produces deterministic and lengthy responses.

AWS AI document references:

Inference Parameters for Foundation Models

Controlling Creativity and Length in Text Generation

Prompt Engineering Best Practices

The company wants to fine-tune an ML model on Amazon Bedrock using sensitive data stored in private databases within a VPC, ensuring the data remains within its private network. AWS PrivateLink provides a secure, private connection between a VPC and AWS services like Amazon Bedrock, allowing data to stay within the company’s network without traversing the public internet. This meets the requirement for maintaining data privacy during fine-tuning.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" AWS PrivateLink enables you to securely connect your VPC to Amazon Bedrock without exposing data to the public internet. This is particularly useful for fine-tuning models with sensitive data, as it ensures that data remains within your private network. "

(Source: AWS Bedrock User Guide, Security and Networking)

Detailed Explanation:

Option A: Restrict access to Amazon Bedrock by using an AWS Identity and Access Management (IAM) service role.While IAM service roles control access to Amazon Bedrock, they do not address the requirement of keeping data within the private network during data transfer. This option is insufficient.

Option B: Restrict access to Amazon Bedrock by using an AWS Identity and Access Management (IAM) resource policy.IAM resource policies define permissions for Bedrock resources but do not ensure that data stays within the private network. This option is incorrect.

Option C: Use AWS PrivateLink to connect the VPC and Amazon Bedrock.This is the correct answer. AWS PrivateLink creates a secure, private connection between the VPC and Amazon Bedrock, ensuring that sensitive data does not leave the private network during fine-tuning, as required.

Option D: Use AWS Key Management Service (AWS KMS) keys to encrypt the data.While AWS KMS can encrypt data, encryption alone does not guarantee that data remains within the private network during transfer. This option does not fully meet the requirement.

The correct answer is B because Amazon Bedrock Prompt Management supports tool use via tools configuration, which enables a prompt to define tools that can invoke external APIs or services.

According to the AWS documentation:

" You can use the tools configuration in Amazon Bedrock to specify external APIs that a foundation model can call during inference. This enables the model to interact with external services, such as invoking functions, retrieving real-time data, or executing workflows. "

The tools configuration allows a prompt to describe which external functions (APIs) are available, their parameters, and how they should be invoked, similar to OpenAI’s function calling or tool use pattern.