AIF-C01 AWS Certified AI Practitioner Exam Questions and Answers

Accuracy is the most appropriate metric to measure the performance of an image classification model. It indicates the percentage of correctly classified images out of the total number of images. In the context of classifying plant diseases from images, accuracy will help the company determine how well the model is performing by showing how many images were correctly classified.

Option B (Correct): " Accuracy " : This is the correct answer because accuracy measures the proportion of correct predictions made by the model, which is suitable for evaluating the performance of a classification model.

Option A: " R-squared score " is incorrect as it is used for regression analysis, not classification tasks.

Option C: " Root mean squared error (RMSE) " is incorrect because it is also used for regression tasks to measure prediction errors, not for classification accuracy.

Option D: " Learning rate " is incorrect as it is a hyperparameter for training, not a performance metric.

AWS AI Practitioner References:

Evaluating Machine Learning Models on AWS: AWS documentation emphasizes the use of appropriate metrics, like accuracy, for classification tasks.

AWS HealthScribe provides speech-to-text and medical documentation generation, specifically designed for healthcare applications.

Amazon Polly is text-to-speech, not speech-to-text.

Amazon Rekognition is computer vision.

Amazon Q Developer is a generative AI assistant for developers, not healthcare.

???? Reference:

AWS Documentation – AWS HealthScribe

AWS documentation identifies ROUGE as a standard evaluation metric for text summarization tasks. ROUGE measures the overlap of n-grams, sequences, or word pairs between a machine-generated summary and a human-written reference summary, making it ideal for automated evaluation.

In this scenario, the company needs a metric that directly compares generated summaries with human references. ROUGE scores quantify how much of the reference content is captured by the model output, which aligns with AWS recommendations for evaluating summarization quality.

The other metrics are not appropriate. F1 score is typically used for classification tasks. Perplexity measures language model confidence but does not compare outputs to reference summaries. Fréchet Inception Distance is used for image generation tasks, not text.

AWS consistently recommends ROUGE for summarization evaluation, making it the correct choice.

Guardrails for Amazon Bedrock provide mechanisms to filter and control the content generated by models to comply with privacy and policy requirements. Using guardrails ensures that sensitive or personal information is not included in the model ' s responses. Additionally, integrating Amazon CloudWatch alarms allows for real-time notification when a policy violation occurs.

Option C (Correct): " Use Guardrails for Amazon Bedrock to filter content. Set up Amazon CloudWatch alarms for notification of policy violations " : This is the correct answer because it directly addresses both the prevention of policy violations and the requirement to receive notifications when such violations occur.

Option A: " Use Amazon Macie to scan the model ' s output for sensitive data " is incorrect because Amazon Macie is designed to monitor data in S3, not to filter real-time model outputs.

Option B: " Configure AWS CloudTrail to monitor the model ' s responses " is incorrect because CloudTrail tracks API activity and is not suited for content moderation.

Option D: " Implement Amazon SageMaker Model Monitor to detect data drift " is incorrect because data drift detection does not address content moderation or privacy compliance.

AWS AI Practitioner References:

Guardrails in Amazon Bedrock: AWS provides guardrails to ensure AI models comply with content policies, and using CloudWatch for alerting integrates monitoring capabilities.

To use a custom model that has been trained to improve summarization quality, the company must deploy the model on an Amazon SageMaker endpoint. This allows the model to be used for real-time inference through Amazon Bedrock or other AWS services. By deploying the model in SageMaker, the custom model can be accessed programmatically via API calls, enabling integration with Amazon Bedrock.

Option B (Correct): " Deploy the custom model in an Amazon SageMaker endpoint for real-time inference " : This is the correct answer because deploying the model on SageMaker enables it to serve real-time predictions and be integrated with Amazon Bedrock.

Option A: " Purchase Provisioned Throughput for the custom model " is incorrect because provisioned throughput is related to database or storage services, not model deployment.

Option C: " Register the model with the Amazon SageMaker Model Registry " is incorrect because while the model registry helps with model management, it does not make the model accessible for real-time inference.

Option D: " Grant access to the custom model in Amazon Bedrock " is incorrect because Bedrock does not directly manage custom model access; it relies on deployed endpoints like those in SageMaker.

AWS AI Practitioner References:

Amazon SageMaker Endpoints: AWS recommends deploying models to SageMaker endpoints to use them for real-time inference in various applications.

The verified answer is B. Pre-training. The scenario describes the first major training stage for a large language model, where the model starts with randomly initialized weights and learns broad language patterns from a very large corpus of unlabeled or self-supervised text data. AWS describes large language models as very large deep learning models that are pre-trained on vast amounts of data. In this stage, the model is not yet being customized for a narrow business task; instead, it learns general-purpose linguistic and semantic representations from large-scale text.

AWS machine learning guidance explains that pre-training teaches the model broad linguistic and semantic patterns, including grammar, context, world knowledge, reasoning, and token prediction, using self-supervised learning approaches such as masked language modeling or causal language modeling. That exactly matches the question’s description: random weight initialization followed by fitting the model to a large web dataset using a language-modeling objective. This is the core training process used to create a foundation model or LLM before later adaptation.

Option A. Fine-tuning is incorrect because AWS defines fine-tuning as training a pretrained model on a new dataset rather than training from scratch. Fine-tuning adapts an existing model for a specific task or domain and usually requires less data and less training time than pre-training.

Option C. Model selection is incorrect because model selection refers to choosing an appropriate model or architecture, not training the model weights from random initialization. Option D. Deployment is also incorrect because AWS describes deployment as the stage where a trained model is made available for inference or predictions, such as through SageMaker inference endpoints.

Therefore, because the company is training an LLM from initial weights on a large web corpus using a language-modeling objective, the stage is pre-training.

The company needs to address the degradation in model inference quality after 4 months in production and prevent future occurrences by receiving notifications. Retraining the model can address the current degradation, likely caused by data drift (changes in the data distribution over time). Amazon SageMaker Model Monitor is designed to detect and monitor model drift, alerting the company when inference quality degrades, thus meeting both requirements.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

" Amazon SageMaker Model Monitor enables you to monitor machine learning models in production for data drift, model performance degradation, and other quality issues. It can detect drift in feature distributions and inference quality, sending notifications when deviations are detected, allowing you to take corrective actions such as retraining the model. "

(Source: Amazon SageMaker Developer Guide, Monitoring Models with SageMaker Model Monitor)

Detailed Explanation:

Option A: Retrain the model. Monitor model drift by using Amazon SageMaker Clarify.SageMaker Clarify is used for bias detection and explainability, not for monitoring model drift or inference quality in production. This option does not fully meet the requirements.

Option B: Retrain the model. Monitor model drift by using Amazon SageMaker Model Monitor.This is the correct answer. Retraining addresses the current degradation, and SageMaker Model Monitor can detect future drift in inference quality, sending notifications to prevent recurrence, as required.

Option C: Build a new model. Monitor model drift by using Amazon SageMaker Feature Store.SageMaker Feature Store is for managing and sharing features, not for monitoring model drift or inference quality. Building a new model may not be necessary if retraining can address the issue.

Option D: Build a new model. Monitor model drift by using Amazon SageMaker JumpStart.SageMaker JumpStart provides pre-trained models and solutions for quick deployment, but it does not offer specific tools for monitoring model drift or inference quality in production.

The ML research team needs a mechanism to audit custom ML models while sharing model artifacts with other teams. Amazon SageMaker Model Cards provide a structured way todocument model details, including intended uses, training data, and inference performance, making them ideal for auditing and ensuring transparency when publishing models.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

" Amazon SageMaker Model Cards enable you to document critical details about your machine learning models, such as intended uses, training data, evaluation metrics, and inference details. Model Cards support auditing by providing a centralized record that can be reviewed by teams to understand model behavior and limitations. "

(Source: Amazon SageMaker Developer Guide, SageMaker Model Cards)

Detailed Explanation:

Option A: Create documents with the relevant information. Store the documents in Amazon S3.While storing documents in S3 is feasible, it lacks the structured format and integration with SageMaker that Model Cards provide, making it less suitable for auditing purposes.

Option B: Use AWS AI Service Cards for transparency and understanding models.AWS AI Service Cards are not a standard feature in AWS documentation. This option appears to be a distractor and is not a valid solution.

Option C: Create Amazon SageMaker Model Cards with Intended uses and training and inference details.This is the correct answer. SageMaker Model Cards are specifically designed to document model details for auditing, transparency, and collaboration, meeting the team’s requirements.

Option D: Create model training scripts. Commit the model training scripts to a Git repository.Sharing training scripts in a Git repository provides access to code but does not offer a structured auditing mechanism for model details like intended uses or inference performance.

The Amazon EC2 Trn series (Trainium) instances are designed for high-performance, cost-effective machine learning training while being energy-efficient. AWS Trainium-powered instances are optimized for deep learning models and have been developed to minimize environmental impact by maximizing energy efficiency.

Option D (Correct): " Amazon EC2 Trn series " : This is the correct answer because the Trn series is purpose-built for training deep learning models with lower energy consumption, which aligns with the company ' s concern about environmental effects.

Option A: " Amazon EC2 C series " is incorrect because it is intended for compute-intensive tasks but not specifically optimized for ML training with environmental considerations.

Option B: " Amazon EC2 G series " (Graphics Processing Unit instances) is optimized for graphics-intensive applications but does not focus on minimizing environmental impact for training.

Option C: " Amazon EC2 P series " is designed for ML training but does not offer the same level of energy efficiency as the Trn series.

AWS AI Practitioner References:

AWS Trainium Overview: AWS promotes Trainium instances as their most energy-efficient and cost-effective solution for ML model training.

When a model is trained on a dataset containing confidential or sensitive data, the model may inadvertently learn patterns from this data, which could then be reflected in its inference responses. To ensure that a model does not generate responses based on confidential data, the most effective approach is to remove the confidential data from the training dataset and then retrain the model.

Explanation of Each Option:

Option A (Correct): " Delete the custom model. Remove the confidential data from the training dataset. Retrain the custom model. " This option is correct because it directly addresses the core issue: the model has been trained on confidential data. The only way to ensure that the model does not produce inferences based on this data is to remove the confidential information from the training dataset and then retrain the model from scratch. Simply deleting the model and retraining it ensures that no confidential data is learned or retained by the model. This approach follows the best practices recommended by AWS for handling sensitive data when using machine learning services like Amazon Bedrock.

Option B: " Mask the confidential data in the inference responses by using dynamic data masking. " This option is incorrect because dynamic data masking is typically used to mask or obfuscate sensitive data in a database. It does not address the core problem of the model beingtrained on confidential data. Masking data in inference responses does not prevent the model from using confidential data it learned during training.

Option C: " Encrypt the confidential data in the inference responses by using Amazon SageMaker. " This option is incorrect because encrypting the inference responses does not prevent the model from generating outputs based on confidential data. Encryption only secures the data at rest or in transit but does not affect the model ' s underlying knowledge or training process.

Option D: " Encrypt the confidential data in the custom model by using AWS Key Management Service (AWS KMS). " This option is incorrect as well because encrypting the data within the model does not prevent the model from generating responses based on the confidential data it learned during training. AWS KMS can encrypt data, but it does not modify the learning that the model has already performed.

AWS AI Practitioner References:

Data Handling Best Practices in AWS Machine Learning: AWS advises practitioners to carefully handle training data, especially when it involves sensitive or confidential information. This includes preprocessing steps like data anonymization or removal of sensitive data before using it to train machine learning models.

Amazon Bedrock and Model Training Security: Amazon Bedrock provides foundational models and customization capabilities, but any training involving sensitive data should follow best practices, such as removing or anonymizing confidential data to prevent unintended data leakage.

The verified answer is B. Reduction of the cost for each decision. The question asks for the immediate value of deploying AI agents to automate manual decision-making. AWS Prescriptive Guidance for operationalizing agentic AI identifies immediate ROI metrics such as cost per decision, time compression, and error reduction. Cost per decision compares the cost of agent processing against the human equivalent. That directly maps to the scenario because the company replaced or augmented manual decision-making processes with AI agents.

The immediate value of automation is usually measured by direct operational efficiency: lower cost, faster cycle time, fewer manual steps, and reduced human effort. AWS guidance also recommends anchoring technical and business KPIs to strategic value, including decision latency, resolution accuracy, and cost savings. This supports using cost per decision as a practical business metric for agent deployments.

Option A is incorrect because network effect is a long-term platform or ecosystem metric. It measures the increasing value of a product as more users or participants join, not the immediate value of automating decisions. Option C is incorrect because additional revenue from market expansion is a strategic growth outcome, not an immediate operational value metric. Option D is also incorrect because additional vertical solutions represent future expansion potential, not the direct value of the current deployment.

Because the deployment automates manual decisions, the most direct and immediate metric is the reduction in cost for each decision. Therefore, option B is correct.

Retrieval-Augmented Generation (RAG) integrates external knowledge sources (databases, vector stores, document repositories) with LLMs, enabling them to generate contextually accurate and up-to-date responses without retraining.

B is incorrect: RAG does not speed up training; it improves inference results.

C is incorrect: speech recognition is not an RAG use case.

D is incorrect: computer vision augmentation is unrelated to RAG.

???? Reference:

AWS Documentation – Knowledge Bases for RAG in Amazon Bedrock

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Fairness is a core principle of AWS Responsible AI. It requires that AI systems:

Do not produce biased or discriminatory outcomes

Treat individuals and groups equitably

Are evaluated and mitigated for bias across protected attributes

AWS Responsible AI guidance specifically highlights fairness as the principle used to identify, measure, and mitigate bias in AI systems such as recommendation engines.

Why the other options are incorrect:

Governance (A) focuses on oversight and policies.

Explainability (B) explains decisions but does not directly mitigate bias.

Controllability (C) focuses on human oversight and intervention.

AWS AI document references:

AWS Responsible AI Principles

Bias and Fairness in ML Systems

Responsible AI Best Practices on AWS

The correct answer is D because autoencoders are an unsupervised machine learning method commonly used for anomaly detection when labeled data is not available.

From AWS documentation:

" Autoencoders learn to compress and reconstruct input data. During anomaly detection, they learn normal patterns in data. Data points that the model cannot accurately reconstruct are flagged as anomalies. "

This approach is ideal when there is no labeled data and when patterns must be learned based on normal behavior alone — a common situation in IoT sensor data environments.

Explanation of other options:

A. Linear regression requires labeled data and is used for predicting continuous values.

B. Classification requires labeled data to assign inputs into categories.

C. Decision trees are supervised learning models and also require labeled datasets.

Referenced AWS AI/ML Documents and Study Guides:

AWS Machine Learning Specialty Guide – Unsupervised Learning Techniques

Amazon SageMaker Examples – Anomaly Detection Using Autoencoders

Tokens in generative AI models are the smallest units that the model processes, typically representing words, subwords, or characters. They are essential for the model to understand and generate language, breaking down text into manageable parts for processing.

Option A (Correct): " Tokens are the basic units of input and output that a generative AI model operates on, representing words, subwords, or other linguistic units " : This is the correct definition of tokens in the context of generative AI models.

Option B: " Mathematical representations of words " describes embeddings, not tokens.

Option C: " Pre-trained weights of a model " refers to the parameters of a model, not tokens.

Option D: " Prompts or instructions given to a model " refers to the queries or commands provided to a model, not tokens.

AWS AI Practitioner References:

Understanding Tokens in NLP: AWS provides detailed explanations of how tokens are used in natural language processing tasks by AI models, such as in Amazon Comprehend and other AWS AI services.

Generative AI models (such as large language models) are designed to generate new content, such as text, summaries, images, and more. Summarizing text—like customer complaints—is a classic application of generative AI.

A is correct:

" Text summarization is a core generative AI use case, as it involves generating new, concise content from a larger body of text. "

(Reference: AWS Generative AI Use Cases)

B and C are standard ML classification/segmentation tasks.

D is a regression/prediction task, not generative.

The problem involves a simple probability calculation that can be handled efficiently by straightforward mathematical rules and computations. Using machine learning techniques would introduce unnecessary complexity and operational overhead.

Option C (Correct): " Use code that will calculate probability by using simple rules and computations " : This is the correct answer because it directly solves the problem with minimal overhead, using basic probability rules.

Option A: " Use supervised learning to create a regression model " is incorrect as it overcomplicates the solution for a simple probability problem.

Option B: " Use reinforcement learning to train a model " is incorrect because reinforcement learning is not needed for a simple probability calculation.

Option D: " Use unsupervised learning to create a model " is incorrect as unsupervised learning is not applicable to this task.

AWS AI Practitioner References:

Choosing the Right Solution for AI Tasks: AWS recommends using the simplest and most efficient approach to solve a given problem, avoiding unnecessary machine learning techniques for straightforward tasks.

The correct answer is D. Amazon Bedrock Agents are used to orchestrate and execute complex workflows by connecting foundation models with APIs, databases, and tools. According to AWS documentation, agents interpret user inputs, plan the necessary steps, call external APIs or systems, and return structured results. This allows the model to go beyond text generation into full automation workflows—such as booking tasks, querying internal systems, or summarizing reports. Option A describes multi-modal models, B refers to prompt tuning, and C misstates control delegation; agents act autonomously based on model reasoning. Thus, Bedrock Agents function as intelligent orchestrators, handling multi-step task execution through integrated tool use.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Agents Overview

AWS Generative AI Best Practices – Workflow Orchestration

The verified answer is A. Amazon Bedrock Guardrails. The requirement is to prevent a deployed foundation model from returning answers about a specific unwanted topic: politics. AWS documentation states that Amazon Bedrock Guardrails provides configurable safeguards to help you build safe generative AI applications. It also explains that guardrails provide safety and privacy controls across foundation models and help detect and filter undesirable content in user inputs and model responses. Most importantly for this question, AWS specifically identifies denied topics as a guardrail capability. With denied topics, you can define a set of topics that are undesirable in the context of your application, and the filter helps block them if they are detected in user queries or model responses. That exactly matches the scenario because the company wants political questions blocked before answers are sent to users.

Amazon Bedrock Agents is incorrect because agents are used to build applications that can reason, orchestrate tasks, call APIs, and connect to knowledge sources or action groups. Agents do not primarily exist to block topic categories in model input or output. Amazon SageMaker Clarify is incorrect because AWS describes SageMaker Clarify as a service for fairness, model explainability, feature attribution, and bias detection. It is useful for understanding model behavior and detecting bias, but it is not the correct control for filtering political responses from a generative AI application.

Amazon SageMaker Model Monitor is also incorrect because it monitors deployed model quality, data quality, bias drift, and feature attribution drift. Monitoring can identify problems after deployment, but it does not directly enforce real-time content filtering for foundation model responses. The question asks for a solution that ensures political answers are not sent to users. AWS Bedrock Guardrails is purpose-built for that control by applying safeguards to FM inputs and outputs.

The requirement is to deploy a customized machine learning (ML) model and monitor its quality for potential drift over time in a production environment. Let’s evaluate each option:

A. Amazon Rekognition: This service is designed for image and video analysis, such as object detection, facial recognition, and text extraction. It is not suited for deploying custom ML models or monitoring model quality drift.

B. Amazon SageMaker Clarify: This feature helps detect bias in ML models and explains model predictions. While it addresses fairness and interpretability, it does not specifically focus on monitoring model quality drift over time in production.

C. Amazon Comprehend: This is a natural language processing (NLP) service for extracting insights from text, such as sentiment analysis or entity recognition. It does not support deploying custom ML models or monitoring model performance drift.

D. Amazon SageMaker Model Monitor: This feature is part of Amazon SageMaker and is specifically designed to monitor ML models in production. It tracks metrics such as data drift, model drift, and performance degradation over time, alerting users when issues are detected.

Exact Extract Reference: According to the AWS documentation on Amazon SageMaker, “Amazon SageMaker Model Monitor allows you to detect and remediate data and model quality issues in production. It continuously monitors the performance of deployed models, capturing data and model predictions to detect deviations from expected behavior, such as data drift or model performance degradation.” (Source: AWS SageMaker Documentation - Model Monitoring, https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor.html).

This directly aligns with the requirement to observe model quality drift, making Amazon SageMaker Model Monitor the correct choice.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

The F1 score is a standard evaluation metric that represents the harmonic mean of precision and recall.

In AWS ML evaluation guidance:

Precision measures correctness of positive predictions

Recall measures coverage of actual positive cases

F1 score balances both metrics into a single performance indicator

This makes the F1 score particularly useful when evaluating classification performance of foundation models.

Why the other options are incorrect:

Speed (B) is a latency metric.

Cost (C) measures operational efficiency.

Energy efficiency (D) is unrelated to predictive accuracy.

AWS AI document references:

Model Evaluation Metrics on AWS

Classification Performance Measurement

Amazon SageMaker Evaluation Best Practices

Comprehensive and Detailed Explanation from AWS AI Documents:

Classification requires predefined labels (categories). The company explicitly does not want to define categories.

Regression (linear or logistic) predicts numerical values or probabilities, not groups.

Clustering is an unsupervised learning technique that groups similar data points together based on their features without needing labeled categories.

AWS defines clustering as:

“Clustering is an unsupervised machine learning algorithm that automatically groups data points into clusters based on their similarities.”

This makes Clustering the correct choice for segmenting customers into groups without predefined labels.

???? Reference:

AWS ML Glossary – Clustering

Diversity in datasets ensures representation of all demographics, reducing bias and improving fairness.

Accuracy is model performance.

Recency bias skews towards recent data.

Reliability measures consistency of results, not representation.

???? Reference:

AWS Responsible AI Guidelines – Data Diversity

The company is building a chatbot using an LLM to answer questions about HR policies, with access to a large digital documentation base. Retrieval Augmented Generation (RAG) optimizes the LLM’s responses by retrieving relevant information from the documentation base and using it to generate accurate, contextually grounded answers, reducing hallucinations and improving response quality.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" Retrieval Augmented Generation (RAG) enhances the performance of large language models by retrieving relevant information from external knowledge bases, such as documentation or databases, and incorporating it into the generation process. This technique ensures responses are accurate and grounded in the provided data, making it ideal for applications like policy chatbots. "

(Source: AWS Bedrock User Guide, Retrieval Augmented Generation)

Detailed Explanation:

Option A: Use Retrieval Augmented Generation (RAG).This is the correct answer. RAG leverages the documentation base to provide the LLM with relevant HR policy information, optimizing the chatbot’s responses for accuracy and relevance.

Option B: Use few-shot prompting.Few-shot prompting provides a few examples in the prompt to guide the LLM, but it is less effective than RAG for large documentation bases, as it cannot dynamically retrieve specific policy details.

Option C: Set the temperature to 1.Setting the temperature to 1 controls the randomness of the LLM’s output but does not optimize responses using external documentation. This option is unrelated to the documentation base.

Option D: Decrease the token size.Decreasing token size (likely referring to limiting input/output tokens) may reduce response length but does not optimize the quality of responses using the documentation base.

AWS Glue is the correct service for transforming petabytes of unstructured data into a structured format suitable for machine learning tasks.

AWS Glue:

A fully managed extract, transform, and load (ETL) service that makes it easy to prepare and transform unstructured data into a structured format.

Provides a range of tools for cleaning, enriching, and cataloging data, making it ready for data scientists to use in ML models.

Why Option D is Correct:

Data Transformation: AWS Glue can handle large volumes of data and transform unstructured data into structured formats efficiently.

Integrated ML Support: Glue integrates with other AWS services to support ML workflows.

Why Other Options are Incorrect:

A. Amazon Lex: Used for building chatbots, not for data transformation.

B. Amazon Rekognition: Used for image and video analysis, not for data transformation.

C. Amazon Kinesis Data Streams: Handles real-time data streaming, not suitable for batch transformation of large volumes of unstructured data.

Generative AI models are used to create new content based on existing data. One common use case is generating photorealistic images from text descriptions, which is particularly useful in digital marketing, where visual content is key to engaging potential customers.

Option B (Correct): " Creating photorealistic images from text descriptions for digital marketing " : This is the correct answer because generative AI models, like those offered by Amazon Bedrock, can create images based on text descriptions, making them highly valuable for generating marketing materials.

Option A: " Improving network security by using intrusion detection systems " is incorrect because this is a use case for traditional machine learning models, not generative AI.

Option C: " Enhancing database performance by using optimized indexing " is incorrect as it is unrelated to generative AI.

Option D: " Analyzing financial data to forecast stock market trends " is incorrect because it typically involves predictive modeling rather than generative AI.

AWS AI Practitioner References:

Use Cases for Generative AI Models on AWS: AWS highlights the use of generative AI for creative content generation, including image creation, text generation, and more, which is suited for digital marketing applications.

The correct answer is C because BERTScore is a commonly used metric to evaluate the semantic similarity between generated text (like summaries) and reference text. It uses contextual embeddings from BERT to compare generated and reference sentences, making it highly suitable for evaluating generative tasks like summarization.

From AWS documentation:

" Amazon Bedrock supports BERTScore for evaluating generative text tasks, such as summarization or translation, by comparing the semantic similarity between the output and a reference. "

Explanation of other options:

A. AUC is used for binary classification models, not generative text.

B. F1 score is also used for classification problems (precision/recall balance).

D. Real World Knowledge (RWK) score is not a standard or supported evaluation metric in Amazon Bedrock.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Documentation – Model Evaluation Metrics

AWS ML Specialty Guide – Evaluating Generative Models

AWS Generative AI Developer Tools

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Amazon SageMaker Model Cards provide a structured way to document:

Approved training datasets

Intended use cases

Ethical considerations and limitations

Compliance with internal policies and governance standards

Model Cards are a Responsible AI governance tool, enabling transparency and accountability throughout the model lifecycle.

Why the other options are incorrect:

Catalog (A) organizes ML assets but does not enforce ethical or policy documentation.

Clarify (B) detects bias and explainability issues but does not govern approved data usage.

Model Registry (C) manages model versions and approvals but does not document ethical intent.

AWS AI document references:

Amazon SageMaker Model Cards Documentation

AWS Responsible AI Practices

AI Governance on AWS

Amazon Bedrock Guardrails allow developers to create safeguards that filter harmful content and prevent sensitive topics from being discussed. This functionality helps mitigate prompt injection attacks with minimal implementation effort. According to the official Amazon Bedrock documentation:

“You can configure Guardrails for Amazon Bedrock to define denied topics, use content filters, and apply sensitive information filters, offering protection against prompt injection attacks with minimal development effort.”

Amazon QuickSight is a fully managed business intelligence (BI) service that allows users to create and publish interactive dashboards that include visualizations like graphs, charts, and tables. " Amazon Q " is the natural language query feature within Amazon QuickSight. It enables users to ask questions about their data in natural language and receive visual responses such as graphs.

Option C (Correct): " Amazon Q in Amazon QuickSight " : This is the correct answer because Amazon QuickSight Q is specifically designed to allow users to explore their data through natural language queries, and it can automatically generate graphs to display sales data and other metrics. This makes it an ideal choice for the company to automate the generation of graphs showing total sales for its top-selling products across various retail locations.

Option A, B, and D: These options are incorrect:

A. Amazon Q in Amazon EC2: Amazon EC2 is a compute service that provides virtual servers, but it is not directly related to generating graphs or providing natural language querying features.

B. Amazon Q Developer: This is not an existing AWS service or feature.

D. Amazon Q in AWS Chatbot: AWS Chatbot is a service that integrates with Amazon Chime and Slack for monitoring and managing AWS resources, but it is not used for generating graphs based on sales data.

AWS AI Practitioner References:

Amazon QuickSight Q is designed to provide insights from data by using natural language queries, making it a powerful tool for generating automated graphs and visualizations directly from queried data.

Business Intelligence (BI) on AWS: AWS services such as Amazon QuickSight provide business intelligence capabilities, including automated reporting and visualization features, which are ideal for companies seeking to visualize data like sales trends over time.

The manufacturing company needs to create product descriptions in multiple languages, which requires automated language translation. Amazon Translate is a fully managed service that uses machine learning to provide high-quality translation between languages, making it the ideal solution for this task.

Exact Extract from AWS AI Documents:

From the Amazon Translate Developer Guide:

" Amazon Translate is a neural machine translation service that delivers fast, high-quality, and affordable language translation. It can be used to automatically translate text, such as product descriptions, into multiple languages to reach a global audience. "

(Source: Amazon Translate Developer Guide, Introduction to Amazon Translate)

Detailed Explanation:

Option A: Amazon TranslateThis is the correct answer. Amazon Translate automates the translation of text into multiple languages, directly addressing the company’s need to create product descriptions in different languages.

Option B: Amazon TranscribeAmazon Transcribe converts speech to text, which is unrelated to translating text into multiple languages. This option is incorrect.

Option C: Amazon KendraAmazon Kendra is an intelligent search service that uses machine learning to provide answers from documents, not for translating text. This option is irrelevant.

Option D: Amazon PollyAmazon Polly is a text-to-speech service that generates spoken audio from text, not for translating text into other languages. This option does not meet the requirements.

Amazon SageMaker Ground Truth is designed to support human evaluation and labeling workflows using both internal teams and external workforces. AWS documentation states that Ground Truth enables organizations to build high-quality labeled datasets and conduct human reviews using private workforces, vendor-managed workforces, or third-party providers.

In this scenario, the company needs to evaluate toxicity in foundation model outputs, which requires nuanced human judgment. AWS highlights that Ground Truth supports tasks such as content moderation, sentiment analysis, and safety evaluation, making it well suited for assessing harmful or toxic content generated by models.

Ground Truth provides managed tooling for task distribution, reviewer instructions, quality control, and auditability. It allows companies to seamlessly scale operations by combining internal reviewers for sensitive data with external reviewers for higher-volume workloads, while maintaining consistent review standards.

The other options do not meet the requirement. Amazon Bedrock Agents orchestrate interactions with foundation models but do not manage human review workflows. Amazon Comprehend Custom focuses on training NLP models, not evaluating FM outputs. Amazon SageMaker JumpStart provides pretrained models and solutions, not human evaluation pipelines.

AWS positions SageMaker Ground Truth as a core service for human-in-the-loop machine learning and responsible AI, making it the correct choice for toxicity evaluation using both internal and external reviewers.

Provide labeled data to customize a model to improve performance on specific tasks.

Correct Answer: Fine-tuning

Comprehensive and Detailed Explanation (AWS AI documents):

AWS generative AI guidance defines fine-tuning as the process of adapting a pre-trained foundation model using labeled, task-specific data. Fine-tuning adjusts the model’s parameters so it performs better on a particular task, such as classification, summarization, or domain-specific reasoning.

Fine-tuning is commonly used when:

High-quality labeled data is available

The goal is to improve accuracy on a specific task

The base FM already has strong general capabilities

AWS AI Study Guide References:

AWS foundation model customization methods

AWS fine-tuning concepts for generative AI

Provide unlabeled data to customize a foundation model for a specific domain.

Correct Answer: Continued pre-training

Comprehensive and Detailed Explanation (AWS AI documents):

AWS documentation describes continued pre-training as extending the training of a foundation model using large volumes of unlabeled, domain-specific data. This method helps the model better understand domain vocabulary, structure, and context without requiring labeled datasets.

Continued pre-training is useful when:

Large amounts of unlabeled domain data are available

The goal is to improve domain understanding rather than a single task

Labeling data would be expensive or impractical

AWS AI Study Guide References:

AWS generative AI training lifecycle

AWS guidance on domain adaptation using unlabeled data

Transfer knowledge from a larger and more intelligent model to a smaller model.

Correct Answer: Distillation

Comprehensive and Detailed Explanation (AWS AI documents):

AWS generative AI materials define distillation as a technique where a smaller model (student) learns to replicate the behavior of a larger, more capable model (teacher). The goal is to retain most of the performance while reducing model size, cost, and inference latency.

Distillation is commonly used to:

Reduce operational costs

Improve inference speed

Deploy models to resource-constrained environments

AWS AI Study Guide References:

AWS model optimization techniques

AWS knowledge distillation concepts

The evaluation stage of the generative AI model lifecycle involves testing the model to assess its performance, including accuracy, coherence, and other metrics. This stage ensures the model meets the desired quality standards before deployment.

Exact Extract from AWS AI Documents:

From the AWS AI Practitioner Learning Path:

" The evaluation phase in the machine learning lifecycle involves testing the model against validation or test datasets to measure its performance metrics, such as accuracy, precision, recall, or task-specific metrics for generative AI models. "

(Source: AWS AI Practitioner Learning Path, Module on Machine Learning Lifecycle)

Detailed Explanation:

Option A: DeploymentDeployment involves making the model available for use in production. While monitoring occurs post-deployment, accuracy testing is performed earlier in the evaluation stage.

Option B: Data selectionData selection involves choosing and preparing data for training, not testing the model’s accuracy.

Option C: Fine-tuningFine-tuning adjusts a pre-trained model to improve performance for a specific task, but it is not the stage where accuracy is formally tested.

Option D: EvaluationThis is the correct answer. The evaluation stage is where tests are conducted to examine the model’s accuracy and other performance metrics, ensuring it meets requirements.

Jailbreaking an LLM refers to deliberately crafting prompts to bypass its safety guardrails and produce restricted or harmful content.

Fuzzing is input testing for software.

DoS is a service availability attack.

Pen testing (C) is allowed with AWS authorization but doesn’t describe bypassing model safeguards.

???? Reference:

AWS Responsible AI – Prompt Injection and Jailbreak Risks

Partial dependence plots (PDPs) are visual tools used to show the relationship between a feature (or a set of features) in the data and the predicted outcome of a machine learning model. They are highly effective for providing transparency and explainability of the model ' s behavior to stakeholders by illustrating how different input variables impact the model ' s predictions.

Option B (Correct): " Partial dependence plots (PDPs) " : This is the correct answer because PDPs help to interpret how the model ' s predictions change with varying values of input features, providing stakeholders with a clearer understanding of the model ' s decision-making process.

Option A: " Code for model training " is incorrect because providing the raw code for model training may not offer transparency or explainability to non-technical stakeholders.

Option C: " Sample data for training " is incorrect as sample data alone does not explain how the model works or its decision-making process.

Option D: " Model convergence tables " is incorrect. While convergence tables can show the training process, they do not provide insights into how input features affect the model ' s predictions.

AWS AI Practitioner References:

Explainability in AWS Machine Learning: AWS provides various tools for model explainability, such as Amazon SageMaker Clarify, which includes PDPs to help explain the impact of different features on the model’s predictions.

Model fine-tuning adapts a pre-trained model to a specific domain or task using labeled data. This is the preferred approach when you want highly customized behavior for a particular application or subject area.

(Reference: Amazon Bedrock Fine-Tuning)

Data augmentation is used to artificially increase the size of a labeled dataset, usually by transforming or generating variations of the original data. This helps improve model generalization when labeled data is limited.

(Reference: AWS Data Preparation Techniques, AWS AI Practitioner Guide)

Continued pre-training (also called domain-adaptive pre-training) further trains a foundation model on large amounts of unlabeled data from a specific domain, improving the model’s language understanding or generation for that domain.

(Reference: Amazon Bedrock Customization Options)

The correct answer is C – Test the AI solution to ensure that it does not discriminate against any protected groups. According to AWS Responsible AI principles, fairness and bias mitigation are essential when AI is used for high-impact decisions such as hiring. AWS documentation emphasizes evaluating datasets, model outputs, and demographic performance to ensure that AI systems do not reinforce or reproduce discriminatory patterns. Services such as Amazon SageMaker Clarify support automated bias detection and explainability, helping teams identify and mitigate unwanted correlations in training data or model predictions. Option A violates AWS guidance, as human-in-the-loop review is required for sensitive decisions. Option B risks amplifying historical bias because training on only “successful” hires can create feedback loops. Option D contradicts transparency principles, which AWS states are crucial for accountability in regulated or ethical decision-making domains. Therefore, rigorous fairness testing aligns with AWS’s recommended practices for responsible AI in hiring workflows.

Referenced AWS Documentation:

AWS Responsible AI Whitepaper – Fairness and Bias Mitigation

Amazon SageMaker Clarify Documentation

AWS Data Exchange is a service that allows companies to securely exchange data with third parties, such as independent software vendors (ISVs). AWS Data Exchange can be configured to provide notifications, including email notifications, when new datasets or compliance reports become available.

Option D (Correct): " AWS Data Exchange " : This is the correct answer because it enables the company to receive notifications, including email messages, when ISVs ' compliance reports are available.

Option A: " AWS Audit Manager " is incorrect because it focuses on assessing an organization ' s own compliance, not receiving third-party compliance reports.

Option B: " AWS Artifact " is incorrect as it provides access to AWS’s compliance reports, not ISVs ' .

Option C: " AWS Trusted Advisor " is incorrect as it offers optimization and best practices guidance, not compliance report notifications.

AWS AI Practitioner References:

AWS Data Exchange Documentation: AWS explains how Data Exchange allows organizations to subscribe to third-party data and receive notifications when updates are available.

The verified answer is D. Bilingual Evaluation Understudy (BLEU) score. The company wants to evaluate whether the chatbot’s generated language matches a target communication style that includes creative spelling and shortened words. AWS AI Practitioner guidance lists BLEU, ROUGE, and BERTScore as relevant metrics for assessing foundation model performance. AWS Prescriptive Guidance describes BLEU as a metric-based evaluation method that measures n-gram overlap and focuses on precision. Because the requirement is about matching a particular style of generated language against reference examples, BLEU is the best fit among the given options.

F1 score is incorrect because it is primarily used for classification-style problems where precision and recall are combined into one score. It is not the correct metric for evaluating generated text style.

BERTScore is incorrect in this specific question because BERTScore focuses on semantic similarity using contextual embeddings. That can be useful when paraphrases should be accepted, but the question emphasizes surface language style: creative spelling, shortened words, and target-audience wording. Those are closer to token and phrase overlap against reference-style responses.

ROUGE is incorrect because ROUGE is commonly used for summarization and measures overlap with reference text, especially recall-oriented overlap. The scenario is not primarily asking whether the chatbot preserved all important content from a source document. It is asking whether the generated response matches a language style.

BLEU is therefore the best answer because it can compare the generated chatbot output to reference examples written in the desired teenage language style and measure how closely the model’s wording overlaps with those references.

Adding a role description to the prompt context is a straightforward way to instruct the generative AI model to adjust its response style based on the user ' s age range. This method requires minimal implementation effort as it does not involve additional training or complex logic.

Option B (Correct): " Add a role description to the prompt context that instructs the model of the age range that the response should target " : This is the correct answer because it involves the least implementation effort while effectively guiding the model to tailor responses according to the age range.

Option A: " Fine-tune the model by using additional training data " is incorrect because it requires significant effort in gathering data and retraining the model.

Option C: " Use chain-of-thought reasoning " is incorrect as it involves complex reasoning that may not directly address the need to adjust response style based on age.

Option D: " Summarize the response text depending on the age of the user " is incorrect because it involves additional processing steps after generating the initial response, increasing complexity.

AWS AI Practitioner References:

Prompt Engineering Techniques on AWS: AWS recommends using prompt context effectively to guide generative models in providing tailored responses based on specific user attributes.

The correct answers are A and E because both directly align with AWS best practices for securing generative AI services and data privacy in enterprise applications.

From the AWS Amazon Q Business documentation:

" AWS Key Management Service (KMS) integrates with Amazon Q Business to encrypt sensitive data at rest. You can use customer-managed KMS keys to meet compliance requirements. "

And:

" You must configure IAM access controls to manage which users and applications can access Amazon Q Business indexes, ensuring that only authorized users can retrieve information. "

Explanation of other options:

B. Cross-account access is not a common requirement for internal enterprise use of Amazon Q Business unless explicitly sharing data across organizations. It’s not a requirement for securing access.

C. Amazon Inspector is a vulnerability management tool for EC2 and containers. It is unrelated to Amazon Q authentication or security.

D. Allowing public access would violate security and privacy principles and directly contradict the stated requirement.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Q Business Developer Guide – Security and Identity Management

AWS KMS Documentation – Integration with Bedrock and Amazon Q

AWS Certified Machine Learning Specialty Guide – Responsible AI and Governance Section

Exploratory data analysis (EDA) involves understanding the data by visualizing it, calculating statistics, and creating correlation matrices. This stage helps identify patterns, relationships, and anomalies in the data, which can guide further steps in the ML pipeline.

Option C (Correct): " Exploratory data analysis " : This is the correct answer as the tasks described (correlation matrix, calculating statistics, visualizing data) are all part of the EDA process.

Option A: " Data pre-processing " is incorrect because it involves cleaning and transforming data, not initial analysis.

Option B: " Feature engineering " is incorrect because it involves creating new features from raw data, not analyzing the data ' s existing structure.

Option D: " Hyperparameter tuning " is incorrect because it refers to optimizing model parameters, not analyzing the data.

AWS AI Practitioner References:

Stages of the Machine Learning Pipeline: AWS outlines EDA as the initial phase of understanding and exploring data before moving to more specific preprocessing, feature engineering, and model training stages.

BERT-based models (Bidirectional Encoder Representations from Transformers) are suitable for tasks that involve understanding the context of words in a sentence and suggesting missing words. These models use bidirectional training, which considers the context from both directions (left and right of the missing word) to predict the appropriate word to fill in the gaps.

BERT-based Models:

BERT is a pre-trained transformer model designed for natural language understanding tasks, including text completion, where certain words are missing.

It excels at understanding context and relationships between words in a sentence, making it ideal for suggesting potential words to fill in missing text.

Why Option D is Correct:

Contextual Understanding: BERT uses its bidirectional training to understand the context around missing words, making it highly accurate in suggesting suitable replacements.

Text Completion Capability: BERT ' s architecture is explicitly designed for tasks like masked language modeling, where certain words in a text are masked (or missing), and the model predicts the missing words.

Why Other Options are Incorrect:

A. Topic modeling: Focuses on identifying topics in a text corpus, not on predicting missing words.

B. Clustering models: Group similar data points together, which is not suitable for predicting missing text.

C. Prescriptive ML models: Focus on providing recommendations based on data analysis, not on natural language processing tasks like filling in missing text.

Transfer learning is the correct strategy for adapting pre-trained models for new, related tasks without creating models from scratch.

Transfer Learning:

Involves taking a pre-trained model and fine-tuning it on a new dataset for a related task.

This approach is efficient because it leverages existing knowledge from a model trained on a large dataset, requiring less data and computational resources than training a new model from scratch.

Why Option B is Correct:

Adaptation of Pre-trained Models: Allows for adapting existing models to new tasks, which aligns with the company ' s goal of not starting from scratch.

Efficiency and Speed: Speeds up the model development process by building on the knowledge of pre-trained models.

Why Other Options are Incorrect:

A. Increase the number of epochs: Does not address the strategy of reusing pre-trained models.

C. Decrease the number of epochs: Similarly, does not apply to adapting pre-trained models.

D. Use unsupervised learning: Does not involve using pre-trained models for new tasks.

Amazon Bedrock is a service that provides foundational models for building generative AI applications. When creating an application for children, it is crucial to ensure that the generated content is appropriate for the target audience. " Guardrails " in Amazon Bedrock provide mechanisms to control the outputs and topics of generated content to align with desired safety standards and appropriateness levels.

Option C (Correct): " Guardrails for Amazon Bedrock " : This is the correct answer because guardrails are specifically designed to help users enforce content moderation, filtering, and safety checks on the outputs generated by models in Amazon Bedrock. For a children’s application, guardrails ensure that all content generated is suitable and appropriate for the intended audience.

Option A: " Amazon Rekognition " is incorrect. Amazon Rekognition is an image and video analysis service that can detect inappropriate content in images or videos, but it does not handle text or story generation.

Option B: " Amazon Bedrock playgrounds " is incorrect because playgrounds are environments for experimenting and testing model outputs, but they do not inherently provide safeguards to ensure content appropriateness for specific audiences, such as children.

Option D: " Agents for Amazon Bedrock " is incorrect. Agents in Amazon Bedrock facilitate building AI applications with more interactive capabilities, but they do not provide specific guardrails for ensuring content appropriateness for children.

AWS AI Practitioner References:

Guardrails in Amazon Bedrock: Designed to help implement controls that ensure generated content is safe and suitable for specific use cases or audiences, such as children, by moderating and filtering inappropriate or undesired content.

Building Safe AI Applications: AWS provides guidance on implementing ethical AI practices, including using guardrails to protect against generating inappropriate or biased content.

Precision is the metric that measures the proportion of true positives (actual frauds) among all flagged positives (flagged frauds). High precision ensures that most of the flagged cases are truly fraudulent, minimizing the number of false positives employees must review.

C is correct:

" Precision is the ratio of true positives to all predicted positives, and it answers: ‘Of all the cases flagged as fraud, how many were actually fraud?’ High precision means fewer non-fraudulent cases are sent for manual review. "

(Reference: AWS ML Concepts – Precision and Recall, AWS Certified AI Practitioner Study Guide)

A (Recall) measures how many actual frauds are caught, but does not minimize false positives.

B (Accuracy) can be misleading in imbalanced datasets (like fraud detection).

Transitioning to a new large language model (LLM) on Amazon Bedrock typically involves minimal changes when the new model is pre-trained and available as a foundation model. Since the company is moving from one pre-trained LLM to another, the primary task is to ensure compatibility between the new model ' s input requirements and the existing application. Adjusting the prompt template is often necessary because different LLMs may have varying prompt formats, tokenization methods, or response behaviors, even for similar tasks like document extraction.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" When switching between foundation models in Amazon Bedrock, you may need to adjust the prompt template to align with the new model’s expected input format and optimize its performance for your use case. Prompt engineering is critical to ensure the model understands the task and generates accurate outputs. "

(Source: AWS Bedrock User Guide, Prompt Engineering for Foundation Models)

Detailed Explanation:

Option A: Create a new labeled dataset.Creating a new labeled dataset is unnecessary when transitioning to a new pre-trained LLM, as pre-trained models are already trained on large datasets. This option would only be relevant if the company were training a custom model from scratch, which is not the case here.

Option B: Perform feature engineering.Feature engineering is typically associated with traditional machine learning models, not pre-trained LLMs. LLMs process raw text inputs, and transitioning to a new LLM does not require restructuring input features. This option is incorrect.

Option C: Adjust the prompt template.This is the correct approach. Different LLMs may interpret prompts differently due to variations in training data, tokenization, or model architecture. Adjusting the prompt template ensures the new LLM understands the task (e.g., document extraction) and produces the desired output format. AWS documentation emphasizes prompt engineering as a key step when adopting a new foundation model.

Option D: Fine-tune the LLM.Fine-tuning is not required for transitioning to a new pre-trained LLM unless the company needs to customize the model for a highly specific task. Since the question does not indicate a need for customization beyond document extraction (a common LLM capability), fine-tuning is unnecessary.

The verified answer is A. Amazon SageMaker Clarify. The requirement is transparency and explainability for a model that supports loan application decisions. AWS documentation states that Amazon SageMaker Clarify provides tools to explain how machine learning models make predictions. These tools help modelers, developers, and stakeholders understand model characteristics before deployment and debug predictions after deployment. AWS also states that transparency about how ML models arrive at predictions is critical to consumers and regulators, which directly matches the financial-services regulatory requirement in the question.

SageMaker Clarify uses feature attribution methods based on SHAP and Shapley values. AWS explains that Shapley values help determine the contribution that each feature made to model predictions and can be provided for specific predictions and globally for the model as a whole. For a loan application model, this can help explain whether features such as income, credit history, or debt ratio had greater influence on the decision.

Amazon Rekognition is incorrect because it is used for computer vision tasks such as image and video analysis, not explaining tabular loan approval decisions. Amazon Comprehend is incorrect because it is an NLP service for extracting insights from text, such as entities, sentiment, or key phrases. It does not provide general model explainability for loan decision models. Amazon SageMaker Model Monitor is incorrect because it monitors model quality and drift in production, but the question asks for explaining how decisions are made. Therefore, SageMaker Clarify is the correct service.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Retrieval Augmented Generation (RAG) enhances LLM responses by:

Retrieving relevant information from external knowledge sources

Injecting retrieved content into the prompt context

Reducing hallucinations and improving factual accuracy

AWS generative AI guidance describes RAG as a best practice when models must use up-to-date or domain-specific knowledge that is not embedded in the model weights.

Why the other options are incorrect:

RL (A) focuses on reward-based learning.

NLP (B) is a broad field, not a specific technique.

Transfer learning (D) adapts model weights but does not retrieve external data at inference time.

AWS AI document references:

Retrieval Augmented Generation on AWS

Improving LLM Accuracy with External Knowledge

Generative AI Architectures

AWS documentation describes LLM-as-a-judge as an automated evaluation technique where a large language model is used to assess the outputs of another model based on qualitative criteria such as helpfulness, correctness, tone, and alignment with expectations. This approach enables scalable and repeatable evaluations without requiring human reviewers.

In this scenario, the company needs to compare two foundation models across subjective dimensions that are difficult to measure using traditional metrics. LLM-as-a-judge allows the evaluator model to score or rank responses using predefined evaluation prompts and criteria, ensuring consistent and automated assessment.

The other options do not meet the requirements. String matching and ROUGE focus on lexical similarity and are unsuitable for evaluating tone or helpfulness in customer service interactions. Retrieval Augmented Generation is an architectural pattern, not an evaluation technique.

AWS highlights LLM-as-a-judge as a practical approach for automated qualitative evaluation of generative AI outputs, making it the correct choice.

Amazon SageMaker Ground Truth Plus is a managed data labeling service that includes human-in-the-loop (HITL) validation. This solution ensures high accuracy by involving human reviewers to validate the annotations and reduce the risk of incorrect annotations.

Amazon SageMaker Ground Truth Plus:

It allows for the creation of high-quality training datasets with human oversight, which minimizes errors in labeling and increases accuracy.

Human-in-the-loop workflows help verify the correctness of annotations, ensuring that generated images for protective eyewear meet high-quality standards.

Why Option A is Correct:

High Accuracy: Human-in-the-loop validation provides the ability to catch and correct errors in annotations, ensuring high-quality data.

Minimized Risk of Incorrect Annotations: Human review adds a layer of quality assurance, which is especially important in use cases like generating precise images for protective eyewear.

Why Other Options are Incorrect:

B. Amazon Bedrock: Does not offer a knowledge base for data augmentation; it focuses on running foundation models.

C. Amazon Rekognition: Provides image recognition and analysis, not a solution for minimizing annotation errors.

D. Amazon QuickSight: A data visualization tool, not relevant to image annotation or generation tasks.

Thus, A is the correct answer for generating high-accuracy images with minimized annotation risks.

The correct answer is B, because AWS recommends that any generative AI initiative begin with use-case clarification, stakeholder alignment, and measurable business objectives. According to the AWS Generative AI Adoption Framework and the AWS Machine Learning Journey guidelines, successful AI projects start with defining specific business outcomes—such as revenue growth, reduced time-to-market, or improved campaign efficiency. Conducting stakeholder interviews ensures the organization identifies the highest-value marketing use cases, such as personalized campaigns or content generation, and sets KPIs to measure revenue impact within the target timeframe. AWS documentation emphasizes avoiding premature model training (option A), which is costly and unnecessary without validated requirements. Implementing a prebuilt assistant (option C) may help operations but does not guarantee alignment with the core revenue objective. Replicating competitor features (option D) may lack strategic alignment. Therefore, refining use cases and measurable goals is the foundational AWS-recommended approach for a targeted revenue-driven generative AI initiative.

Referenced AWS Documentation:

AWS Generative AI Adoption Framework

AWS ML Business Value and Use-Case Identification Guidelines

The F1 score is a metric used to evaluate the performance of a classification model by considering both precision and recall. Precision measures the accuracy of positive predictions (i.e., the proportion of true positive predictions among all positive predictions made by the model), while recall measures the model ' s ability to identify all relevant positive instances (i.e., the proportion of true positive predictions among all actual positive instances). The F1 score is the harmonic mean of precision and recall, providing a single metric that balances both concerns. This is particularly useful when dealing with imbalanced datasets or when the cost of false positives and false negatives is significant. Options B, C, and D pertain to other aspects of model performance but are not related to the F1 score.

The verified answers are A. Model evaluation and C. AI model service cards. The question is specifically about explainability and transparency with model selections before a generative AI application goes to production. AWS AI Practitioner guidance identifies model selection as part of the foundation model lifecycle and includes evaluation as a required activity in that lifecycle. AWS also lists model-selection factors such as model type, performance requirements, capabilities, constraints, compliance, modality, latency, model complexity, customization, and input/output length. This means model evaluation directly supports responsible selection because it provides measurable evidence that a model meets the application’s business, technical, and governance requirements.

AI model service cards are also correct because AWS describes AI Service Cards as responsible AI documentation that improves transparency. AWS states that AI Service Cards provide information about intended use cases, limitations, responsible AI design choices, and performance optimization best practices for AWS AI services and models. AWS also links these cards to responsible AI areas such as fairness, bias, explainability, robustness, governance, transparency, privacy, and security. That directly addresses the company’s concern about transparency when choosing models.

Guardrails is not the best answer here. Guardrails are important for safety controls, denied topics, content filtering, and responsible runtime behavior, but the question focuses on explainability and transparency in model selection, not output filtering. Data encryption is incorrect because encryption protects data confidentiality at rest or in transit; it does not explain model behavior or document model limitations. Automated reasoning is also not the best match. It can support formal validation of specific policy-based logic, but it is not the primary AWS tool or technique for transparent model selection. Therefore, model evaluation and AI model service cards are the two techniques/tools that best address the stated requirement.

Explainability refers to the ability of an AI system to make its decision-making process clear and understandable to humans.

A is correct:

" Explainability is crucial for human-centered AI, especially in healthcare, to ensure that doctors and patients understand the rationale behind AI-driven recommendations. "

(Reference: AWS Responsible AI)

B relates to protecting data, not explanations.

C is about treating groups equally.

D is about managing data lifecycle, not providing rationales.

Building a well-architected ML workload follows a structured lifecycle as outlined in AWS best practices. The process begins with defining the business goal and framing the ML problem to ensure the project aligns with organizational objectives. Next, the model is developed, which includes data preparation, training, and evaluation. Once the model is ready, it is deployed tomake predictions in a production environment. Finally, the model is monitored to ensure it performs as expected and to address any issues like drift or degradation over time. This order ensures a systematic approach to ML development.

Exact Extract from AWS AI Documents:

From the AWS AI Practitioner Learning Path:

" The machine learning lifecycle typically follows these stages: 1) Define the business goal and frame the ML problem, 2) Develop the model (including data preparation, training, and evaluation), 3) Deploy the model to production, and 4) Monitor the model for performance and drift to ensure it continues to meet business needs. "

(Source: AWS AI Practitioner Learning Path, Module on Machine Learning Lifecycle)

Detailed Explanation:

Step 1: Define business goal and frame ML problemThis is the first step in any ML project. It involves understanding the business objective (e.g., reducing churn) and framing the ML problem (e.g., classification or regression). Without this step, the project lacks direction. The hotspot lists this option as " Define business goal and frame ML problem, " which matches this stage.

Step 2: Develop modelAfter defining the problem, the next step is to develop the model. This includes collecting and preparing data, selecting an algorithm, training the model, and evaluating its performance. The hotspot lists " Develop model " as an option, aligning with this stage.

Step 3: Deploy modelOnce the model is developed and meets performance requirements, it is deployed to a production environment to make predictions or automate decisions. The hotspot includes " Deploy model " as an option, which fits this stage.

Step 4: Monitor modelAfter deployment, the model must be monitored to ensure it performs well over time, addressing issues like data drift or performance degradation. The hotspot lists " Monitor model " as an option, completing the lifecycle.

Hotspot Selection Analysis:

The hotspot provides four steps, each with the same dropdown options: " Select..., " " Deploy model, " " Develop model, " " Monitor model, " and " Define business goal and frame ML problem. " The correct selections are:

Step 1: Define business goal and frame ML problem

Step 2: Develop model

Step 3: Deploy model

Step 4: Monitor model

Each option is used exactly once, as required, and follows the logical order of the ML lifecycle.

Adjusting the prompt is the correct solution to align the LLM outputs with the company ' s expectations for short, specific language responses.

Adjust the Prompt:

Modifying the prompt can guide the LLM to produce outputs that are shorter and tailored to the desired language.

A well-crafted prompt can provide specific instructions to the model, such as " Answer in a short sentence in Spanish. "

Why Option A is Correct:

Control Over Output: Adjusting the prompt allows for direct control over the style, length, and language of the LLM outputs.

Flexibility: Prompt engineering is a flexible approach to refining the model’s behavior without modifying the model itself.

Why Other Options are Incorrect:

B. Choose an LLM of a different size: The model size does not directly impact the response length or language.

C. Increase the temperature: Increases randomness in responses but does not ensure brevity or specific language.

D. Increase the Top K value: Affects diversity in model output but does not align directly with response length or language specificity.

Experimenting and refining the prompt is the best approach to ensure that the chatbot using a foundation model (FM) produces responses that adhere to the company ' s tone.

Prompt Engineering:

Adjusting and refining the prompt allows for better control over the FM ' s outputs, ensuring they align with the desired tone and style.

This iterative process involves testing different prompts and modifying them based on the model ' s responses to achieve the desired outcome.

Why Option C is Correct:

Directly Influences Output Quality: Allows for fine-tuning of the model’s responses to match the company ' s tone.

Cost-Effective: Does not require modifying the model itself, only the inputs to it.

Why Other Options are Incorrect:

A. Low limit on tokens: Limits response length but not the adherence to company tone.

B. Batch inferencing: Relates to processing multiple inputs, not controlling response tone.

D. Higher temperature: Increases randomness in responses, which could deviate from the desired tone.

The correct answer is C – A CSV file that consists of measurement data, which is a classic example of structured data. According to AWS documentation, structured data is data that is organized in a predefined schema, typically stored in tabular formats with fixed rows, columns, and data types. CSV files, relational databases, and spreadsheets fall into this category because their structure allows deterministic querying and processing. Measurement data contained in a CSV file is easy to analyze with SQL, Amazon Athena, Amazon Redshift, or SageMaker Data Wrangler. In contrast, options A and D (text comments and transcriptions) are examples of unstructured data, requiring NLP techniques. Option B (video files) represents unstructured multimedia data, requiring computer vision. Structured data is essential for supervised ML models, business analytics, and statistical modeling. AWS emphasizes that structured data provides the simplest path to feature engineering and model training due to its consistent format.

Referenced AWS Documentation:

AWS Data Analytics Whitepaper – Structured vs. Unstructured Data

Amazon SageMaker Data Wrangler Documentation

Unsupervised learning involves discovering hidden patterns without labeled data. Example: clustering.

Image recognition (B) is supervised learning.

House price prediction (C) is regression (supervised).

Dataset 1: A dataset that contains text-based customer reviews → Natural language processing (NLP)

NLP is designed for analyzing text (sentiment analysis, text classification, etc.).

Dataset 2: A dataset that contains images of animals labeled with their species names → Computer vision

Computer vision models classify or detect objects in images.

Dataset 3: A dataset that contains daily sales volumes for products → Time series forecasting

Time series forecasting predicts future values based on historical sequential data (like sales, demand, stock prices).

The company wants to fine-tune an ML model on Amazon Bedrock using sensitive data stored in private databases within a VPC, ensuring the data remains within its private network. AWS PrivateLink provides a secure, private connection between a VPC and AWS services like Amazon Bedrock, allowing data to stay within the company’s network without traversing the public internet. This meets the requirement for maintaining data privacy during fine-tuning.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" AWS PrivateLink enables you to securely connect your VPC to Amazon Bedrock without exposing data to the public internet. This is particularly useful for fine-tuning models with sensitive data, as it ensures that data remains within your private network. "

(Source: AWS Bedrock User Guide, Security and Networking)

Detailed Explanation:

Option A: Restrict access to Amazon Bedrock by using an AWS Identity and Access Management (IAM) service role.While IAM service roles control access to Amazon Bedrock, they do not address the requirement of keeping data within the private network during data transfer. This option is insufficient.

Option B: Restrict access to Amazon Bedrock by using an AWS Identity and Access Management (IAM) resource policy.IAM resource policies define permissions for Bedrock resources but do not ensure that data stays within the private network. This option is incorrect.

Option C: Use AWS PrivateLink to connect the VPC and Amazon Bedrock.This is the correct answer. AWS PrivateLink creates a secure, private connection between the VPC and Amazon Bedrock, ensuring that sensitive data does not leave the private network during fine-tuning, as required.

Option D: Use AWS Key Management Service (AWS KMS) keys to encrypt the data.While AWS KMS can encrypt data, encryption alone does not guarantee that data remains within the private network during transfer. This option does not fully meet the requirement.

The verified answer is C. Use the LLM-as-a-judge approach with a rubric across prompts to compare model outputs. The question asks for a scalable way to compare two foundation models for chat summarization based on correctness and completeness. AWS documentation for Amazon Bedrock model evaluation states that an evaluation job using a judge model uses an LLM to score another model’s responses and provide an explanation of how it scored each prompt and response pair. This is specifically designed to compare model outputs across prompt datasets at scale, without requiring every output to be manually scored by humans.

AWS Bedrock documentation also lists built-in metrics for model evaluation jobs that use an LLM as a judge. The valid built-in metrics include Correctness and Completeness, which directly match the evaluation criteria in the question. Therefore, using LLM-as-a-judge with a rubric across prompts is the best fit because it evaluates the actual summaries produced by each model against the desired quality dimensions.

Option A is partially valid as an evaluation method, but it is not the most scalable approach. Human reviewers can provide high-quality judgments, but manual review becomes expensive and slow when comparing many prompts, outputs, and models. Option B is incorrect because latency and throughput measure operational performance, not whether a summary is correct or complete. A fast model can still produce incomplete or inaccurate summaries. Option D is incorrect because external benchmark rankings are generic. They do not prove that a model performs best on the company’s specific chat summarization workload.

The decisive terms are “scalable,” “correctness,” and “completeness.” Amazon Bedrock LLM-as-a-judge evaluation directly supports those dimensions, so option C is correct.

With Amazon Bedrock, AWS handles infrastructure security and patching (shared responsibility model).

Customers are responsible for securing their data (encryption, IAM, policies) both in transit and at rest.

Provisioning infrastructure (D) and platform patching (A, B) are AWS responsibilities.

???? Reference:

AWS Shared Responsibility Model

Amazon Personalize is a fully managed ML service for personalized recommendations (movies, products, music, etc.) based on user behavior and history.

Polly converts text to lifelike speech.

Comprehend performs NLP tasks like sentiment analysis.

Transcribe is speech-to-text.

???? Reference:

AWS Documentation – Amazon Personalize

Artificial Intelligence (AI) is the broad field focused on simulating human problem-solving and cognitive abilities, including reasoning, perception, and decision-making.

(Reference: AWS Certified AI Practitioner Official Study Guide)

Machine Learning (ML) is a subset of AI that uses data-driven algorithms to identify patterns and make predictions without explicit programming for each specific task.

(Reference: AWS Machine Learning Overview)

Deep learning is a subset of ML that uses neural networks with many layers (deep neural networks) to process complex data and extract high-level features.

(Reference: AWS Deep Learning on AWS)

Transfer learning is a machine learning technique that reuses knowledge learned from previous tasks to improve training efficiency and performance on new tasks. AWS documentation explains that transfer learning allows models to start from pretrained weights or representations, reducing training time and the amount of data required.

In this retail application scenario, the company wants to leverage information from prior tasks to increase learning speed, which is a defining characteristic of transfer learning. AWS emphasizes that transfer learning is especially effective when tasks are related, such as customer behavior analysis, product recommendations, or demand forecasting.

By initializing a model with learned features from an existing task, transfer learning enables faster convergence and improved accuracy compared to training from scratch. AWS frequently recommends this approach when computational efficiency and rapid iteration are important.

The other options do not satisfy the requirement. Supervised learning defines how labels are used but does not reuse prior knowledge. Hyperparameter tuning optimizes model configuration but does not leverage previous task outputs. Regularization techniques reduce overfitting but do not accelerate learning through knowledge reuse.

AWS documentation positions transfer learning as a foundational concept in modern ML workflows, particularly for retail, personalization, and natural language processing use cases. Therefore, transfer learning is the correct solution.

Creating an Amazon Bedrock knowledge base allows the integration of external or private data sources with a foundation model (FM) like Amazon Titan. This integration helps supplement the model with relevant data from the company ' s private data sources to enhance its responses.

Option C (Correct): " Create an Amazon Bedrock knowledge base " : This is the correct answer as it enables the company to incorporate private data into the FM to improve its effectiveness.

Option A: " Use a different FM " is incorrect because it does not address the need to supplement the current model with private data.

Option B: " Choose a lower temperature value " is incorrect as it affects output randomness, not the integration of private data.

Option D: " Enable model invocation logging " is incorrect because logging does not help in supplementing the model with additional data.

AWS AI Practitioner References:

Amazon Bedrock and Knowledge Integration: AWS explains how creating a knowledge base allows Amazon Bedrock to use external data sources to improve the FM’s relevance and accuracy.

The verified answer is C. Amazon Inspector. The company needs automated vulnerability assessment for Amazon EC2-based infrastructure. AWS documentation states that Amazon Inspector scans EC2 instances for package vulnerabilities and network reachability issues and produces findings. It compares instance metadata against vulnerability intelligence and security advisory rules. This is exactly the service used to assess EC2 infrastructure before deploying sensitive workloads such as generative AI models.

AWS also documents that Amazon Inspector scans EC2 instances for common vulnerabilities and exposures, operating system package vulnerabilities, programming language package vulnerabilities, network exposure issues, and network reachability issues. This confirms that Inspector is the correct service for automated vulnerability assessment of EC2-based ML infrastructure.

AWS CloudFormation is incorrect because it provisions infrastructure as code. It can create EC2 instances, security groups, and related resources, but it does not perform vulnerability assessment. Amazon Comprehend is incorrect because it is a natural language processing service used to extract insights from text. It does not scan infrastructure. AWS Trusted Advisor is incorrect because it provides best-practice recommendations across categories such as cost optimization, security, performance, and service limits, but it is not the dedicated automated vulnerability assessment service for EC2 instances.

The requirement is specific: scan EC2-based ML infrastructure for vulnerabilities before deployment. The AWS-native service that performs this function is Amazon Inspector.

The correct answer is C because Amazon Bedrock ' s model evaluation feature allows users to compare outputs from different foundation models using human evaluation or automatic metrics. It enables the creation of structured evaluations where human reviewers (in this case, scientists) can assess model responses based on custom criteria like relevance, coherence, or accuracy.

From AWS documentation:

" Amazon Bedrock provides model evaluation capabilities that support both automatic and human evaluation. You can define custom evaluation prompts and collect assessments from reviewers to compare foundation model outputs for tasks such as summarization, text generation, and more. "

This solution is ideal for research workflows requiring domain experts to provide feedback on LLM-generated content.

Explanation of other options:

A. Amazon Personalize is used for building recommendation systems, not for evaluating model output.

B. Amazon Rekognition is used for analyzing images and videos (e.g., moderation, facial recognition), not textual output.

D. Amazon Comprehend provides NLP services like sentiment analysis, but sentiment is not sufficient for full quality evaluation of research paper generation.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Model Evaluation Overview

AWS Generative AI Best Practices

AWS ML Specialty Study Guide – Evaluation and Feedback Loops in LLMs

Benchmark datasets are pre-validated datasets specifically designed to evaluate machine learning models for bias, fairness, and potential discrimination. These datasets are the most efficient tool for assessing an LLM’s performance against known standards with minimal administrative effort.

Option D (Correct): " Benchmark datasets " : This is the correct answer because using standardized benchmark datasets allows the company to evaluate model outputs for bias with minimal administrative overhead.

Option A: " User-generated content " is incorrect because it is unstructured and would require significant effort to analyze for bias.

Option B: " Moderation logs " is incorrect because they represent historical data and do not provide a standardized basis for evaluating bias.

Option C: " Content moderation guidelines " is incorrect because they provide qualitative criteria rather than a quantitative basis for evaluation.

AWS AI Practitioner References:

Evaluating AI Models for Bias on AWS: AWS supports using benchmark datasets to assess model fairness and detect potential bias efficiently.

To build an AI model responsibly and minimize bias, it is essential to ensure fairness and transparency throughout the model development and deployment process. This involves detecting and mitigating data imbalances and thoroughly evaluating the model ' s behavior to understand its impact on different groups.

Option A (Correct): " Detect imbalances or disparities in the data " : This is correct because identifying and addressing data imbalances or disparities is a critical step in reducing bias. AWS provides tools like Amazon SageMaker Clarify to detect bias during data preprocessing and model training.

Option C (Correct): " Evaluate the model ' s behavior so that the company can provide transparency to stakeholders " : This is correct because evaluating the model ' s behavior for fairness and accuracy is key to ensuring that stakeholders understand how the model makes decisions. Transparency is a crucial aspect of responsible AI.

Option B: " Ensure that the model runs frequently " is incorrect because the frequency of model runs does not address bias.

Option D: " Use the Recall-Oriented Understudy for Gisting Evaluation (ROUGE) technique to ensure that the model is 100% accurate " is incorrect because ROUGE is a metric for evaluating the quality of text summarization models, not for minimizing bias.

Option E: " Ensure that the model ' s inference time is within the accepted limits " is incorrect as it relates to performance, not bias reduction.

AWS AI Practitioner References:

Amazon SageMaker Clarify: AWS offers tools such as SageMaker Clarify for detecting bias in datasets and models, and for understanding model behavior to ensure fairness and transparency.

Responsible AI Practices: AWS promotes responsible AI by advocating for fairness, transparency, and inclusivity in model development and deployment.

Amazon SageMaker is AWS’s fully managed ML service that supports retraining and deploying models with new, recent data for continuous improvement. This directly meets the requirement to iterate and continuously improve model accuracy.

A is correct:

" Amazon SageMaker enables teams to retrain models using the most recent data, ensuring ongoing improvement in model accuracy. "

(Reference: Amazon SageMaker Overview)

B (Amazon Personalize) is for recommendations, not general ML or waste reduction.

C (CloudWatch) is for monitoring, not ML training or deployment.

D (Rekognition) is for image/video analysis.

The correct answer is Amazon Bedrock, AWS’s fully managed service for building and scaling generative AI applications using foundation models (FMs). Bedrock gives developers access to models from leading providers such as Anthropic (Claude), Meta (Llama), Mistral, Cohere, and Amazon Titan. Users can invoke these models via API without managing infrastructure or model training. According to AWS documentation, Bedrock supports tasks such as text generation, summarization, question answering, image generation, and RAG workflows with minimal setup. It supports both on-demand and provisioned throughput modes and integrates with features like Guardrails, Knowledge Bases, and Agents for secure, enterprise-grade applications. Amazon Q Developer is a generative AI tool for developers, but it doesn’t host or scale models. Amazon Kendra is an intelligent search engine, and Amazon Comprehend is used for NLP tasks like entity extraction—not foundation model access.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Foundation Models and Use Cases

AWS Certified ML Specialty Guide – Generative AI on AWS

Anomaly detection identifies unusual behavior (such as suspicious IP traffic) compared to normal baselines.

Speech recognition (A) is irrelevant.

NER in NLP (B) extracts entities from text, not detect malicious IPs.

Fraud forecasting (D) predicts fraudulent transactions but not directly suspicious IP activity.

???? Reference:

AWS Documentation – Anomaly Detection

Inference = applying a trained ML model to new, unseen data to make predictions, classifications, or generate outputs.

A is algorithm research, C refers to ensemble learning, D is data collection.

???? Reference:

AWS ML Glossary – Inference

Comprehensive and Detailed Explanation (AWS AI documents):

AWS Responsible AI best practices emphasize that bias should be detected, measured, mitigated, and monitored throughout the ML lifecycle, especially for sensitive domains such as healthcare. When biased outcomes are observed, AWS guidance recommends addressing bias at the data and model level, not only at the output level.

Using Amazon SageMaker Clarify aligns directly with AWS Responsible AI principles because it is designed to:

Detect and quantify bias in datasets and model predictions across sensitive attributes such as demographic groups

Provide pre-training and post-training bias metrics, allowing practitioners to identify where bias originates

Support data-centric mitigation, including improving dataset balance and representativeness

After identifying bias with SageMaker Clarify, collecting additional balanced training data and retraining the model helps ensure that:

The model learns from a more representative dataset

Disparate treatment recommendations based on demographics are reduced

Fairness is improved while maintaining clinical accuracy

Why the other options are not sufficient or aligned with AWS best practices:

B. Prompt engineering can influence outputs but does not address underlying data or model bias and is not sufficient for regulated, high-risk domains like healthcare.

C. Content filtering removes outputs after generation but does not prevent biased decision-making by the model itself.

D. Separate FM endpoints by demographic group increases the risk of reinforcing bias and violates fairness principles rather than mitigating them.

AWS AI Study Guide References:

AWS Responsible AI principles: Fairness and Governance

Amazon SageMaker Clarify: bias detection and mitigation

AWS best practices for ML in high-risk domains such as healthcare

When a model performs well on training data but poorly on evaluation/test data, it indicates overfitting.

Overfitting: The model memorizes the training data patterns instead of generalizing.

Underfitting (A) means the model performs poorly on both training and test data.

Bias (C) refers to systemic errors in predictions, not this training/test mismatch.

Prompt engineering (B) applies to generative AI, not general ML training models.

???? Reference:

AWS ML Glossary – Overfitting and Underfitting

Object detection is the correct strategy for automatically identifying and categorizing animals in photos.

Object Detection:

A computer vision technique that identifies and locates objects within an image and assigns them to predefined categories.

Ideal for tasks such as identifying animals in photos, where the goal is to detect specific objects (animals) and categorize them accordingly.

Why Option A is Correct:

Automatic Identification: Object detection models can automatically identify different types of animals in the images without manual intervention.

Categorization Capability: Assigns labels to detected objects, fulfilling the requirement for categorizing animals.

Why Other Options are Incorrect:

B. Anomaly detection: Identifies outliers or unusual patterns, not specific objects in images.

C. Named entity recognition: Used in NLP to identify entities in text, not for image processing.

D. Inpainting: Used for filling in missing parts of images, not for detecting or categorizing objects.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Conversion rate measures the percentage of users who take a desired business action, such as completing a purchase after receiving recommendations.

In the context of:

Personalized product recommendations

Measuring direct impact on sales revenue

Conversion rate is the most relevant business metric, as it directly correlates AI-driven recommendations with revenue-generating outcomes.

Why the other options are incorrect:

Cross-domain performance (A) evaluates generalization across datasets, not revenue.

Solution efficiency (B) focuses on performance and cost, not sales impact.

User satisfaction (C) measures experience quality, not financial outcomes.

AWS AI document references:

AWS Generative AI Use Case Evaluation Guidance

Measuring Business Impact of AI Solutions

AI Metrics and KPIs on AWS

The correct answer is A, as the most effective way to ensure fairness in AI systems is to audit and diversify training data. AWS Responsible AI documentation stresses that bias originates primarily from unbalanced or incomplete datasets. By including samples from all demographic groups, the model learns patterns that generalize fairly across populations. AWS SageMaker Clarify supports data bias detection and offers fairness metrics like demographic parity and equal opportunity difference. Deeper models (option B) or secrecy (option C) do not mitigate bias and may worsen transparency . Static test datasets (option D) fail to capture evolving data distributions. Therefore, ongoing bias reviews and diverse datasets form the foundation of responsible generative AI for financial use cases.

Referenced AWS AI/ML Documents and Study Guides:

AWS Responsible AI Whitepaper – Fairness and Bias Mitigation

Amazon SageMaker Clarify Documentation – Bias Detection

AWS Artifact provides compliance reports and certifications (ISO, SOC, GDPR-related documentation) to prove regulatory adherence.

The verified answer is D. Amazon Nova Premier. The decisive requirement is the combination of a 1 million-token context window, multimodal document understanding, chart analysis, and video input. AWS documentation identifies Amazon Nova Premier as the most capable multimodal Amazon Nova understanding model. It supports text, image, and video inputs and generates text output. AWS also lists Amazon Nova Premier with a 1M context window, while Amazon Nova Pro and Amazon Nova Lite support 300k, and Amazon Nova Micro supports 128k and is text-only. Because the company’s legal documents are up to 1 million tokens long, Nova Premier is the only listed option that satisfies the context-length requirement.

AWS documentation also states that Amazon Nova Premier has a supported context length of 1 million tokens, which AWS equates to 1 million tokens of text, 500 images, or 90 minutes of video. The same documentation explains that Nova Premier excels at question answering on long documents. This directly matches the research company’s need to analyze very long legal documents and ingest video summaries for compliance reporting.

Amazon Nova Micro is incorrect because it is a text-only model and has a smaller context window. It cannot process embedded high-resolution charts or video inputs. Amazon Nova Lite is incorrect because it is multimodal, but its context window is 300k, which is below the 1 million-token requirement. Amazon Nova Pro is also incorrect for the same reason: it is highly capable and multimodal, but its context window is 300k rather than 1M. The requirement is not simply “multimodal”; it is long-context multimodal analysis at the 1 million-token scale. Therefore, the only model that fully meets the requirements is Amazon Nova Premier.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Hallucinations occur when an AI model generates incorrect, fabricated, or misleading outputs that appear plausible but are factually wrong.

AWS generative AI guidance identifies hallucinations as:

A common limitation of generative models

A risk when models generate numerical or factual data

A key reason for validation and human review in critical use cases

Why the other options are incorrect:

Safety (B) relates to harmful or restricted content.

Interpretability (C) refers to understanding how a model makes decisions.

Cost (D) concerns operational expenses.

AWS AI document references:

Generative AI Risks and Limitations

Responsible Use of Foundation Models

Model Validation Best Practices

The verified answer is A. Review the training data to check for biases. Include data from all demographics in the training data. The application is being used for loan approval decisions, so fairness is critical. AWS Machine Learning Lens guidance states that teams should analyze whether training data adequately represents the diversity of the user population and check for existing biases in labels or features that could be perpetuated by the model. AWS also recommends evaluating and preparing representative training data, analyzing training data for potential biases, verifying that the data accurately represents the population on which the model will be deployed, and addressing representation gaps.

This directly matches option A. For loan decisions, biased or unrepresentative training data can cause unfair outcomes for demographic groups. Reviewing the training data and including representative data from all demographics helps reduce the risk that the model learns patterns that disadvantage underrepresented groups.

Option B is incorrect because a deep learning model with many hidden layers does not automatically make a system fair. In fact, more complex models can be harder to interpret and may still learn biased patterns from biased data.

Option C is incorrect because secrecy conflicts with responsible AI principles. Financial loan decisions often require transparency, explainability, governance, and auditability. Hiding the decision process does not make outputs fair.

Option D is incorrect because monitoring only a static test dataset is insufficient. A static dataset may not represent changing real-world populations, drift, or emerging bias. AWS guidance recommends tracking fairness metrics over time and detecting emerging bias in deployment.

Therefore, the correct solution is to review and balance representative training data across demographics.

The correct answer is A because temperature controls the randomness of a language model ' s output. A higher temperature increases diversity by making the model more likely to explore less probable tokens, while a lower temperature results in more deterministic and repetitive outputs.

From AWS documentation:

" The temperature parameter in LLMs adjusts the randomness of generated responses. Higher values (e.g., 0.8–1.0) produce more creative and diverse output, while lower values (e.g., 0.1–0.3) make output more focused and repetitive. "

Explanation of other options:

B. Batch size is related to training efficiency, not output diversity.

C. Learning rate affects the training convergence rate, not inference-time output variety.

D. Optimizer type is a training configuration that influences how the model learns during training, not diversity during inference.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock – Parameter Tuning Guide

AWS Machine Learning Specialty Guide – LLM Inference Parameters

Amazon SageMaker Model Cards are specifically designed to support transparency, responsible AI, and governance throughout the machine learning lifecycle. According to AWS AI documentation, Model Cards provide a structured way to document critical information about machine learning models, including intended use cases, business context, training data assumptions, evaluation metrics, ethical considerations, and known limitations or risks. This makes Model Cards the correct feature for the requirements described.

AWS emphasizes that Model Cards help organizations meet internal governance standards and external regulatory or compliance expectations by improving model interpretability and accountability. They allow AI practitioners to clearly explain why a model was built, how it was trained, what data it relies on, and what risks or biases may exist. This aligns directly with the need to document business problems, training considerations, and usage risks.

Other options do not fully address these needs. Amazon SageMaker Model Registry focuses on versioning, approval workflows, and deployment tracking of models, but it does not provide comprehensive documentation for transparency or ethical considerations. Amazon SageMaker Model Monitor is designed to detect data drift, bias drift, and performance degradation in production, not to document assumptions or governance details. Model Dashboard offers a centralized view of deployed models and endpoints but does not provide structured, narrative documentation of model intent or risks.

AWS positions Model Cards as a core component of Responsible AI, enabling organizations to promote fairness, explainability, and trust in machine learning systems. By capturing standardized, auditable documentation, Model Cards ensure that stakeholders—including developers, auditors, and business leaders—can understand how a recommendation system should be used and where caution is required.

The correct answer is Text embeddings model, which transforms input text into dense vector representations. These vectors preserve semantic meaning and are ideal for similarity search, retrieval-augmented generation (RAG), and semantic search use cases, especially with Amazon OpenSearch Service. According to AWS Bedrock documentation, embeddings models are specifically designed to map text into a numerical space where related concepts are placed closer together. This allows efficient querying and ranking of documents based on the user’s question. This step is critical in chatbots using private knowledge bases. Text completion and instruction-following models focus on generating or following tasks, not producing embeddings. Image generation models are irrelevant here. Therefore, using a text embeddings model ensures that the chatbot retrieves contextually relevant results from stored vectors.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Text Embeddings Models

AWS ML Specialty Guide – Semantic Search and Vector Databases

BLEU (Bilingual Evaluation Understudy) is the standard metric for evaluating machine translation quality across multiple languages.

ROUGE is for summarization quality (not translation).

AUC is for classification model performance.

Precision is a general metric but not specific for evaluating translations.

???? Reference:

AWS Documentation – Evaluation Metrics for NLP

Amazon Textract is a service that automatically extracts text and data from scanned documents, including PDFs. It is the best choice for converting resumes from PDF format to plain text for further processing.

Amazon Textract:

Extracts text, forms, and tables from scanned documents accurately.

Ideal for automating the process of converting PDF resumes into plain text format.

Why Option A is Correct:

Automation of Text Extraction: Textract is designed to handle large volumes of documents and convert them into machine-readable text, perfect for the company ' s need.

Scalability and Efficiency: Supports scalability to handle a growing volume of resumes as the company expands.

Why Other Options are Incorrect:

B. Amazon Personalize: Used for creating personalized recommendations, not for text extraction.

C. Amazon Lex: A service for building conversational interfaces, not for processing documents.

D. Amazon Transcribe: Used for converting speech to text, not for extracting text from documents.

Summarization is a natural language processing (NLP) task that condenses long documents into concise, meaningful summaries while retaining the key information.

Regression predicts numerical values.

Clustering groups similar items.

Classification assigns data into predefined categories.

???? Reference:

AWS NLP Use Cases – Summarization

The correct answer is D – Purchase Provisioned Throughput on Amazon Bedrock, which provides guaranteed and predictable model capacity for workloads with consistent or steady request volume. According to AWS Bedrock documentation, Provisioned Throughput is specifically designed for production applications that require reliable, consistent inference performance at a controlled cost. It allows customers to reserve a fixed number of model inference units (MIUs), ensuring low latency and cost savings compared to on-demand pricing when traffic is steady. On-demand throughput (option B) is ideal for unpredictable or sporadic usage, but it becomes more expensive for stable traffic patterns because it charges per token with no discount for steady volume. Hosting the model on EC2 (option A) or Lambda (option C) increases operational overhead, requires model containerization, scaling management, and may not support LLM-level GPU performance efficiently. Bedrock Provisioned Throughput eliminates infrastructure management and provides the most cost-effective solution for stable, predictable workloads.

Referenced AWS Documentation:

Amazon Bedrock Developer Guide – Provisioned Throughput

AWS ML Specialty Study Guide – Cost Optimization for Generative AI

The correct answer is D because Amazon Bedrock provides access to foundation models (FMs) from various providers for generative AI use cases, including text generation. It supports generating content in a consistent tone, voice, or writing style using prompts or few-shot examples.

From AWS documentation:

" Amazon Bedrock allows you to build and scale generative AI applications using foundation models from AI21 Labs, Anthropic, Cohere, Meta, Mistral, Stability AI, and Amazon. These models can generate text with controlled tone and style for applications like branding, content creation, and copywriting. "

Explanation of other options:

A. Amazon Comprehend is for natural language understanding, such as sentiment analysis and entity recognition, not generation.

B. Amazon Personalize is for building recommendation systems, not content generation.

C. Amazon Rekognition is for image and video analysis, not text generation.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Generative AI Use Cases

AWS Certified Machine Learning Specialty Guide – Content Generation with FMs

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Amazon Bedrock supports importing custom foundation models that have been trained or fine-tuned outside of Bedrock, including models customized using Amazon SageMaker AI.

Amazon SageMaker AI provides:

Full control over model training and fine-tuning

Ability to train models using approved internal datasets

Advanced customization beyond prompt-based techniques

After customization in SageMaker, the trained model can be imported into Amazon Bedrock for managed, scalable inference and internal deployment.

Why the other options are incorrect:

A (Guardrails) enforce safety, compliance, and output controls; they do not create or fine-tune models.

B (Amazon Personalize) is a recommendation service, not a foundation model customization tool.

C (Agents) orchestrate tasks and tool usage but do not modify or fine-tune model weights.

AWS AI document references:

Amazon Bedrock Documentation — section on Custom model import

Amazon SageMaker AI Overview — section on model training and fine-tuning

Foundation Models on AWS — customization approaches

AWS CloudTrail is a service that enables governance, compliance, and operational and risk auditing of your AWS account. It tracks API calls and identifies unauthorized access attempts to AWS resources, including Amazon Bedrock.

AWS CloudTrail:

Provides detailed logs of all API calls made within an AWS account, including those to Amazon Bedrock.

Can identify unauthorized access attempts by logging and monitoring the API calls, which helps in setting appropriate IAM policies and roles.

Why Option B is Correct:

Monitoring and Security: CloudTrail logs all access requests and helps detect unauthorized access attempts.

Auditing and Compliance: The logs can be used to audit user activity and enforce security measures.

Why Other Options are Incorrect:

A. AWS Audit Manager: Used for automating audit preparation, not for tracking real-time unauthorized access attempts.

C. Amazon Fraud Detector: Designed to detect fraudulent online activities, not unauthorized access to AWS services.

D. AWS Trusted Advisor: Provides best practice recommendations for AWS resources, not access monitoring.

Thus, B is the correct answer for identifying unauthorized users attempting to access Amazon Bedrock.

Amazon Augmented AI (Amazon A2I) is designed to enable human review workflows for machine learning predictions where human judgment is required. AWS documentation states that A2I allows organizations to integrate human reviewers into AI workflows to review low-confidence predictions or samples selected by business rules. This directly aligns with the requirement to involve employees in validating and improving translation outputs.

In this scenario, the translation model produces a confidence score, which is a common trigger used by Amazon A2I to route predictions to human reviewers. AWS explicitly describes that A2I supports use cases such as natural language processing, translation, content moderation, and document processing, where automated models may need human oversight to ensure accuracy and quality.

Amazon A2I provides managed workflows, reviewer task interfaces, and audit trails that allow employees to review, correct, and validate model outputs. The feedback collected through A2I can then be used to improve future model training, increasing translation quality over time.

The other options do not meet the requirement. Amazon SageMaker Clarify focuses on bias detection and explainability, not human review workflows. Amazon SageMaker Model Monitor is used to detect data drift and model performance degradation in production, not to involve humans in validating predictions. Amazon Bedrock Agents are designed to orchestrate tasks and interactions with foundation models, not to manage human-in-the-loop review processes.

AWS positions Amazon A2I as a core service for implementing human-in-the-loop machine learning, making it the correct solution for incorporating employees into a structured translation review process.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

BLEU is a widely used metric for evaluating machine translation by comparing machine-generated translations against reference (human) translations.

In this scenario:

Both systems are evaluated on the same dataset

The goal is to compare model output against human output

AWS ML evaluation guidance describes BLEU as suitable for relative comparison of translation quality across systems.

Why the other options are incorrect:

Absolute quality (A, C) is difficult to measure without human judgment.

BERTScore (D) is more computationally complex and less standard for operational comparisons.

AWS AI document references:

Evaluating Machine Translation Models

NLP Model Evaluation Metrics

Comparing AI and Human Translations

The verified answer is A. Present the model Shapley values. AWS documentation states that SageMaker Clarify provides feature attributions based on Shapley values. These values can determine the contribution each feature made to model predictions and can be provided for individual predictions or at a global level for the model as a whole. That is exactly what stakeholders need when they ask for transparency and explainability: they need to understand which features influenced the model’s decisions and how strongly those features contributed.

AWS also explains that SageMaker Clarify helps explain how ML models make predictions and that transparency is critical for consumers and regulators. Clarify’s explainability uses a model-agnostic feature attribution approach and includes a scalable implementation of SHAP. These explanations answer practical stakeholder questions such as why the model made a prediction, how it makes predictions, and which features have the largest influence on model behavior.

Option B is incorrect because accuracy measures predictive correctness, not explainability. A model can be highly accurate while still being opaque. Accuracy alone does not show why a specific prediction was made.

Option C is incorrect because a confusion matrix summarizes classification performance by showing true positives, false positives, true negatives, and false negatives. It is useful for evaluation, but it does not explain individual feature influence or model reasoning.

Option D is incorrect because a secure inference endpoint protects access to the deployed model. Security is important, but it does not provide transparency or explainability.

Therefore, presenting Shapley values is the correct solution because it directly explains feature contributions to model predictions.

When you have a labeled dataset and need to scale a generative AI solution for more complex or diverse product categories, fine-tuning the foundation model with your dataset is the best approach for consistent, accurate tagging.

D is correct:

“Fine-tuning a foundation model with your labeled data allows the model to generalize to new categories and improve tagging accuracy for your inventory.”

(Reference: Amazon Bedrock Fine-Tuning, AWS Generative AI)

A (zero-shot) and B (prompt templates) do not leverage the labeled data or scale as accurately.

C (continued pre-training) uses unlabeled data, not labeled.

ISO certifications apply to processes, frameworks, and systems — not individuals or every piece of software.

When a company is ISO-certified, its development framework and governance processes comply with ISO standards for security, risk, or AI responsibility.

???? Reference:

AWS Compliance Programs – ISO

The verified answer is B. Data leakage. The model exposes sensitive company information because that information was inadvertently included in training data. AWS guidance warns that using sensitive data to train models can cause unintended disclosure of data from model output, including data leakage during inference. This is exactly the scenario: sensitive information entered the training process and later appeared in model output after deployment.

AWS security reference guidance for generative AI model customization identifies sensitive information disclosure as a threat where a model trained on datasets containing PII leaks sensitive information during inference. Although the question says company information rather than PII specifically, the same security principle applies: protected data included in training or continued pre-training can be memorized or reproduced by the model later.

Jailbreaking is incorrect because jailbreaking refers to attempts to bypass model safety controls through adversarial prompts. The problem here is not that a user bypassed safety controls; the sensitive information was already embedded through training data.

Contextual grounding is incorrect because grounding is a technique for improving answer accuracy by connecting model responses to trusted context, such as RAG sources. It is not a security risk.

Prompt injection is incorrect because prompt injection involves malicious input that attempts to override or manipulate model behavior at inference time. The question does not describe a malicious prompt. It describes accidental exposure from training data.

Therefore, the correct security risk is data leakage.

The mobile app for users with visual impairment needs to hear user speech and provide voice responses, requiring speech-to-text (speech recognition) and text-to-speech capabilities. Deep learning neural networks are widely used for speech recognition tasks, as they can effectively process and transcribe spoken language. AWS services like Amazon Transcribe, which uses deep learning for speech recognition, can fulfill this requirement by converting user speech to text, and Amazon Polly can generate voice responses.

Exact Extract from AWS AI Documents:

From the AWS Documentation on Amazon Transcribe:

" Amazon Transcribe uses deep learning neural networks to perform automatic speech recognition (ASR), converting spoken language into text with high accuracy. This is ideal for applications requiring voice input, such as accessibility features for visually impaired users. "

(Source: Amazon Transcribe Developer Guide, Introduction to Amazon Transcribe)

Detailed Explanation:

Option A: Use a deep learning neural network to perform speech recognition.This is the correct answer. Deep learning neural networks are the foundation of modern speech recognition systems, as used in AWS services like Amazon Transcribe. They enable the app to hear and transcribe user speech, and a service like Amazon Polly can handle voice responses, meeting the requirements.

Option B: Build ML models to search for patterns in numeric data.This option is irrelevant, as the task involves processing speech (audio data) and generating voice responses, not analyzing numeric data patterns.

Option C: Use generative AI summarization to generate human-like text.Generative AI summarization focuses on summarizing text, not processing speech orgenerating voice responses. This option does not address the core requirement of speech recognition.

Option D: Build custom models for image classification and recognition.Image classification and recognition are unrelated to processing speech or generating voice responses, making this option incorrect for an app focused on audio interaction.

The verified answer is C. To break text into smaller units for processing. AWS defines tokenization as the process of breaking input text into smaller units called tokens. These tokens can be words, subwords, or characters, and tokenization is used as a preprocessing step for natural language processing tasks. This exactly matches option C.

Tokenization is fundamental because machine learning and generative AI systems do not process raw human language in the same way humans read sentences. Text must first be split into units the model can represent, count, embed, and process mathematically. For example, a sentence might be split into words, subword pieces, punctuation, or characters depending on the tokenizer and model architecture. These tokens can then be converted into numerical representations for downstream tasks such as classification, summarization, question answering, translation, or text generation.

Option A is incorrect because encryption protects data confidentiality by transforming readable text into unreadable ciphertext. Tokenization in NLP is not encryption. The original purpose is linguistic and computational processing, not data protection.

Option B is incorrect because compression reduces file size. Tokenization may reduce text into units, but its purpose is not storage compression. It prepares text for analysis by NLP systems.

Option D is incorrect because translation is a downstream NLP task that converts text from one language to another. Tokenization may be used before translation, but it is not itself translation.

The wording “break text into smaller units” is the defining phrase. Therefore, the correct answer is C.

In the context of AI, " hallucination " refers to the phenomenon where a model generates outputs that are plausible-sounding but are not grounded in reality or the training data. This problemoften occurs with large language models (LLMs) when they create information that sounds correct but is actually incorrect or fabricated.

Option B (Correct): " Hallucination " : This is the correct answer because the problem described involves generating content that sounds factual but is incorrect, which is characteristic of hallucination in generative AI models.

Option A: " Data leakage " is incorrect as it involves the model accidentally learning from data it shouldn ' t have access to, which does not match the problem of generating incorrect content.

Option C: " Overfitting " is incorrect because overfitting refers to a model that has learned the training data too well, including noise, and performs poorly on new data.

Option D: " Underfitting " is incorrect because underfitting occurs when a model is too simple to capture the underlying patterns in the data, which is not the issue here.

AWS AI Practitioner References:

Large Language Models on AWS: AWS discusses the challenge of hallucination in large language models and emphasizes techniques to mitigate it, such as using guardrails and fine-tuning.

The scenario involves analyzing customer feedback and automatically classifying it into categories such as product quality, customer service, and delivery experience. This task requires processing and understanding textual data, which is a core application of natural language processing (NLP). NLP encompasses techniques for analyzing, interpreting, and generating human language, including tasks like text classification, sentiment analysis, and topic modeling, all of which are relevant to this use case.

Exact Extract from AWS AI Documents:

From the AWS AI Practitioner Learning Path:

" Natural Language Processing (NLP) enables machines to understand and process human language. Common NLP tasks include text classification, sentiment analysis, named entity recognition, and topic modeling. Services like Amazon Comprehend can be used to classify text into predefined categories based on content. "

(Source: AWS AI Practitioner Learning Path, Module on AI and ML Concepts)

Detailed Explanation:

Option A: Computer visionComputer vision involves processing and analyzing visual data, such as images or videos. Since the scenario deals with textual customer feedback, computer vision is not applicable.

Option B: Natural language processing (NLP)This is the correct answer. The task of classifying customer feedback into categories requires understanding and processing text, which is an NLP task. AWS services like Amazon Comprehend are specifically designed for such text classification tasks.

Option C: Recommendation systemsRecommendation systems suggest items or content based on user preferences or behavior. The scenario does not involve recommending products or services but rather classifying feedback, so this option is incorrect.

Option D: Fraud detectionFraud detection involves identifying anomalous or fraudulent activities, typically in financial or transactional data. The scenario focuses on text classification, not anomaly detection, making this option irrelevant.

The correct answer is C because Amazon SageMaker JumpStart provides administrative controls that allow organizations to manage and restrict access to foundation models within the AWS environment.

According to the official AWS documentation:

" Amazon SageMaker JumpStart provides model access management capabilities that enable administrators to control which foundation models are visible and usable by end users. Using AWS Identity and Access Management (IAM) policies, you can restrict access to specific models or completely disable model discovery in JumpStart. "

This allows companies to enforce governance over which FMs their users can see and interact with, satisfying the requirement to control employee access to publicly available foundation models.

Explanation of other options:

A. AWS Cost Explorer is used to analyze billing and usage data but does not control access to services or models. It is helpful for budgeting and visibility, not access control.

B. AWS Artifact provides access to compliance reports and certifications, not tools for controlling user access to ML models.

D. Amazon OpenSearch Service is used for search and analytics on structured and unstructured data. It does not provide access control mechanisms for foundation models.

Referenced AWS AI/ML Documents and Study Guides:

Amazon SageMaker JumpStart Documentation – Model Access Management

AWS IAM Documentation – Restricting Access to SageMaker Resources

AWS Machine Learning Specialty Certification Guide – Security and Governance Section

Providing labeled data with both a prompt field and a completion field is the correct strategy for fine-tuning a foundation model (FM) on Amazon Bedrock.

Fine-Tuning Strategy:

To fine-tune a model, labeled data that pairs input prompts with the correct outputs (completions) is necessary.

This allows the model to learn the desired behavior or response style based on the provided examples.

Why Option A is Correct:

Proper Training Format: The prompt-completion pairs provide the necessary format for training the model to produce accurate outputs.

Customization: Ensures that the model is fine-tuned to the specific requirements of the company’s data and desired outputs.

Why Other Options are Incorrect:

B. Prepare a .txt file in .csv format: This does not align with the specific need for labeled data with prompts and completions.

C. Purchase Provisioned Throughput: Relates to read/write capacity in databases, not to model fine-tuning.

D. Train on journals and textbooks: Lacks the specific format and labeling required for fine-tuning.

Real-time inference is designed to provide immediate, low-latency predictions, which is necessary when the company requires near real-time latency for its ML models. This option is optimal when there is a need for fast responses, even with large input data sizes and substantial processing times.

Option A (Correct): " Real-time inference " : This is the correct answer because it supports low-latency requirements, which are essential for real-time applications where quick response times are needed.

Option B: " Serverless inference " is incorrect because it is more suited for intermittent, small-scale inference workloads, not for continuous, large-scale, low-latency needs.

Option C: " Asynchronous inference " is incorrect because it is used for workloads that do not require immediate responses.

Option D: " Batch transform " is incorrect as it is intended for offline, large-batch processing where immediate response is not necessary.

AWS AI Practitioner References:

Amazon SageMaker Inference Options: AWS documentation describes real-time inference as the best solution for applications that require immediate prediction results with low latency.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

In Amazon Bedrock evaluations, Completeness measures how thoroughly a model or agent response addresses all aspects of the user prompt.

AWS evaluation guidance for LLM-as-a-judge explains that:

Completeness focuses on coverage of prompt requirements

It is especially useful for evaluating multi-part questions

It is a built-in qualitative metric in agent evaluation workflows

Why the other options are incorrect:

ROUGE (A) measures text overlap, mainly for summarization.

Following instructions (C) evaluates adherence, not coverage.

Refusal (D) measures appropriate refusal behavior.

AWS AI document references:

Amazon Bedrock Model Evaluation

LLM-as-a-Judge Metrics

Evaluating Agent Responses on AWS

The company is building a chatbot using an LLM on Amazon Bedrock, and the chatbot needs to use content from previous customer messages to resolve requests. Adding previous messages to the model prompt (also known as providing conversation history) enables the LLM to maintain context across interactions, allowing it to respond coherently based on the ongoing conversation.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" To enable a large language model (LLM) to maintain context in a conversation, you can include previous messages in the model prompt. This approach, often referred to as providing conversation history, allows the LLM to generate responses that are contextually relevant toprior interactions. "

(Source: AWS Bedrock User Guide, Building Conversational Applications)

Detailed Explanation:

Option A: Turn on model invocation logging to collect messages.Model invocation logging records interactions for auditing or debugging but does not provide the LLM with access to previous messages during inference to maintain conversation context.

Option B: Add messages to the model prompt.This is the correct answer. Including previous messages in the prompt gives the LLM the conversation history it needs to respond appropriately, a common practice for chatbots on Amazon Bedrock.

Option C: Use Amazon Personalize to save conversation history.Amazon Personalize is for building recommendation systems, not for managing conversation history in a chatbot. This option is irrelevant.

Option D: Use Provisioned Throughput for the LLM.Provisioned Throughput in Amazon Bedrock ensures consistent performance for model inference but does not address the need to use previous messages in the conversation.

Building and training a generative AI model from scratch provides the company with the most ownership and control over security responsibilities. In this scenario, the company is responsible for all aspects of the security of the data, the model, and the infrastructure.

Option D (Correct): " Building and training a generative AI model from scratch by using specific data that a customer owns " : This is the correct answer because it involves complete ownership of the model, data, and infrastructure, giving the company the highest level of responsibility for security.

Option A: " Using a third-party enterprise application that has embedded generative AI features " is incorrect as the company has minimal control over the security of the AI features embedded within a third-party application.

Option B: " Building an application using an existing third-party generative AI foundation model (FM) " is incorrect because security responsibilities are shared with the third-party model provider.

Option C: " Refining an existing third-party generative AI FM by fine-tuning the model with business-specific data " is incorrect as the foundation model and part of the security responsibilities are still managed by the third party.

AWS AI Practitioner References:

Generative AI Security Scoping Matrix on AWS: AWS provides a security responsibility matrix that outlines varying levels of control and responsibility depending on the approach to developing and using AI models.

To determine customer sentiments based on written customer reviews, the company can use Amazon Comprehend and Amazon Bedrock.

Amazon Comprehend:

A natural language processing (NLP) service that uses machine learning to uncover insights and relationships in text.

Can analyze customer reviews to detect sentiments (positive, negative, neutral, or mixed) automatically.

Amazon Bedrock:

Provides access to foundational models (FMs) from multiple AI companies for tasks such as text generation, summarization, and sentiment analysis.

The company can use a pre-trained sentiment analysis model available on Amazon Bedrock for processing customer reviews.

Why Other Options are Incorrect:

A. Amazon Lex: Used for building conversational interfaces like chatbots, not for sentiment analysis.

C. Amazon Polly: Converts text to speech; it doesn ' t analyze sentiment.

E. Amazon Rekognition: Analyzes images and videos, not text.

Amazon Transcribe is the correct solution for converting audio from customer calls into text, allowing the company to analyze and extract key information from the conversations.

Amazon Transcribe:

It is a fully managed automatic speech recognition (ASR) service that converts speech into text, making it easier to perform text-based analysis on audio data.

After transcribing the audio, further analysis can be performed using other AWS services like Amazon Comprehend to extract insights such as sentiment, key phrases, or entities.

Why Option B is Correct:

Conversion to Text: Transcribing audio recordings is the first step in gaining insights from spoken conversations, allowing for further processing.

Enables Further Analysis: Once the audio is transcribed into text, other tools and services can be used to analyze the content more deeply.

Why Other Options are Incorrect:

A. Amazon Lex: Is used for building conversational interfaces, not for transcribing or analyzing audio from customer calls.

C. Amazon SageMaker Model Monitor: Monitors ML models for bias and data drift, not for audio analysis.

D. Amazon Comprehend: Can analyze text but cannot transcribe audio; it would be used after transcription is completed.

Step 1: Store meeting audio recordings in an Amazon S3 bucket.

Step 2: Convert meeting audio recordings to meeting text files by using Amazon Transcribe.

Step 3: Summarize meeting text files by using Amazon Bedrock.

The company wants to create an application to summarize meeting audio recordings, which requires a sequence of steps involving storage, speech-to-text conversion, and text summarization. Amazon S3 is the recommended storage service for audio files, Amazon Transcribe converts audio to text, and Amazon Bedrock provides generative AI capabilities for summarization. These three steps, in this order, create an efficient workflow for the application.

Exact Extract from AWS AI Documents:

From the Amazon Transcribe Developer Guide:

" Amazon Transcribe uses deep learning to convert audio files into text, supporting applications such as meeting transcription. Audio files can be stored in Amazon S3, and Transcribe can process them directly from an S3 bucket. "

From the AWS Bedrock User Guide:

" Amazon Bedrock provides foundation models that can perform text summarization, enabling developers to build applications that generate concise summaries from text data, such as meeting transcripts. "

(Source: Amazon Transcribe Developer Guide, Introduction to Amazon Transcribe; AWS Bedrock User Guide, Text Generation and Summarization)

Detailed Explanation:

Step 1: Store meeting audio recordings in an Amazon S3 bucket.Amazon S3 is the standard storage service for audio files in AWS workflows, especially for integration with services like Amazon Transcribe. Storing the recordings in S3 allows Transcribe to access and process them efficiently. This is the first logical step.

Step 2: Convert meeting audio recordings to meeting text files by using Amazon Transcribe.Amazon Transcribe is designed for automatic speech recognition (ASR), converting audio files (stored in S3) into text. This step is necessary to transform the meeting recordings into a format that can be summarized.

Step 3: Summarize meeting text files by using Amazon Bedrock.Amazon Bedrock provides foundation models capable of generative AI tasks like text summarization. Once the audio is converted to text, Bedrock can summarize the meeting transcripts, completing the application’s requirements.

Unused Options Analysis:

Convert meeting audio recordings to meeting text files by using Amazon Polly.Amazon Polly is a text-to-speech service, not for converting audio to text. This option is incorrect and not used.

Store meeting audio recordings in an Amazon Elastic Block Store (Amazon EBS) volume.Amazon EBS is for block storage, typically used for compute instances, not for storing files for processing by services like Transcribe. S3 is the better choice, so this option is not used.

Summarize meeting text files by using Amazon Lex.Amazon Lex is for building conversational interfaces (chatbots), not for text summarization. Bedrock is the appropriate service for summarization, so this option is not used.

Hotspot Selection Analysis:

The task requires selecting and ordering three steps from the list, with each step used exactly once or not at all. The selected steps—storing in S3, converting with Transcribe, and summarizing with Bedrock—form a complete and logical workflow for the application.