Demo Bedrock API Part 3

# invoke_model.py
import boto3
import json

inference_client = boto3.client("bedrock-runtime", region_name="us-east-1")

payload = {
    "prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>\nWhat is Generative AI? Answer in exactly 2 bullet points",
    "max_gen_len": 200,
    "temperature": 0.3,
    "top_p": 0.9,
}

response = inference_client.invoke_model(
    modelId="meta.llama3-8b-instruct-v1:0",
    body=json.dumps(payload),
)

response_body = json.loads(response["body"].read())
print(response_body["generation"])

alistair@HODEI-LEGION5:~/bedrock-demo-02$ /bin/python3 /home/alistair/bedrock-demo-02/invoke-model.py

Here are 2 bullet points that explain what Generative AI is:

• **Generative AI models are designed to create new, original content**: Unlike traditional AI models that are trained to perform specific tasks, generative AI models are trained to generate new data, such as images, music, text, or videos, that are unique and often indistinguishable from human-created content.

• **Generative AI models use machine learning algorithms to learn patterns and relationships in data**: Generative AI models are trained on large datasets and use machine learning algorithms to identify patterns, relationships, and structures in the data. This allows them to generate new content that is coherent, realistic, and often surprising, as they can combine and manipulate the patterns and relationships they've learned to create novel outputs.

alistair@HODEI-LEGION5:~/bedrock-demo-02$

# converse.py
import boto3
import json

inference_client = boto3.client("bedrock-runtime", region_name="us-east-1")

messages = [
    {
        "role": "user",
        "content": [
            {"text": "What is generative AI? Answer in one sentence"}
        ],
    }
]

models = [
    "amazon.nova-micro-v1:0",
    "meta.llama3-8b-instruct-v1:0",
]

for model_id in models:
    payload = {"messages": messages}
    response = inference_client.invoke_model(
        modelId=model_id,
        body=json.dumps(payload),
    )
    response_body = json.loads(response["body"].read())
    # Print the entire response body for inspection (format varies by model)
    print(f"\n{model_id}:\n")
    print(json.dumps(response_body, indent=2))

alistair@HODEI-LEGION5:~/bedrock-demo-02$ /bin/python3 /home/alistair/bedrock-demo-02/converse.py

amazon.nova-micro-v1:0:

Generative AI refers to advanced artificial intelligence systems capable of creating new content, such as text, images, or music, based on learned patterns from training data.

meta.llama3-8b-instruct-v1:0:

Generative AI refers to a type of artificial intelligence that can create new, original content, such as text, images, music, or videos, using algorithms and machine learning models that mimic human creativity and innovation.

alistair@HODEI-LEGION5:~/bedrock-demo-02$