Effective Prompting Guide

​

Why Prompt Quality Matters

• Understand your specific situation and constraints
• Draw on relevant AI industry expertise
• Provide more actionable and targeted guidance
• Save time by reducing follow-up questions
• Generate more useful documents and recommendations

​

The Anatomy of an Effective Prompt

​

1. Clear Objective

• “I need to evaluate vendors for a generative AI project”
• “I’m preparing to present our AI strategy to our board”
• “I need to prepare for a meeting with an AI vendor tomorrow”

I need to develop evaluation criteria to 
compare three enterprise LLM vendors (OpenAI, 
Anthropic, and Google) for our customer service use case.

​

2. Specific Instructions

• Create a specific document type
• Compare multiple options
• Analyze a particular vendor’s offering
• Suggest questions for a specific scenario

We are trying to decide whether ChatGPT Team or ChatGPT Enterprise 
is most appropriate for our business. I would like you to 
guide me through the decision process, and then help me 
create a summary document that I can share with the 
rest of our leadership team. 

​

3. Contextual Background

• Organization context: Industry, size, regulatory requirements
• Technical environment: Existing systems, integration requirements
• Team context: Stakeholder roles, expertise levels
• Project stage: Where you are in the process
• Timeline and constraints: Budget, deadlines, or other limitations

We're a financial services company with 
2,000 employees handling sensitive customer data. 
Our team is currently using a mix of free and 
paid personal ChatGPT accounts.  
Our team has limited AI expertise, and we need 
to present a recommendation to our executive team 
in three weeks.

​

4. Examples (When Applicable)

• Similar documents you’ve created before
• Formats you prefer
• Style or tone preferences
• What “good” looks like to you

We previously created a vendor evaluation 
for our CRM system that was well-received. 
It used a 1-5 scoring system with clear criteria 
definitions and included both quantitative 
metrics and qualitative assessments.

​

5. Exception Handling

• Risk factors specific to your industry
• Internal requirements or policies
• Particular concerns from stakeholders

Data residency is a critical concern for us as 
we operate in the EU and must comply with GDPR. 
Also, our security team has expressed concerns 
about prompt injection attacks.

​

6. Tone and Interaction Preferences

• Do you want a direct answer or a guided exploration?
• Do you prefer technical depth or executive summaries?
• Are you looking for coaching through a process?

I'd like you to guide me through this decision
process step by step, as I'll need to explain 
the rationale to stakeholders with varying levels 
of technical understanding.

​

Putting It All Together

Objective: I need to develop a proof of concept (POC) 
plan for evaluating LLM integration into our customer 
support system.

Instructions: Please help me create a structured POC 
plan document that outlines the testing approach, 
success criteria, and timeline.

Context: I'm the IT Director at a healthcare company 
with 1,500 employees. We're considering implementing 
an AI solution to help our support agents respond to 
common patient questions more efficiently. We currently 
use ServiceNow for our ticketing system and have a team 
of 20 support agents. We're at the validation stage of 
our procurement process and have shortlisted Microsoft 
Azure OpenAI Service and Anthropic Claude. 
Our budget is approximately $50,000 for the POC phase.

Example: We previously ran a successful POC for our 
patient portal that included 4 weeks of testing with 
clear success metrics (20% reduction in response time, 
90% accuracy rate).

Exceptions: We need to consider HIPAA compliance 
requirements throughout the testing process, and 
we cannot use actual patient data without additional 
security measures.

Tone preference: I would appreciate a collaborative 
approach where you guide me through the key decisions 
for the POC design, explaining the rationale for 
different testing approaches and helping me anticipate challenges.

​

Refining Your Prompts

1. Clarify your objective: “That’s helpful, but I’m specifically looking for…”
2. Add more context: “Let me provide some additional background…”
3. Request adjustments: “Can you format this differently to focus more on…”
4. Ask for alternatives: “What other approaches should we consider?”

​

Prompt Templates for Common AI Program Scenarios

​

AI Strategy and Vision

I need help defining the business problem we're trying to solve with AI technology. 
We're a [industry] company considering [general AI use case]. Our main challenges 
include [specific pain points]. Can you help me create a structured problem statement 
that will help align our stakeholders and quantify the potential impact?

​

C-Suite Collaboration

I need help getting buy-in from our Chief Financial Officer who is skeptical 
about the investment required to roll out ChatGPT Enterprise to all employees. 
Our organization is [brief context]. The key stakeholders include [roles]. 
Can you help me develop a comprehensive Discussion plan that will help me guide 
the conversation, understand her concerns, and address them. 

​

AI Governance and Risk

Please help me to draft an AI acceptable usage policy that we can share 
across our organisation.
We want to provide clear guidelines that encourages employee adoption of AI.
Please make it easily digestible as we will turn it into a GPT that employees
can access directly in our ChatGPT workspace. 

​

Change Enablement

Please help me design our AI Ambassador program. We want to invite 
10% of our employee base to become AI champions ahead of our wider rollout.
I need details of how to structure this program, how to select and invite
The right colleagues and a framework for training and inspiring them.   

​

Best Practices

• Start with guided tasks when available, as they’re designed to walk you through specific activities similar companies have faced.
• Be specific about what you’re trying to accomplish
• Include relevant details but avoid overwhelming with unnecessary information
• Use project-based chats rather than standalone conversations for ongoing strategic activities
• Upload relevant documents to your project to provide additional context
• Follow up with clarifying questions if Kowalah’s response isn’t quite what you needed

​

Common Prompting Mistakes to Avoid

• Being too vague: “Help me with AI strategy” provides little guidance
• Omitting crucial context: Not mentioning industry-specific requirements or constraints
• Asking complex questions without breaking them down into manageable parts
• Expecting mind-reading: Not clearly stating your objective or expectations
• Overlooking your audience: Not specifying who the output is intended for

​

Next Steps

• Explore example AI procurement questions
• Learn about the six procurement stages
• Start your first project