AI Prompt Engineer

Job Title: AI Prompt Engineer

Job Category: Information Technology

Time Type: Full time

Minimum Clearance Required to Start: None

Employee Type: Regular

Percentage of Travel Required: Up to 10%

Type of Travel: Local

We are seeking a highly creative, technically proficient, and detail-oriented Prompt Engineer to join our growing AI team. This pivotal role will be responsible for designing, testing, and optimizing prompts for Large Language Models (LLMs) to achieve high-quality, and reliable outputs for various use cases. You will be instrumental in translating complex requirements into effective AI interactions. This role is ideal for someone who thrives on experimentation, understands how LLMs interpret language, and is passionate about unlocking the full potential of generative AI.

You will excel at developing innovative software solutions as part of a technically diverse and geographically disbursed team. A strong passion for AI technologies and experience with agile delivery and deploying software in short sprints.

Responsibilities:

• Prompt Design & Optimization: Develop, refine, and iterate on prompts for various generative AI models (LLMs) to elicit desired behaviors, responses, and creative outputs.
• Iterative Testing & Analysis: Conduct testing to compare prompt
• variations, analyze results drive continuous improvement.
• Collaboration: Work closely with multiple groups to integrate prompts to streamline manual processes.
• Research & Development: Stay abreast of the latest advancements in LLMs, generative AI, and prompt engineering techniques.
• Fine-tuning & RAG Support: Provide input and collaborate on strategies for model fine-tuning and Retrieval Augmented Generation (RAG) to further improve accuracy.
• Problem Solving: Debug unexpected model behaviors, identifying root causes within prompt structure, model limitations, or data context.

Required: Must be a U.S. Citizen with the ability to pass CBP background investigation, criteria include, but not limited to:

• 3-year check for felony convictions
• 1 year check for illegal drug use
• 1 year check for misconduct such as theft or fraud
• Must be available to work onsite in Ashburn, VA and/or Washington, D.C.
• Bachelor's degree in Computer Science, Software Engineering, Information Technology, or related field (equivalent experience may be considered in lieu of degree).
• 1+ years of software development experience, internships, or relevant academic project work.
• 1+ year of hands-on experience working with Large Language Models (e.g., OpenAI GPT series, Llama, Gemini) or other generative AI models.
• Experience with at least one programming language (Python, JavaScript/TypeScript)
• Familiarity with prompt engineering techniques (few-shot, chain-of-thought, structured outputs, function calling)

Desired:

• Problem-solving skills, with a data-driven approach to experimentation and optimization.
• Witten and verbal communication skills, with an ability to articulate complex technical concepts clearly.
• Ability to work independently and collaboratively in a fast-paced, evolving environment.
• Exposure to RAG concepts, including embeddings and vector databases
• Understanding of AI safety considerations (e.g., prompt injection, bias, data privacy)
• Exposure to Agile/Scrum development environments

This position is contingent on funding and may not be filled immediately. However, this position is representative of positions within CACI that are consistently available. Individuals who apply may also be considered for other positions at CACI.

What You Can Expect: