Senior Data Engineer
About the role
Client Requirements
MUST BE
The CTG Experience
Recognized by The Washington Post as a Top Workplace in 2025 and 2026.
About the Role
Senior Data Engineer
You Will Get To
- Design, build, and maintain scalable
data pipelines, ETL/ELT workflows, and data models
Python, Apache Spark (PySpark), Databricks, dbt, SQL (PostgreSQL), and AWS Glue
.
- Develop and optimize
AWS-native
data platforms leveraging AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), Lambda, Step Functions, Amazon S3, Redshift, RDS, DMS, and CloudWatch .
- Build high-performance ingestion, transformation, and orchestration workflows for structured and semi-structured data using
Apache Iceberg, Parquet, ORC, and Avro
.
- Design and optimize analytical data platforms using
Amazon Athena, Trino, Hive, OpenSearch, and enterprise data catalog technologies
.
- Integrate enterprise and external data sources across relational and NoSQL platforms including
PostgreSQL, Oracle, Redshift, GraphDB, and other NoSQL databases
.
- Build
AI-enabled
Amazon Bedrock
RAG pipelines
vector search
Amazon S3 Vector
OpenSearch vector indexes
.
- Develop cloud infrastructure using
CloudFormation (Infrastructure as Code)
GitHub
Harness
CI/CD
SNS
SQS
EventBridge
for event-driven architectures.
- Improve the reliability, scalability, performance, and maintainability of enterprise data platforms through monitoring, troubleshooting, automation, and continuous optimization.
- Support mission-critical analytics and reporting solutions within large-scale
AWS-based federal data environments
FedRAMP
NIST 800-53
security controls.
- Lead modernization initiatives migrating legacy platforms including
IBM DataStage
Hadoop
RunDeck
, and shell-based workflows to cloud-native AWS services.
- Mentor junior engineers through technical guidance, architecture discussions, and code reviews while promoting engineering best practices.
- Collaborate with cross-functional teams in an
Agile
Who You Are
- A strategic data engineer who enjoys designing complex systems and solving complex challenges
- Strong in modern cloud-based solution design
- Comfortable balancing business needs with technical constraints and long-term strategy
- A strong communicator
- Collaborative, proactive, and comfortable navigating ambiguity
Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related technical field
- 9+ years of professional experience in data engineering or related domains
• Strong hands-on experience with:
•
Databricks
Apache Spark (PySpark)
Python
SQL (PostgreSQL)
dbt
for large-scale data engineering, ETL/ELT development, data transformation, and data modeling.
- Designing, building, and maintaining
AWS-native
AWS Glue
Amazon EMR
Amazon MWAA (Apache Airflow)
AWS Lambda
AWS Step Functions
Amazon S3
Amazon Redshift
Amazon RDS
AWS DMS
Amazon CloudWatch
.
- Developing scalable
data pipelines
workflow orchestration
data integration
solutions across enterprise environments.
- Working with modern data lake technologies including
Apache Iceberg
Parquet
ORC
Avro
.
- Designing and optimizing solutions using relational and NoSQL databases including
PostgreSQL
Redshift
Oracle
GraphDB
NoSQL
platforms.
- Building reliable, high-performance data platforms through
performance tuning
system optimization
ETL/ELT
Java
CI/CD
Harness
.
- Strong analytical and problem-solving skills
- Experience working in agile, iterative software development environments
- Ability to quickly learn and apply new technologies and domain knowledge
- Excellent written and verbal communication skills, with the ability to explain complex topics to diverse audiences
Nice to Have
- Experience supporting analytics, data engineering, or modernization initiatives for
financial regulators,
capital markets, or other highly regulated environments is a plus.
- Experience with
Kafka
(streaming/data pipelines)
- Experience with Docker and Kubernetes for containerization and orchestration
- Proficiency with Splunk for log aggregation and system monitoring
- Experience using Terraform for infrastructure automation and management
- Strong SQL skills, including performance tuning and complex query design
Salary
$130k to $165k annually.
Full Time Employee Benefits
- Remote Work (Hybrid roles will be specified in the job post)
- Competitive Compensation Package
- Medical, Dental, and Vision
- Life Insurance, Short/Long Term Disability
- Employee Assistance Program
- 401(k) with 4% matching
- Liberal PTO vacation policy
- Generous Annual Continuing Education
- Annual Wellness Budget
- Bonus Incentive Programs (Employee referrals and performance-based rewards)
Thanks for your interest in Capital Technology Group !
Capital Technology Group is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.
Originally posted on Himalayas
Not included in the source posting: about the role.
Skills
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.