
Sr Data Engineer – 15623
Contractor posted 2 days agoJob Detail
-
Job ID 22381
Job Description
This is a contract with a great organization. As a contractor for Smith Johnson, you are eligible for medical, dental, life, disability. Smith Johnson pays for 70% of your medical and dental and 100% of life and disability. The contract is also eligible for PTO/holiday accrued monthly. You are also eligible for a 3% retirement matching plan. Smith Johnson believes in taking care of our contractors.
Job Description:
You’ll be part of a team supporting our client’s Banking system modernization effort!
Do you want to take your career to the next level? Are you ready for the responsibility of working with high-profile clients? At CGI, you will solve challenging business and technical problems as a full-time consultant serving local, enterprise clients. You also can work on cutting edge technologies and cloud native development. Tired of the same old thing? Take your talents to a world class consulting firm that inspires personal and professional growth and values your ideas.
Responsibilities:
- Play key role in establishing and implementing migration patterns for the Data Lake Modernization project
- Actively migrate use cases from our on-premises Data Lake to Databricks on GCP
- Collaborate with Product Management and business partners to understand case requirements and reporting
- Adhere to internal development best practices/lifecycle (e.g. Testing, Code Reviews, CI/CD, Documentation)
- Document and showcase feature designs/workflows
- Participate in team meetings and discussions around product development
- Stay up to date on industry latest industry trends and design patterns
 Qualifications:
- 6+ years development experience with Spark (PySpark), Python and SQL
- Extensive knowledge building data pipelines
- Hands on experience with Databricks Development
- Strong experience developing on Linux OS
- Experience with scheduling and orchestration (e.g. Databricks Workflows, airflow, prefect, control-m)
- Solid understanding of distributed systems, data structures, design principles
- Comfortable communicating with teams via showcases/demos
- Agile Development Methodologies (e.g. SAFe, Kanban, Scrum)
- Bachelor’s in Computer Science, Computer Engineering or related field
Preferred:Â
- 3+ years experience with GIT
- 3+ years experience with CI/CD (e.g. Azure Pipelines)
- Experience with streaming technologies, such as Kafka, Spark
- Experience building applications on Docker and Kubernetes
- Cloud experience (e.g. Azure, Google)
Required skills
Other jobs you may like
-
Network Engineer – 15622
- Utah, United States