Data Engineer

  1. Home
  2. Careers
  3. Data Engineer

Data Engineer

Experience: 3-4 Years
 
Location: Remote
 
Job Description:
  • GCP Tools (Mandatory): BigQuery, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run, Cloud Composer (Airflow), Cloud Spanner, Bigtable.
  • Container Orchestration: Kubernetes (preferred on GKE) and Helm for managing and deploying containerized applications.
  • CI/CD and Automation: Jenkins for building CI/CD pipelines to automate deployment and testing of data pipelines.
  • Develop and Optimize Pipelines: Write efficient Python and SQL scripts to build data pipelines and ETL/ELT processes. Monitor and optimize workflows for performance and cost-effectiveness.
  • Data Integration and Orchestration: Design workflows to integrate data from various sources using GCP services and orchestrate tasks with Cloud Composer (Apache Airflow).
  • Programming Languages: Proficient in Python for data processing and automation, SQL for querying and data manipulation. Experience with Java is a plus.
  • DevOps Tools: Familiarity with Terraform or Deployment Manager for Infrastructure as Code (IaC) to manage GCP resources.
  • Monitoring and Logging: Experience with Cloud Monitoring, Datadog, or similar tools to track pipeline performance and ensure operational efficiency.
  • Data Engineering Skills: Expertise in ETL/ELT pipelines, data modeling, and data integration across large datasets.
  • Strong understanding of data warehousing and real-time data processing workflows.
  • Strong communication skills to work effectively with cross-functional teams and mentor junior developers.
  • Proven ability to lead in an Agile environment.
  • 3+ years of experience as a Data Engineer, with hands-on experience in Kubernetes, Helm, Python, and Jenkins.
  • Strong experience building and optimizing data pipelines and services in any cloud platform.
  • Proficiency in Python and SQL. Familiarity with Java and Docker is a plus.
Send your resumes to: career@ceiyone.com; saranya.ravikumar@ceiyone.com
 
Note: Please include the role in the subject line of the email.
Are you interested in this role?

FAQ's

Frequently asked question

Ceiyone offers a variety of roles in software development, project management, IT consulting, and emerging technology positions across departments.

We seek candidates with strong technical skills, problem-solving abilities, and passion for innovation in software and technology development.

Ceiyone values candidates with relevant technical qualifications, experience in software development, and expertise in emerging technologies or business processes.

We provide continuous learning opportunities, mentorship programs, and certifications to support your professional growth within software development and technology roles.

Yes, Ceiyone fosters internal promotions and career growth through training, mentorship, and access to new, challenging projects.

You still have a questions

Need more details about our software development services? Contact us!

Connect with us

Do you have a specific IT challenge, interest in a career at Ceiyone, or just want to get in touch?

    Book Free Consultation

    Guaranteed response within 8 business hours.

    Fill up your details
    Get Custom Solutions, Recommendations, Estimates.
    What's next?
    One of our Account Managers will contact you shortly