Data Engineer
We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and modern data platforms. The ideal candidate will have strong expertise in ETL/ELT development, cloud technologies, SQL, Python, and big data frameworks. This role requires collaboration with business stakeholders, data analysts, and data scientists to deliver high-quality, reliable data solutions that support analytics and business intelligence initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.
- Build and optimize data ingestion, transformation, and processing workflows.
- Develop and maintain data warehouses, data lakes, and lakehouse architectures.
- Ensure data quality, integrity, governance, and security across data platforms.
- Optimize SQL queries and data processing jobs for performance and scalability.
- Collaborate with business analysts, data scientists, and application teams to understand data requirements.
- Implement monitoring, logging, and automated validation for data pipelines.
- Troubleshoot production issues and provide timely resolution.
- Participate in code reviews and follow best practices for version control and CI/CD.
- Create technical documentation for data models, pipelines, and processes.
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- 5+ years of experience in Data Engineering.
- Strong proficiency in Python and SQL.
- Hands-on experience with Apache Spark and PySpark.
- Experience developing ETL/ELT pipelines using modern data engineering tools.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
- Experience with data warehouses such as Snowflake, Amazon Redshift, BigQuery, or Azure Synapse.
- Knowledge of workflow orchestration tools such as Apache Airflow, Azure Data Factory, or AWS Glue.
- Experience working with Git, CI/CD pipelines, and Agile methodologies.
- Strong analytical, troubleshooting, and problem-solving skills.
Top Searches
Job seekers searching for E-Solutions
Other job titles you may consider
Trending Searches in Pensacola, FL
Jobs currently in Demand