Data Engineer by Bigspark
Bigspark
- Accra
- Permanent
- Full-time
- Adhere and contribute to our delivery principles
- Develop and support scalable, extensible, and highly available data pipelines on heterogeneous datasets that power downstream applications
- Join a team with skills in either Python, Java, Scala..
- Interact with stakeholders and program management to understand client requirements
- Solution Design - Using predefined architectural components to agree an acceptable design
- Deliver software development for clients, whilst collaborating with team members at various levels across the globe
- Educated to at least BSc (Hons) level - preferably in Computer Science, Data Science or Mathematics
- At least 3-5 years in a commercial software environment
- Experience delivering multiple solutions using key techniques such as Data Modelling, DWH, Lakes, ETL, ELT, Virtualisation & Streaming
- Big data stack experience in one or more of the tools - Hadoop, Spark, Hive/Impala, Kafka, Snowflake
- Experience of storage formats Avro, Parquet, ORC
- Proficiency in object-oriented programming languages (Python, C#, Java, Scala)
- Experience with database integrations (SQL/NoSQL) and processing data at scale
- Understanding of source control management e.g. GitHub
- Experience in use of CI tools (Jenkins) or an understanding of their role
- Flexible in learning and working with new technologies
JobDirecta