A global company in the crypto and blockchain technology space is seeking a qualified Senior Data Engineer to join the team. You'll be implementing scalable solution, allowing the company to operate quickly and accurately.
Responsibilities:
- Build prototypes to improve data engineering and evaluate new technologies
- Ability to build data connections to company's internal IT System
- Conduct code reviews and provide technical guidance to junior developers
- Continuously optimize and improve software performance and scalability
- Develop, customize, and configure self service tools to extract and analyze data from company's internal data store
- Build scalable and reliable data pipelines to collect, transform, load and curate data from blockchains and internal financial system
Requirements:
- 5+ years' experience
- Familiarity with design principles and experience building data pipelines
- Experience with SQL Server and use of common frameworks like Pandas, Spark or similar
- Familiarity with business requirements gathering for data sourcing
- Experience with data warehouse technologies and data modeling (Druid, Iceberg, Athena)
- Experience with various programming language (e.g. Python, Scala)
Bonus Points:
- Knowledge in designing and writing CI/CD
- Building and contributing to data lakes in the cloud
- Experience with cloud service such as AWS, GCP and/or Kubernetes
